Popular GitHub Repositories for Distilbert

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

Turkish BERT/DistilBERT, ELECTRA, ConvBERT and T5 models

An all-in-one AI audio playground using Cloudflare AI Workers to transcribe, analyze, summarize, and translate any audio file.

Models to perform neural summarization (extractive and abstractive) using machine learning transformers and a tool to convert abstractive summarization datasets to the extractive task.

Transformers 3rd Edition

DistilBERT / GPT-2 for on-device inference thanks to TensorFlow Lite with Android demo apps

A flexible, adaptive classification system for dynamic text classification

Build and train state-of-the-art natural language processing models using BERT

Pytorch-Named-Entity-Recognition-with-transformers

Simple State-of-the-Art BERT-Based Sentence Classification with Keras / TensorFlow 2. Built with HuggingFace's Transformers.

DBMDZ BERT, DistilBERT, ELECTRA, GPT-2 and ConvBERT models

Tensorflow and Keras implementation of the state of the art researches in Dialog System NLU

A collection of resources on using BERT (https://arxiv.org/abs/1810.04805 ) and related Language Models in production environments.

Multi-Class Text Classification for products based on their description with Machine Learning algorithms and Neural Networks (MLP, CNN, Distilbert).

This repository contains a DistilBERT model fine-tuned using the Hugging Face Transformers library on the IMDb movie review dataset. The model is trained for sentiment analysis, enabling the determination of sentiment polarity (positive or negative) within text reviews.

Distillation of BERT model with catalyst framework

FoodBERT: Food Extraction with DistilBERT

A small seq2seq punctuator tool based on DistilBERT

Topic clustering library built on Transformer embeddings and cosine similarity metrics.Compatible with all BERT base transformers from huggingface.

Compares the DistilBERT and MobileBERT architectures for mobile deployments.