Popular GitHub Repositories for Transformer Networks

An Open Source Machine Learning Framework for Everyone

? Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Deep Learning for humans

??? 60+ Implementations/tutorials of deep learning papers with side-by-side notes ?; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), ? reinforcement learning (ppo, dqn), capsnet, distillation, ... ?

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Deepfakes Software For All

A high-throughput and memory-efficient inference and serving engine for LLMs

Port of OpenAI's Whisper model in C/C++

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

? Industrial-strength Natural Language Processing (NLP) in Python

PyTorch Tutorial for Deep Learning Researchers

OpenMMLab Detection Toolbox and Benchmark

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

The most cited deep learning papers

A curated list of awesome Deep Learning tutorials, projects and communities.

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

Graph Neural Network Library for PyTorch

SOTA Open Source TTS

? A ranked list of awesome machine learning Python libraries. Updated weekly.