Popular GitHub Repositories for Pure Transformer

? Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

A high-throughput and memory-efficient inference and serving engine for LLMs

??? 60+ Implementations/tutorials of deep learning papers with side-by-side notes ?; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), ? reinforcement learning (ppo, dqn), capsnet, distillation, ... ?

Port of OpenAI's Whisper model in C/C++

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

OpenMMLab Detection Toolbox and Benchmark

aka "Bayesian Methods for Hackers": An introduction to Bayesian methods + probabilistic programming with a computation/understanding-first, mathematics-second point of view. All in pure Python ;)

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

SOTA Open Source TTS

? A ranked list of awesome machine learning Python libraries. Updated weekly.

CVPR 2025 论文和开源项目合集

SGLang is a fast serving framework for large language models and vision language models.

[CVPR2023] Blur Interpolation Transformer for Real-World Motion from Blur

[NeurIPS 2022] Towards Robust Blind Face Restoration with Codebook Lookup Transformer

pix2tex: Using a ViT to convert images of equations into LaTeX code.

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".

Natural Language Processing Tutorial for Deep Learning Researchers

Ongoing research training transformer models at scale

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.