Popular GitHub Repositories for Bi Modal Transformer

? Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

??? 60+ Implementations/tutorials of deep learning papers with side-by-side notes ?; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), ? reinforcement learning (ppo, dqn), capsnet, distillation, ... ?

A high-throughput and memory-efficient inference and serving engine for LLMs

Port of OpenAI's Whisper model in C/C++

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

OpenMMLab Detection Toolbox and Benchmark

???AI-driven database tool and SQL client, The hottest GUI client, supporting MySQL, Oracle, PostgreSQL, DB2, SQL Server, DB2, SQLite, H2, ClickHouse, and more.

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

SOTA Open Source TTS

? A ranked list of awesome machine learning Python libraries. Updated weekly.

CVPR 2025 论文和开源项目合集

MiniCPM-o 2.6: A GPT-4o Level MLLM for Vision, Speech and Multimodal Live Streaming on Your Phone

[NeurIPS 2022] Towards Robust Blind Face Restoration with Codebook Lookup Transformer

SGLang is a fast serving framework for large language models and vision language models.

pix2tex: Using a ViT to convert images of equations into LaTeX code.

This is an official implementation for "Swin Transformer: Hierarchical Vision Transformer using Shifted Windows".

Natural Language Processing Tutorial for Deep Learning Researchers

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

Ongoing research training transformer models at scale