KVQuant

? Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

21 Lessons, Get Started Building with Generative AI ? https://microsoft.github.io/generative-ai-for-beginners/

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

A high-throughput and memory-efficient inference and serving engine for LLMs

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Port of OpenAI's Whisper model in C/C++

?? - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

Making large AI models cheaper, faster and more accessible

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.