Popular GitHub Repositories for Linear Scaling

100 Days of ML Coding

Machine Learning From Scratch. Bare bones NumPy implementations of machine learning models and algorithms with a focus on accessibility. Aims to cover everything from linear regression to deep learning.

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

MIT Deep Learning Book in PDF format (complete and parts) by Ian Goodfellow, Yoshua Bengio and Aaron Courville

? CAMEL: Finding the Scaling Law of Agents. The first and the best multi-agent framework. https://www.camel-ai.org

WebGL-accelerated ML // linear algebra // automatic differentiation for JavaScript.

[NeurIPS 2024 Best Paper][GPT beats diffusion?] [scaling laws in visual generation?] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

CUDA Templates for Linear Algebra Subroutines

Detailed and tailored guide for undergraduate students or anybody want to dig deep into the field of AI with solid foundation.

H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

Code for Tensorflow Machine Learning Cookbook

Statistical Machine Intelligence & Learning Engine

Contains Solutions and Notes for the Machine Learning Specialization By Stanford University and Deeplearning.ai - Coursera (2022) by Prof. Andrew NG

A complete guide to start and improve in machine learning (ML), artificial intelligence (AI) in 2025 without ANY background in the field and stay up-to-date with the latest news and state-of-the-art techniques!

Accompanying source code for Machine Learning with TensorFlow. Refer to the book for step-by-step explanations.

Plain python implementations of basic machine learning algorithms

SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformer

High performance, easy-to-use, and scalable machine learning (ML) package, including linear model (LR), factorization machines (FM), and field-aware factorization machines (FFM) for Python and CLI interface.

Implementation for MatMul-free LM.

? Efficient implementations of state-of-the-art linear attention models in Torch and Triton