Popular GitHub Repositories for Horizontal Scaling

? CAMEL: Finding the Scaling Law of Agents. The first and the best multi-agent framework. https://www.camel-ai.org

[NeurIPS 2024 Best Paper][GPT beats diffusion?] [scaling laws in visual generation?] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

Statistical Machine Intelligence & Learning Engine

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

Awesome Reasoning LLM Tutorial/Survey/Guide

Scaled-YOLOv4: Scaling Cross Stage Partial Network

Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch

Bringing BERT into modernity via both architecture changes and scaling

Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.

[NeurIPS'22] PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategies

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways

Feature engineering is the process of using domain knowledge to extract features from raw data via data mining techniques. These features can be used to improve the performance of machine learning algorithms. Feature engineering can be considered as applied machine learning itself.

Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs

[CVPR 2023] VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

Long-RL: Scaling RL to Long Sequences

? MassGen: A Multi-Agent Scaling System Inspired by Grok Heavy and Gemini Deep Think. Discord channel: https://discord.com/invite/VVrT2rQaz5

LLaSA: Scaling Train-time and Inference-time Compute for LLaMA-based Speech Synthesis

Minimal reproduction of OneRec

[ICLR2025 Spotlight?] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters