Popular GitHub Repositories for Compound Scaling

? CAMEL: Finding the Scaling Law of Agents. The first and the best multi-agent framework. https://www.camel-ai.org

[NeurIPS 2024 Best Paper][GPT beats diffusion?] [scaling laws in visual generation?] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". An *ultra-simple, user-friendly yet state-of-the-art* codebase for autoregressive image generation!

Statistical Machine Intelligence & Learning Engine

TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.

Meltano: the declarative code-first data integration engine that powers your wildest data and ML-powered product ideas. Say goodbye to writing, maintaining, and scaling your own API integrations.

Scaled-YOLOv4: Scaling Cross Stage Partial Network

Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch

Awesome Reasoning LLM Tutorial/Survey/Guide

Bringing BERT into modernity via both architecture changes and scaling

Infinity ∞ : Scaling Bitwise AutoRegressive Modeling for High-Resolution Image Synthesis

Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.

[NeurIPS'22] PointNeXt: Revisiting PointNet++ with Improved Training and Scaling Strategies

Implementation of the specific Transformer architecture from PaLM - Scaling Language Modeling with Pathways

Feature engineering is the process of using domain knowledge to extract features from raw data via data mining techniques. These features can be used to improve the performance of machine learning algorithms. Feature engineering can be considered as applied machine learning itself.

Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"

[CVPR 2023] VideoMAE V2: Scaling Video Masked Autoencoders with Dual Masking

LLaSA: Scaling Train-time and Inference-time Compute for LLaMA-based Speech Synthesis

[ICLR2025 Spotlight?] Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters

This repository provides programs to build Retrieval Augmented Generation (RAG) code for Generative AI with LlamaIndex, Deep Lake, and Pinecone leveraging the power of OpenAI and Hugging Face models for generation and evaluation.

ReasonFlux: Hierarchical LLM Reasoning via Scaling Thought Templates