Popular GitHub Repositories for Large Scale

Making large AI models cheaper, faster and more accessible

A high-performance distributed training framework for Reinforcement Learning

Large-scale Point Cloud Semantic Segmentation with Superpoint Graphs

[CVPR 2021] SpinNet: Learning a General Surface Descriptor for 3D Point Cloud Registration

DSIR large-scale data selection framework for language model training

Data-driven model reduction library with an emphasis on large scale parallelism and linear subspace methods

[MICCAI'23] Foundation Model for Endoscopy Video Analysis via Large-scale Self-supervised Pre-train

FFHQR -- the first large-scale retouching dataset for computer vision research.

BioDynaMo is a high-performance and modular, agent-based simulation platform.

An efficient 3D semantic segmentation framework for Urban-scale point clouds like SensatUrban, Campus3D, etc.

一个基于原生 PyTorch 的大型 M-LLM（文本/音频）训练库，支持张量并行 (tp)、模型并行 (cp)、数据并行 (dp) 和流水线并行 (pp)。

NeuroEvolution Optimization with Reinforcement Learning

Official implementation of Balanced Spherical Grid for Egocentric View Synthesis (CVPR 2023)

Overlapping community detection in Large-Scale Networks using BigCLAM model build on Apache Spark

[ICML'24 Oral] Rethinking Post-Hoc Search-Based Neural Approaches for Solving Large-Scale Traveling Salesman Problems

Code for "Can We Scale Transformers to Predict Parameters of Diverse ImageNet Models?" [ICML 2023]

A Really Scalable RL Framework to 10k+ CPUs

An AI-powered interactive video retrieval system

Stochastic Testing and Input Manipulation for Unbiased Learning Systems

Search engine for semi-structured data (text and structured data) that provides all kinds of intelligent search features (keyword search, autocompletion, faceted search, error-tolerant search, synonym search, semantic search) very efficiently also on very large data.