Popular GitHub Repositories for Corruption Aware Training

Learn how to design, develop, deploy and iterate on production-grade ML applications.

Making large AI models cheaper, faster and more accessible

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

This repository is primarily maintained by Omar Santos (@santosomar) and includes thousands of resources related to ethical hacking, bug bounties, digital forensics and incident response (DFIR), artificial intelligence security, vulnerability research, exploit development, reverse engineering, and more.

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

A WebGL accelerated JavaScript library for training and deploying ML models.

The Unity Machine Learning Agents Toolkit (ML-Agents) is an open-source project that enables games and simulations to serve as environments for training intelligent agents using deep reinforcement learning and imitation learning.

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

Machine Learning Engineering Open Book

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

Ongoing research training transformer models at scale

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

Open source libraries and APIs to build custom preprocessing pipelines for labeling, training, or production machine learning pipelines.

? Easy-to-use and powerful NLP and LLM library with ? Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including ?Text Classification, ? Neural Search, ? Question Answering, ?? Information Extraction, ? Document Intelligence, ? Sentiment Analysis etc.

Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)

Collection of scripts to aggregate image data for the purposes of training an NSFW Image Classifier

The official GitHub page for the survey paper "A Survey of Large Language Models".