Popular GitHub Repositories for Checkpointing

A GPipe implementation in PyTorch

Orbax provides common checkpointing and persistence utilities for JAX users

Simple gradient checkpointing for eager mode execution

An Elixir library for genetic programming and neuroevolution, implementing standard genetic algorithms and NEAT. Features parallel evaluation, checkpointing, and extensible operators for selection, crossover, and mutation. Solve optimization problems through evolution with a clean, flexible API.

Implementation of Proximal Policy Optimization (PPO) for training agents in OpenAI Gym environments, with configurable training, checkpointing, and visualization.

End-to-end fine-tuning of Hugging Face models using LoRA, QLoRA, quantization, and PEFT techniques. Optimized for low-memory with efficient model deployment

High-performance distributed translation system for large multilingual datasets using PySpark and OpenAI. Supports caching, checkpointing, and metadata-preserving Stata translation.

Made a web searching tool chatbot

Develop an AI application for classifying flower species using deep learning, featuring data preprocessing, model training, and inference capabilities.

Automatic checkpointing and job resubmission system for robust LLM training on Slurm-based HPC clusters. Collaboration with @vulus98