Popular GitHub Repositories for Ddp

Unofficial implementation of Palette: Image-to-Image Diffusion Models by Pytorch

An On-Chain Open-Source Platform for Rapid AI Model Productization Using Decentralized Resources with Flexibility and Scalability

dask-pytorch-ddp is a Python package that makes it easy to train PyTorch models on dask clusters using distributed data parallel.

Code for Active Learning at The ImageNet Scale. This repository implements many popular active learning algorithms and allows training with torch's DDP.

bert_seq2seq的DDP版本，支持bert、roberta、nezha、t5、gpt2等模型，支持seq2seq、ner、关系抽取等任务，无需添加额外代码，轻松启动DDP多卡训练。

Optimizing the way of contrastive learning in PyTorch-DDP(DistributedDataParallel) multi-GPU training

A set of scripts and configurations for pretraining of Large Language Models (LLM)

WIP implementation of Probabilistic Differential Dynamic Programming in PyTorch

PyTorch distributed training comparison

This repository provides hands-on labs on PyTorch-based Distributed Training and SageMaker Distributed Training. It is written to make it easy for beginners to get started, and guides you through step-by-step modifications to the code based on the most basic BERT use cases.

Framework, Model & Kernel Optimizations for Distributed Deep Learning - Data Hack Summit

Implementation of SigLIP

A VQGAN implementation trained on CIFAR-10, supporting single-machine multi-GPU training via DDP. Adjustable params & commands for training/testing models.

Final project of the course "Large Scale AI Engineering" at ETH Zürich, FS2025. Implementation and benchmarking of pretokenization and Distributed Data Parallel (DDP) for efficient LLM training on the CSCS Alps supercomputer.