Popular GitHub Repositories for Horovod

cube studio开源云原生一站式机器学习/深度学习/大模型AI平台，支持sso登录，大数据平台对接，notebook在线开发，拖拉拽任务流pipeline编排，多机多卡分布式训练，超参搜索，推理服务VGPU，边缘计算，标注平台，自动化标注，大模型微调，vllm大模型推理，llmops，私有知识库，AI模型应用商店，支持模型一键开发/推理/微调，支持国产cpu/gpu/npu芯片，支持RDMA，支持pytorch/tf/mxnet/deepspeed/paddle/colossalai/horovod/spark/ray/volcano分布式，deepseek训练推理

TonY is a framework to natively run deep learning frameworks on Apache Hadoop.

A curated list of dedicated resources and applications

multi-gpu pre-training in one machine for BERT without horovod (Data Parallelism)

Neural network based solvers for partial differential equations and inverse problems :milky_way:. Implementation of physics-informed neural networks in pytorch.

GPU scheduler for elastic/distributed deep learning workloads in Kubernetes cluster (IC2E'23)

Distributed Training of Bayesian Neural Networks at Scale

Data-parallel PINNs with Horovod

Distributed training framework for TensorFlow, Keras

Scaling Unet in Tensorflow

Towards Rehearsal-based Continual Learning at Scale: distributed CL using Horovod + PyTorch on up to 128 GPUs

Horovod is a distributed deep learning training framework for TensorFlow, Keras, PyTorch, and Apache MXNet. The goal of Horovod is to make distributed deep learning fast and easy to use.

performance test of MNIST hand writings usign MXNet + TF