Popular GitHub Repositories for Mpi Parallelization

Distributed training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.

A high-performance distributed training framework for Reinforcement Learning

Training and serving large-scale neural networks with auto parallelization.

Performance-optimized wheels for TensorFlow (SSE, AVX, FMA, XLA, MPI)

Pythonic tool for orchestrating machine-learning/high performance/quantum-computing workflows in heterogeneous compute environments.

This repository consists for gpu bootcamp material for HPC and AI

Optical Flow Prediction with TensorFlow. Implements "PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volume," by Deqing Sun et al. (CVPR 2018)

Pax is a Jax-based machine learning framework for training large scale models. Pax allows for advanced and fully configurable experimentation and parallelization, and has demonstrated industry leading model flop utilization rates.

Code and models for our ICCV 2021 paper "MINE: Towards Continuous Depth MPI with NeRF for Novel View Synthesis"

DeepHyper: Scalable Asynchronous Neural Architecture and Hyperparameter Search for Deep Neural Networks

Distributed and decentralized training framework for PyTorch over graph

An asynchronous/parallel method of AlphaGo Zero algorithm with Gomoku

Microsoft Finance Time Series Forecasting Framework (FinnTS) is a forecasting package that utilizes cutting-edge time series forecasting and parallelization on the cloud to produce accurate forecasts for financial data.

FedTorch is a generic repository for benchmarking different federated and distributed learning algorithms using PyTorch Distributed API.

Small scale distributed training of sequential deep learning models, built on Numpy and MPI.

The Lightning plugin ecosystem provides fast quantum state-vector and tensor network simulators written in C++ for use with PennyLane.

The Arbor multi-compartment neural network simulation library.

Intel(R) Machine Learning Scaling Library is a library providing an efficient implementation of communication patterns used in deep learning.

TePDist (TEnsor Program DISTributed) is an HLO-level automatic distributed system for DL models.

Machine learning operator & controller for Kubernetes