GPUMD

Tensors and Dynamic neural networks in Python with strong GPU acceleration

A high-throughput and memory-efficient inference and serving engine for LLMs

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

The fastai deep learning library

A WebGL accelerated JavaScript library for training and deploying ML models.

SGLang is a fast serving framework for large language models and vision language models.

A high-performance, zero-overhead, extensible Python compiler with built-in NumPy support

kaldi-asr/kaldi is the official location of the Kaldi project.

Open3D: A Modern Library for 3D Data Processing

Open deep learning compiler stack for cpu, gpu and specialized accelerators