VulkanIlm

Tensors and Dynamic neural networks in Python with strong GPU acceleration

A high-throughput and memory-efficient inference and serving engine for LLMs

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

The fastai deep learning library

The fastai book, published as Jupyter Notebooks

A WebGL accelerated JavaScript library for training and deploying ML models.

A high-performance, zero-overhead, extensible Python compiler with built-in NumPy support

Open3D: A Modern Library for 3D Data Processing

Open deep learning compiler stack for cpu, gpu and specialized accelerators

NVIDIA? TensorRT? is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.