100DaysOfGPUProgramming

A high-throughput and memory-efficient inference and serving engine for LLMs

The Modular Platform (includes MAX & Mojo)

SGLang is a fast serving framework for large language models and vision language models.

Filament是一个实时物理渲染引擎，支持Android、iOS、Windows、Linux、macOS和WebGL2平台。

kaldi-asr/kaldi is the official location of the Kaldi project.

Open3D: A Modern Library for 3D Data Processing

Open deep learning compiler stack for cpu, gpu and specialized accelerators

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in performant way.

Open source alternative to AWS. Elastic compute, block storage (non replicated), firewall and load balancer, managed Postgres, and IAM services in public beta.

NumPy aware dynamic Python compiler using LLVM