Open Voice OS Server Status Page
X-Ray Vision for your infrastructure!
The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Prometheus, Loki, Elasticsearch, InfluxDB, Postgres and many more.
A high-throughput and memory-efficient inference and serving engine for LLMs
SGLang is a fast serving framework for large language models and vision language models.
kaldi-asr/kaldi is the official location of the Kaldi project.
Open3D: A Modern Library for 3D Data Processing
A curated list of Site Reliability and Production Engineering resources.
TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in performant way.
NumPy aware dynamic Python compiler using LLVM
NumPy & SciPy for GPU
