whisper-trtllm

A high-throughput and memory-efficient inference and serving engine for LLMs

This repository contains the Hugging Face Agents Course.

SGLang is a fast serving framework for large language models and vision language models.

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

kaldi-asr/kaldi is the official location of the Kaldi project.

Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node

Open3D: A Modern Library for 3D Data Processing

Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that orchestrate the inference execution in performant way.