Popular GitHub Repositories for Latency Constrained

A robust, efficient, low-latency speech-to-text library with advanced voice activity detection, wake word activation and instant transcription.

The world’s first real-time, distributed, cloud-edge collaborative multimodal AI Agent Framework that simultaneously supports C/C++/Go/Python/JS/TS

LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.

HelixDB is a powerful, graph-vector database built in Rust for millisecond query latency and ease of use.

Scalable, Low-latency and Hybrid-enabled Vector Search in Postgres. Revolutionize Vector Search, not Database.

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

Instant, controllable, local pre-trained AI models in Rust

OpenSPG is a Knowledge Graph Engine developed by Ant Group in collaboration with OpenKG, based on the SPG (Semantic-enhanced Programmable Graph) framework. Core Capabilities: 1) domain model constrained knowledge modeling, 2) facts and logic fused representation, 3) natively support KAG...

? Stateful Serverless Framework for Geo-distributed Edge AI Infra. with function calling support, write once, run on any model.

Starter-kit to build constrained agents with Nextjs, FastAPI and Langchain

This repository provides code for machine learning algorithms for edge devices developed at Microsoft Research India.

Safe RLHF: Constrained Value Alignment via Safe Reinforcement Learning from Human Feedback

TEN VAD: low-latency high-performance Voice Activity Detector

Aura is like Siri, but in your browser. An AI voice assistant optimized for low latency responses.

Fast & Simple Resource-Constrained Learning of Deep Network Structure

The Qualcomm? AI Hub Models are a collection of state-of-the-art machine learning models optimized for performance (latency, memory etc.) and ready to deploy on Qualcomm? devices.

Real-time inference for Stable Diffusion - 0.88s latency. Covers AITemplate, nvFuser, TensorRT, FlashAttention. Join our Discord communty: https://discord.com/invite/TgHXuSJEk6

Python re-implementation of the (constrained) spectral clustering algorithms used in Google's speaker diarization papers.

[ICLR 2020] "FasterSeg: Searching for Faster Real-time Semantic Segmentation" by Wuyang Chen, Xinyu Gong, Xianming Liu, Qian Zhang, Yuan Li, Zhangyang Wang

This repository contains the implementation of paper Online 3D Bin Packing with Constrained Deep Reinforcement Learning.