Popular GitHub Repositories for Omni Wheel

Tensorflow prebuilt binary for Windows

LLaMA-Omni is a low-latency and high-quality end-to-end speech interaction model built upon Llama-3.1-8B-Instruct, aiming to achieve speech capabilities at the GPT-4o level.

Motion planning algorithms commonly used on autonomous vehicles. (path planning + path tracking)

Performance-optimized wheels for TensorFlow (SSE, AVX, FMA, XLA, MPI)

A framework for efficient model inference with omni-modality models

MLX Omni Server is a local inference server powered by Apple's MLX framework, specifically designed for Apple Silicon (M-series) chips. It implements OpenAI-compatible API endpoints, enabling seamless integration with existing OpenAI SDK clients while leveraging the power of local ML inference.

OmniVinci is an omni-modal LLM for joint understanding of vision, audio, and language.

A real-time interactive Omni Avatar built on LiveKit, which allows you to seamlessly integrate with any open source Avatar components (real-time model, visual, voice, memory, search, etc.).

This repository provides programs to build Retrieval Augmented Generation (RAG) code for Generative AI with LlamaIndex, Deep Lake, and Pinecone leveraging the power of OpenAI and Hugging Face models for generation and evaluation.

Prebuilt binary with Tensorflow Lite enabled. For RaspberryPi / Jetson Nano. Support for custom operations in MediaPipe. XNNPACK, XNNPACK Multi-Threads, FlexDelegate.

??Freeze-Omni: A Smart and Low Latency Speech-to-speech Dialogue Model with Frozen LLM

Stream-Omni is an end-to-end language-vision-speech chatbot that simultaneously supports interaction across various modality combinations.

Enterprise IM Solution with AI powered live chat, email support, omni-channel customer service & team im，alternative to slack + zendesk/intercom

A Survey of Spoken Dialogue Models (60 pages)

[CVPR 2024] "LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding, Reasoning, and Planning"; an interactive Large Language 3D Assistant.

LLMVoX: Autoregressive Streaming Text-to-Speech Model for Any LLM

An Open-source Omni Chatbot for Long Speech and Voice Clone

two wheel legged robot for IsaacLab - reinforcement learning

MooER: Moore-threads Open Omni model for speech-to-speech intERaction. MooER-omni includes a series of end-to-end speech interaction models along with training and inference code, covering but not limited to end-to-end speech interaction, end-to-end speech translation and speech recognition.

The lodash for GenAI, stop reinventing the wheel