Popular GitHub Repositories for Realtime Voice

real time face swap and one-click video deepfake with only a single image

For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.

Clone a voice in 5 seconds to generate arbitrary speech in real-time

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

?? - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

?AI拟声: 5秒内克隆您的声音并生成任意语音内容 Clone a voice in 5 seconds to generate arbitrary speech in real-time

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

Instant voice cloning by MIT and MyShell. Audio foundation model.

Easily train a good VC model with voice data <= 10 mins!

SoftVC VITS Singing Voice Conversion

A open, local Manus AI alternative. Powered with Deepseek R1. No APIs, no $456 monthly bills. Enjoy an AI agent that reason, code, and browse with no worries.

? Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants

? Leon is your open-source personal assistant.

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

Netflix-level subtitle cutting, translation, alignment, and even dubbing - one-click fully automated AI video subtitle team | Netflix级字幕切割、翻译、对齐、甚至加上配音，一键全自动视频搬运AI字幕组

Offline speech recognition API for Android, iOS, Raspberry Pi and servers with Python, Java, C# and Node

Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.

A Fundamental End-to-End Speech Recognition Toolkit and Open Source SOTA Pretrained Models, Supporting Speech Recognition, Voice Activity Detection, Text Post-processing etc.

Convert ebooks to audiobooks with chapters and metadata using dynamic AI models and voice cloning. Supports 1,107+ languages!

A PyTorch-based Speech Toolkit