Popular GitHub Repositories for Speech Driven Talking Face

? Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

real time face swap and one-click video deepfake with only a single image

For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.

Clone a voice in 5 seconds to generate arbitrary speech in real-time

Deepfakes Software For All

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

Port of OpenAI's Whisper model in C/C++

?? - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

A generative speech model for daily dialogue.

GFPGAN aims at developing Practical Algorithms for Real-world Face Restoration.

?AI拟声: 5秒内克隆您的声音并生成任意语音内容 Clone a voice in 5 seconds to generate arbitrary speech in real-time

Enhancing code comprehension with AI-driven explanations and a secure code snippet repository.

Instant voice cloning by MIT and MyShell. Audio foundation model.

OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation

one-click face swap

Real-time face swap for PC streaming or video calls

SoftVC VITS Singing Voice Conversion

Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. ?Docker-friendly.?Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, real-time data APIs, and more.

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

State-of-the-art 2D and 3D Face Analysis Project