Popular GitHub Repositories for Lip Synchronization

Industry leading face manipulation platform

fay是一个帮助数字人（2.5d、3d、移动、pc、网页）或大语言模型（openai兼容、deepseek）连通业务系统的agent框架。

PaddlePaddle GAN library, including lots of interesting applications like First-Order motion transfer, Wav2Lip, picture repair, image editing, photo2cartoon, image style transfer, GPEN, and so on.

Real time interactive streaming digital human

Taming Stable Diffusion for Lip Sync!

MuseTalk: Real-Time High Quality Lip Synchorization with Latent Space Inpainting

? AChat - An open-source/self-hosted/local-first AI platform, designed for enterprises and teams, perfectly combining powerful local processing capabilities with seamless remote synchronization.

:unlock: Lip Reading - Cross Audio-Visual Recognition using 3D Architectures

High quality Lip sync

Wunjo CE: Face Swap, Lip Sync, Control Remove Objects & Text & Background, Restyling, Audio Separator, Clone Voice, Video Generation. Open Source, Local & Free.

实时语音交互数字人，支持端到端语音方案（GLM-4-Voice - THG）和级联方案（ASR-LLM-TTS-THG）。可自定义形象与音色，无须训练，支持音色克隆，首包延迟低至3s。Real-time voice interactive digital human, supporting end-to-end voice solutions (GLM-4-Voice - THG) and cascaded solutions (ASR-LLM-TTS-THG). Customizable appearance and voice, supporting voice cloning, with initial package delay as low as 3s.

[CVPR 2022] FaceFormer: Speech-Driven 3D Facial Animation with Transformers

让你的“女神”逆袭，代码撸彩妆（画妆）

Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.

Diffusion-based Portrait and Animal Animation

Industry leading face manipulation platform

PyTorch Implementation for Paper "Emotionally Enhanced Talking Face Generation" (ICCVW'23 and ACM-MMW'23)

This project is a digital human that can talk and listen to you. It uses OpenAI's GPT to generate responses, OpenAI's Whisper to transcript the audio, Eleven Labs to generate voice and Rhubarb Lip Sync to generate the lip sync.

Official Pytorch Implementation of FLOAT: Generative Motion Latent Flow Matching for Audio-driven Talking Portrait.

Industry leading face manipulation platform