Popular GitHub Repositories for Audio Driven Talking Face

[CVPR 2023] SadTalker：Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation

Diffusion-based Portrait and Animal Animation

JoyHallo: Digital human model for Mandarin

PyTorch Implementation for Paper "Emotionally Enhanced Talking Face Generation" (ICCVW'23 and ACM-MMW'23)

[ECCV 2024] Dyadic Interaction Modeling for Social Behavior Generation

Using a single image and just 10 seconds of sample audio, our project enables you to create a video where it appears as if you're speaking the desired text.

Use one line code to call SadTalker API with modelscope

DoyenTalker uses deep learning techniques to generate personalized avatar videos that speak user-provided text in a specified voice. The system utilizes Coqui TTS for text-to-speech generation, along with various face rendering and animation techniques to create a video where the given avatar articulates the speech.