Popular GitHub Repositories for Audio Video

real time face swap and one-click video deepfake with only a single image

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

Instant voice cloning by MIT and MyShell. Audio foundation model.

Real-ESRGAN aims at developing Practical Algorithms for General Image/Video Restoration.

Easily train a good VC model with voice data <= 10 mins!

Cross-platform, customizable ML solutions for live and streaming media.

? Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch and FLAX.

Real-time face swap for PC streaming or video calls

SoftVC VITS Singing Voice Conversion

Deezer source separation library including pretrained models.

GUI for a Vocal Remover that uses Deep Neural Networks.

stable diffusion webui colab

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

Video, Image and GIF upscale/enlarge(Super-Resolution) and Video frame interpolation. Achieved with Waifu2x, Real-ESRGAN, Real-CUGAN, RTX Video Super Resolution VSR, SRMD, RealSR, Anime4K, RIFE, IFRNet, CAIN, DAIN, and ACNet.

Buzz transcribes and translates audio offline on your personal computer. Powered by OpenAI's Whisper.

Netflix-level subtitle cutting, translation, alignment, and even dubbing - one-click fully automated AI video subtitle team | Netflix级字幕切割、翻译、对齐、甚至加上配音，一键全自动视频搬运AI字幕组

Annotate better with CVAT, the industry-leading data engine for machine learning. Used and trusted by teams at any scale, for data of any scale.

A machine learning-based video super resolution and frame interpolation framework. Est. Hack the Valley II, 2018.

Translate the video from one language to another and add dubbing. 将视频从一种语言翻译为另一种语言，同时支持语音识别转录、语音合成、字幕翻译。

[CVPR 2023] SadTalker：Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation