Popular GitHub Repositories for Joint Audio Video Diffusion Transformer

Stable Diffusion web UI

? Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

ComfyUI docker images for use in GPU cloud and local environments. Includes AI-Dock base for authentication and improved user experience.

real time face swap and one-click video deepfake with only a single image

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

??? 60+ Implementations/tutorials of deep learning papers with side-by-side notes ?; including transformers (original, xl, switch, feedback, vit, ...), optimizers (adam, adabelief, sophia, ...), gans(cyclegan, stylegan2, ...), ? reinforcement learning (ppo, dqn), capsnet, distillation, ... ?

A high-throughput and memory-efficient inference and serving engine for LLMs

Port of OpenAI's Whisper model in C/C++

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

Instant voice cloning by MIT and MyShell. Audio foundation model.

Real-ESRGAN aims at developing Practical Algorithms for General Image/Video Restoration.

OpenMMLab Detection Toolbox and Benchmark

Easily train a good VC model with voice data <= 10 mins!

Cross-platform, customizable ML solutions for live and streaming media.

? Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch and FLAX.

Real-time face swap for PC streaming or video calls

SoftVC VITS Singing Voice Conversion

Deezer source separation library including pretrained models.

Invoke is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, and serves as the foundation for multiple commercial products.