Popular GitHub Repositories for Audio Visual

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

Instant voice cloning by MIT and MyShell. Audio foundation model.

Cross-platform, customizable ML solutions for live and streaming media.

Easily train a good VC model with voice data <= 10 mins!

? Diffusers: State-of-the-art diffusion models for image, video, and audio generation in PyTorch and FLAX.

? Create, share, and use custom AI code assistants with our open-source IDE extensions and hub of models, rules, prompts, docs, and other building blocks

SoftVC VITS Singing Voice Conversion

Deezer source separation library including pretrained models.

Invoke is a leading creative engine for Stable Diffusion models, empowering professionals, artists, and enthusiasts to generate and create visual media using the latest AI-driven technologies. The solution offers an industry leading WebUI, and serves as the foundation for multiple commercial products.

FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.

[NeurIPS'23 Oral] Visual Instruction Tuning (LLaVA) built towards GPT-4V level capabilities and beyond.

GUI for a Vocal Remover that uses Deep Neural Networks.

CVPR 2025 论文和开源项目合集

:sparkles::sparkles:Latest Advances on Multimodal Large Language Models

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

Buzz transcribes and translates audio offline on your personal computer. Powered by OpenAI's Whisper.

[CVPR 2023] SadTalker：Learning Realistic 3D Motion Coefficients for Stylized Audio-Driven Single Image Talking Face Animation

Awesome pre-trained models toolkit based on PaddlePaddle. (400+ models including Image, Text, Audio, Video and Cross-Modal with Easy Inference & Serving)

Drench yourself in Deep Learning, Reinforcement Learning, Machine Learning, Computer Vision, and NLP by learning from these exciting lectures!!