Amphion

:robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

AudioLDM: Generate speech, sound effects, music and beyond, with text.

Implementation of AudioLM, a SOTA Language Modeling Approach to Audio Generation out of Google Research, in Pytorch

Text-to-Audio/Music Generation

TTS Generation Web UI (Bark, MusicGen + AudioGen, Tortoise, RVC, Vocos, Demucs, SeamlessM4T, MAGNet, StyleTTS2, MMS, Stable Audio, Mars5, F5-TTS, ParlerTTS)

Audio generation using diffusion models, in PyTorch.

A timeline of the latest AI models for audio generation, starting in 2023!

[CVPR 2025] Taming Multimodal Joint Training for High-Quality Video-to-Audio Synthesis

A family of diffusion models for text-to-audio generation.

A webui for different audio related Neural Networks