Popular GitHub Repositories for Sound Effects

Easy-to-use Speech Toolkit including Self-Supervised Learning model, SOTA/Streaming ASR with punctuation, Streaming TTS with text frontend, Speaker Verification System, End-to-End Speech Translation and Keyword Spotting. Won NAACL2022 Best Demo Award.

AudioGPT: Understanding and Generating Speech, Music, Sound, and Talking Head

A sound cloning tool with a web interface, using your voice or any sound to record audio / 一个带web界面的声音克隆工具，使用你的音色或任意声音来录制音频

DoWhy is a Python library for causal inference that supports explicit modeling and testing of causal assumptions. DoWhy is based on a unified language for causal inference, combining causal graphical models and potential outcomes frameworks.

ALICE (Automated Learning and Intelligence for Causation and Economics) is a Microsoft Research project aimed at applying Artificial Intelligence concepts to economic decision making. One of its goals is to build a toolkit that combines state-of-the-art machine learning techniques with econometrics in order to bring automation to complex causal inference problems. To date, the ALICE Python SDK (econml) implements orthogonal machine learning algorithms such as the double machine learning work of Chernozhukov et al. This toolkit is designed to measure the causal effect of some treatment variable(s) t on an outcome variable y, controlling for a set of features x.

AudioLDM: Generate speech, sound effects, music and beyond, with text.

A Python library for audio data augmentation. Useful for making audio ML models work well in the real world, not just in the lab.

? A comprehensive list of open-source datasets for voice and sound computing (95+ datasets).

Alias is a teachable “parasite” that is designed to give users more control over their smart assistants, both when it comes to customisation and privacy. Through a simple app the user can train Alias to react on a custom wake-word/sound, and once trained, Alias can take control over your home assistant by activating it for you.

Fast audio data augmentation in PyTorch. Inspired by audiomentations. Useful for deep learning.

Real-time voice-changer for voice-chat, etc. Will support many different voice-filters and features in the future. ?

AI Audio Datasets (AI-ADS) ?, including Speech, Music, and Sound Effects, which can provide training data for Generative AI, AIGC, AI model training, intelligent audio tool development, and audio applications.

Identify bird sounds in real time with this Android version of BirdNET. Bird sound recognition for more than 6,000 species worldwide.

Classify music genre from a 10 second sound stream using a Neural Network.

??? A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

SoundNet: Learning Sound Representations from Unlabeled Video. NIPS 2016

The official code repo of "HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection"

This is a list of sound, audio and music development tools which contains machine learning, audio generation, audio signal processing, sound synthesis, spatial audio, music information retrieval, music generation, speech recognition, speech synthesis, singing voice synthesis and more.

Download, Edit, and Generate Videos, Images and Sounds, in bulk using Chat & AI

Source code for "Taming Visually Guided Sound Generation" (Oral at the BMVC 2021)