Popular GitHub Repositories for Microsoft Speech

? Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

21 Lessons, Get Started Building with Generative AI ? https://microsoft.github.io/generative-ai-for-beginners/

Clone a voice in 5 seconds to generate arbitrary speech in real-time

1 min voice data can also be used to train a good TTS model! (few shot voice cloning)

Port of OpenAI's Whisper model in C/C++

12 Weeks, 24 Lessons, AI for All!

?? - a deep learning toolkit for Text-to-Speech, battle-tested in research and production

A generative speech model for daily dialogue.

?AI拟声: 5秒内克隆您的声音并生成任意语音内容 Clone a voice in 5 seconds to generate arbitrary speech in real-time

Instant voice cloning by MIT and MyShell. Audio foundation model.

SoftVC VITS Singing Voice Conversion

DeepSpeech is an open source embedded (offline, on-device) speech-to-text engine which can run in real time on devices ranging from a Raspberry Pi 4 to high power GPU servers.

? The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

MiniCPM-o 2.6: A GPT-4o Level MLLM for Vision, Speech and Multimodal Live Streaming on Your Phone

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning tasks.

Open source simulator for autonomous vehicles built on Unreal Engine / Unity, from Microsoft AI & Research

Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything