Convert ONNX models to plain C++ code (without dependencies)
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
A curated list of awesome C++ (or C) frameworks, libraries, resources, and shiny things. Inspired by awesome-... stuff.
A high-throughput and memory-efficient inference and serving engine for LLMs
ClickHouse? is a real-time analytics database management system
Port of OpenAI's Whisper model in C/C++
Making large AI models cheaper, faster and more accessible
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.
A generative speech model for daily dialogue.
Carbon Language's main repository: documents, design, implementation, and related tools. (NOTE: Carbon Language is experimental; see README)
