Popular GitHub Repositories for Approximate Computing

Making large AI models cheaper, faster and more accessible

Machine Learning、Deep Learning、PostgreSQL、Distributed System、Node.Js、Golang

Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance and scalability of a cloud-native database?.

Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.

? Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Build, Manage and Deploy AI/ML Systems

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 15+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!

The world’s first real-time, distributed, cloud-edge collaborative multimodal AI Agent Framework that simultaneously supports C/C++/Go/Python/JS/TS

AI Toolkit for Healthcare Imaging

Postgres with GPUs for ML/AI apps.

Numenta Platform for Intelligent Computing is an implementation of Hierarchical Temporal Memory (HTM), a theory of intelligence based strictly on the neuroscience of the neocortex.

mlpack: a fast, header-only C++ machine learning library

MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.

A distributed approximate nearest neighborhood search (ANN) library which provides a high quality vector index build, search and distributed online serving toolkits for large scale vector search scenario.

Nexa SDK is a comprehensive toolkit for supporting GGML and ONNX models. It supports text generation, image generation, vision-language models (VLM), Audio Language Model, auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.

Fast inference engine for Transformer models

Alink is the Machine Learning algorithm platform based on Flink, developed by the PAI team of Alibaba computing platform.

C++ tensors with broadcasting and lazy computing