Popular GitHub Repositories for Carbon Aware Computing

Making large AI models cheaper, faster and more accessible

Machine Learning、Deep Learning、PostgreSQL、Distributed System、Node.Js、Golang

Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.

? Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Build, Manage and Deploy AI/ML Systems

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 15+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

AI Toolkit for Healthcare Imaging

Numenta Platform for Intelligent Computing is an implementation of Hierarchical Temporal Memory (HTM), a theory of intelligence based strictly on the neuroscience of the neocortex.

The world’s first real-time, distributed, cloud-edge collaborative multimodal AI Agent Framework that simultaneously supports C/C++/Go/Python/JS/TS

mlpack: a fast, header-only C++ machine learning library

MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.

Context aware, pluggable and customizable data protection and de-identification SDK for text and images

Nexa SDK is a comprehensive toolkit for supporting GGML and ONNX models. It supports text generation, image generation, vision-language models (VLM), Audio Language Model, auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.

Fast inference engine for Transformer models

Alink is the Machine Learning algorithm platform based on Flink, developed by the PAI team of Alibaba computing platform.

A Streamlit-powered Chat Assistant utilizing Ollama's DeepSeek-R1 (1.5B) model for intelligent, context-aware conversations. Designed with an interactive chat interface, adjustable model parameters. It leverages Ollama for local model serving and Streamlit for a responsive UI for text-based interactions.

C++ tensors with broadcasting and lazy computing

? ? ? ? GraphScope: A One-Stop Large-Scale Graph Computing System from Alibaba | 一站式图计算系统

Sparsity-aware deep learning inference runtime for CPUs