Popular GitHub Repositories for Serverless Computing

ComfyUI docker images for use in GPU cloud and local environments. Includes AI-Dock base for authentication and improved user experience.

? The Cloud-Native API Gateway and AI Gateway.

Making large AI models cheaper, faster and more accessible

The Cloud-Native API Gateway and AI Gateway

Machine Learning、Deep Learning、PostgreSQL、Distributed System、Node.Js、Golang

Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals.

? Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

Build, Manage and Deploy AI/ML Systems

A fast, scalable, high performance Gradient Boosting on Decision Trees library, used for ranking, classification, regression and other machine learning tasks for Python, R, Java, C++. Supports computation on CPU and GPU.

SkyPilot: Run AI and batch jobs on any infra (Kubernetes or 15+ clouds). Get unified execution, cost savings, and high GPU availability via a simple interface.

Developer-friendly, serverless vector database for AI applications. Easily add long-term memory to your LLM apps!

AI Toolkit for Healthcare Imaging

Numenta Platform for Intelligent Computing is an implementation of Hierarchical Temporal Memory (HTM), a theory of intelligence based strictly on the neuroscience of the neocortex.

The world’s first real-time, distributed, cloud-edge collaborative multimodal AI Agent Framework that simultaneously supports C/C++/Go/Python/JS/TS

Flexible and powerful framework for managing multiple AI agents and handling complex conversations

Serverless AI Workflows for Data & ML Teams

mlpack: a fast, header-only C++ machine learning library

MACE is a deep learning inference framework optimized for mobile heterogeneous computing platforms.

The Cloud-Native API Gateway and AI Gateway

Nexa SDK is a comprehensive toolkit for supporting GGML and ONNX models. It supports text generation, image generation, vision-language models (VLM), Audio Language Model, auto-speech-recognition (ASR), and text-to-speech (TTS) capabilities.