Popular GitHub Repositories for Runtime

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

An open-source runtime for composable workflows. Great for AI agents and CI/CD.

Secure open source cloud runtime for AI apps & AI agents

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

A retargetable MLIR-based machine learning compiler and runtime toolkit.

Sparsity-aware deep learning inference runtime for CPUs

TTS with kokoro and onnx runtime

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

A reactive runtime for building durable AI agents

NVIDIA Federated Learning Application Runtime Environment

yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.

GPU environment and cluster management with LLM support

The all-in-one RWKV runtime box with embed, RAG, AI agents, and more.

YoloDotNet - A C# .NET 8.0 project for Classification, Object Detection, OBB Detection, Segmentation and Pose Estimation in both images and videos.

Amazon Bedrock Agentcore accelerates AI agents into production with the scale, reliability, and security, critical to real-world deployment.

Offline semantic Text-to-Image and Image-to-Image search on Android powered by quantized state-of-the-art vision-language pretrained CLIP model and ONNX Runtime inference engine

? Use YOLO11 in real-time for object detection tasks, with edge performance ?? powered by ONNX-Runtime.

?? extra-small AI SDK for Browser, Node.js, Deno, Bun or Edge Runtime.

Lightweight and portable LLM sandbox runtime (code interpreter) Python library.