Popular GitHub Repositories for Runtime Attestation

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

An open-source runtime for composable workflows. Great for AI agents and CI/CD.

Secure open source cloud runtime for AI apps & AI agents

Silero VAD: pre-trained enterprise-grade Voice Activity Detector

A retargetable MLIR-based machine learning compiler and runtime toolkit.

Sparsity-aware deep learning inference runtime for CPUs

TTS with kokoro and onnx runtime

Modular AI runtime for robots

Agent Builder and Runtime by Docker Engineering

Provides the same proxy OpenAI API interface for different LLM models, and supports deployment to any Edge Runtime environment.

a fast and user-friendly runtime for transformer inference (Bert, Albert, GPT2, Decoders, etc) on CPU and GPU.

Amazon Bedrock Agentcore accelerates AI agents into production with the scale, reliability, and security, critical to real-world deployment.

A reactive runtime for building durable AI agents

NVIDIA Federated Learning Application Runtime Environment

yolort is a runtime stack for yolov5 on specialized accelerators such as tensorrt, libtorch, onnxruntime, tvm and ncnn.

Lightweight and portable LLM sandbox runtime (code interpreter) Python library.

GPU environment and cluster management with LLM support

YoloDotNet - A C# .NET 8.0 project for Classification, Object Detection, OBB Detection, Segmentation and Pose Estimation in both images and videos.

The all-in-one RWKV runtime box with embed, RAG, AI agents, and more.