mlinfra

An Open Source Machine Learning Framework for Everyone

For developers, who are building real-time data-driven applications, Redis is the preferred, fastest, and most feature-rich cache, data structure server, and document and vector query engine.

The Patterns of Scalable, Reliable, and Performant Large-Scale Systems

A high-throughput and memory-efficient inference and serving engine for LLMs

YOLOv5 ? in PyTorch > ONNX > CoreML > TFLite

Learn how to design, develop, deploy and iterate on production-grade ML applications.

ClickHouse? is a real-time analytics database management system

Apache Airflow - A platform to programmatically author, schedule, and monitor workflows

The java implementation of Apache Dubbo. An RPC and microservice framework.

Making large AI models cheaper, faster and more accessible