Popular GitHub Repositories for Batch Inference

Torchserve server using a YoloV5 model running on docker with GPU and static batch inference to perform production ready and real time inference.

Batch LLM Inference with Ray Data LLM: From Simple to Advanced

This repository provides sample codes, which enable you to learn how to use auto-ml image classification, or object detection under Azure ML(AML) environment.

LightGBM Inference on Datafusion

这个项目模拟了机器学习模型在工业环境中如何进入生产阶段。目标是使用 Kubernetes（minikube）和 FastAPI 构建、部署、监控和重新训练一个情感分析模型。

MLOps project that recommends movies to watch implementing Data Engineering and MLOps best practices.