Popular GitHub Repositories for Canary Deployment

? Lobe Chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / DeepSeek / Qwen), Knowledge Base (file upload / knowledge management / RAG ), Multi-Modals (Plugins/Artifacts) and Thinking. One-click FREE deployment of your private ChatGPT/ Claude / DeepSeek application.

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Universal LLM Deployment Engine with ML Compilation

An AI agent development platform with all-in-one visual tools, simplifying agent creation, debugging, and deployment like never before. Coze your way to AI Agent creation.

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

An open-source runtime for composable workflows. Great for AI agents and CI/CD.

Free MLOps course from DataTalks.Club

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

A video translation and dubbing tool powered by LLMs, offering professional-grade translations and one-click full-process deployment. It can generate content optimized for platforms like YouTube，TikTok, and Shorts. 基于AI大模型的视频翻译和配音工具，专业级翻译，一键部署全流程，可以生成适配抖音，小红书，哔哩哔哩，视频号，TikTok，Youtube Shorts等形态的内容

A video translation and dubbing tool powered by LLMs, offering professional-grade translations and one-click full-process deployment. It can generate content optimized for platforms like YouTube，TikTok, and Shorts. 基于AI大模型的视频翻译和配音工具，专业级翻译，一键部署全流程，可以生成适配抖音，小红书，哔哩哔哩，视频号，TikTok，Youtube Shorts等形态的内容

All-in-One Development Tool based on PaddlePaddle（飞桨低代码开发工具）

[ECCV 2022] ByteTrack: Multi-Object Tracking by Associating Every Detection Box

Simple and Distributed Machine Learning

? AgentVerse ? is designed to facilitate the deployment of multiple LLM-based agents in various applications, which primarily provides two frameworks: task-solving and simulation

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

A guideline for building practical production-level deep learning systems to be deployed in real world applications.

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

Python library for Modzy Machine Learning Operations (MLOps) Platform

Simple, scalable AI model deployment on GPU clusters

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.