Popular GitHub Repositories for Kubenetes Deployment

? Lobe Chat - an open-source, modern-design AI chat framework. Supports Multi AI Providers( OpenAI / Claude 3 / Gemini / Ollama / DeepSeek / Qwen), Knowledge Base (file upload / knowledge management / RAG ), Multi-Modals (Plugins/Artifacts) and Thinking. One-click FREE deployment of your private ChatGPT/ Claude / DeepSeek application.

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Universal LLM Deployment Engine with ML Compilation

Multi-lingual large voice generation model, providing inference, training and deployment full-stack ability.

An open-source runtime for composable workflows. Great for AI agents and CI/CD.

Free MLOps course from DataTalks.Club

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

High-speed Large Language Model Serving for Local Deployment

A video translation and dubbing tool powered by LLMs, offering professional-grade translations and one-click full-process deployment. It can generate content optimized for platforms like YouTube，TikTok, and Shorts. 基于AI大模型的视频翻译和配音工具，专业级翻译，一键部署全流程，可以生成适配抖音，小红书，哔哩哔哩，视频号，TikTok，Youtube Shorts等形态的内容

A video translation and dubbing tool powered by LLMs, offering professional-grade translations and one-click full-process deployment. It can generate content optimized for platforms like YouTube，TikTok, and Shorts. 基于AI大模型的视频翻译和配音工具，专业级翻译，一键部署全流程，可以生成适配抖音，小红书，哔哩哔哩，视频号，TikTok，Youtube Shorts等形态的内容

All-in-One Development Tool based on PaddlePaddle（飞桨低代码开发工具）

[ECCV 2022] ByteTrack: Multi-Object Tracking by Associating Every Detection Box

Simple and Distributed Machine Learning

? AgentVerse ? is designed to facilitate the deployment of multiple LLM-based agents in various applications, which primarily provides two frameworks: task-solving and simulation

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

A guideline for building practical production-level deep learning systems to be deployed in real world applications.

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables running any AI jobs on any GPU cloud or on-premise cluster. Built on this library, TensorOpera AI (https://TensorOpera.ai) is your generative AI platform at scale.

? Turns your machine learning code into microservices with web API, interactive GUI, and more.

Simple, scalable AI model deployment on GPU clusters