Popular GitHub Repositories for Microservice Orchestration

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

? The Cloud-Native API Gateway and AI Gateway.

FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.

AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

?? Build multimodal AI applications with cloud-native stack

Turns Data and AI algorithms into production-ready web applications in no time.

Free MLOps course from DataTalks.Club

What are the principles we can use to build LLM-powered software that is actually good enough to put in the hands of production customers?

This is a collection of tutorials for learning how to use Docker with various tools. Contributions welcome.

? All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.

Alluxio, data orchestration for analytics and machine learning in the cloud

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

Claude-Flow v2.0.0 Alpha represents a revolutionary leap in AI-powered development orchestration. Built from the ground up with enterprise-grade architecture, advanced swarm intelligence, and seamless Claude Code integration.

The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai

Open source data anonymization and synthetic data platform for developers. Anonymize your production data and sync it across your environments so that developers can safely use it.

a self-hosted solution for running ai-generated code in secure sandboxes

The leading workflow orchestration platform. Run stateful step functions and AI workflows on serverless, servers, or the edge.

Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters