Popular GitHub Repositories for Microservice Orchestration

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

? The Cloud-Native API Gateway and AI Gateway.

FastGPT is a knowledge-based platform built on the LLMs, offers a comprehensive suite of out-of-the-box capabilities such as data processing, RAG retrieval, and visual AI workflow orchestration, letting you easily develop and deploy complex question-answering systems without the need for extensive setup or configuration.

?? Build multimodal AI applications with cloud-native stack

AI orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

Turns Data and AI algorithms into production-ready web applications in no time.

Free MLOps course from DataTalks.Club

? All-in-one open-source embeddings database for semantic search, LLM orchestration and language model workflows

BISHENG is an open LLM devops platform for next generation Enterprise AI applications. Powerful and comprehensive features include: GenAI workflow, RAG, Agent, Unified model management, Evaluation, SFT, Dataset Management, Enterprise-level System Management, Observability and more.

Alluxio, data orchestration for analytics and machine learning in the cloud

Scalable and flexible workflow orchestration platform that seamlessly unifies data, ML and analytics stacks.

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework. Website: https://swarms.ai

What are the principles we can use to build LLM-powered software that is actually good enough to put in the hands of production customers?

Open source data anonymization and synthetic data platform for developers. Anonymize your production data and sync it across your environments so that developers can safely use it.

Fault-tolerant, highly scalable GPU orchestration, and a machine learning framework designed for training models with billions to trillions of parameters

Generative AI reference workflows optimized for accelerated infrastructure and microservice architecture.

The leading workflow orchestration platform. Run stateful step functions and AI workflows on serverless, servers, or the edge.

a self-hosted solution for running ai-generated code in secure sandboxes

? Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications