Popular GitHub Repositories for Ops

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

Turns Data and AI algorithms into production-ready web applications in no time.

Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.

? AIGC 提示词可视化编辑器 | OPS | Open Prompt Studio

Serverless AI Workflows for Data & ML Teams

ZenML ?: The bridge between ML and Ops. https://zenml.io.

RAG (Retrieval Augmented Generation) Framework for building modular, open source applications for production by TrueFoundry

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

The ops and reference implementation for Apache Dubbo.

The ultimate LLM Ops platform - Monitoring, Analytics, Evaluations, Datasets and Prompt Optimization ?

DELTA is a deep learning based natural language and speech processing platform. LF AI & DATA Projects: https://lfaidata.foundation/projects/delta/

A curated list of articles that cover the software engineering best practices for building machine learning applications.

AIConfig is a config-based framework to build generative AI applications.

The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

An open-source ML pipeline development platform

Neum AI is a best-in-class framework to manage the creation and synchronization of vector embeddings at large scale.

Providing reproducibility in deep learning frameworks

Notes for Machine Learning Engineering for Production (MLOps) Specialization course by DeepLearning.AI & Andrew Ng

Python SDK for running evaluations on LLM generated responses

ClearML Agent - ML-Ops made easy. ML-Ops scheduler & orchestration solution