Popular GitHub Repositories for Service Health Monitoring

Dify is an open-source LLM app development platform. Dify's intuitive interface combines AI workflow, RAG pipeline, agent capabilities, model management, observability features and more, letting you quickly go from prototype to production.

? Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. ?YC W23

Control GenAI interactions with power, precision, and consistency using LLM-native Conversation Design paradigms

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

The Cloud-Native API Gateway and AI Gateway

Free MLOps course from DataTalks.Club

? Scalable embedding, reasoning, ranking for images and sentences with CLIP

CLI tool for configuring and monitoring Claude Code

Build high-quality LLM apps - from prototyping, testing to production deployment and monitoring.

ModelScope: bring the notion of Model-as-a-Service to life.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

AI Observability & Evaluation

Evidently is ??an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

Venom is a high-performance system developed with JavaScript to create a bot for WhatsApp, support for creating any interaction, such as customer service, media sending, sentence recognition based on artificial intelligence and all types of design architecture for WhatsApp.

Firebase SDK for Apple App Development

Context aware, pluggable and customizable data protection and de-identification SDK for text and images

Real-time Claude Code usage monitor with predictions and warnings

Next-generation AI Agent Optimization Platform: Cozeloop addresses challenges in AI agent development by providing full-lifecycle management capabilities from development, debugging, and evaluation to monitoring.

Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more. Integrates with most LLMs and agent frameworks including OpenAI Agents SDK, CrewAI, Langchain, Autogen, AG2, and CamelAI

Install, run and deploy your own decentralized AI agent service