AutomaticEvaluation

Fast and extensible multi-platform HTTP/1-2-3 web server with automatic HTTPS

? ? ? Open Source Airtable Alternative

? Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. ?YC W23

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

??? APITable, an API-oriented low-code platform for building collaborative apps and better than all other Airtable open-source alternatives.

The LLM Evaluation Framework

Supercharge Your LLM Application Evaluations ?

A framework for few-shot evaluation of language models.