AutomaticEvaluation

Fast and extensible multi-platform HTTP/1-2-3 web server with automatic HTTPS

? ? ? Open Source Airtable Alternative

Grounded SAM: Marrying Grounding DINO with Segment Anything & Stable Diffusion & Recognize Anything - Automatically Detect , Segment and Generate Anything

? Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. ?YC W23

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

??? APITable, an API-oriented low-code platform for building collaborative apps and better than all other Airtable open-source alternatives.

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

The LLM Evaluation Framework

Supercharge Your LLM Application Evaluations ?

A framework for few-shot evaluation of language models.