LLM-Multilingual-Knowledge-Boundaries

Label Studio is a multi-type data labeling and annotation tool with standardized output format

? The largest hub of ready-to-use datasets for ML models with fast, easy-to-use and efficient data manipulation tools

? Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. ?YC W23

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

The LLM Evaluation Framework

pix2code: Generating Code from a Graphical User Interface Screenshot

Supercharge Your LLM Application Evaluations ?

The standard data-centric AI package for data quality and machine learning with messy, real-world data and labels.

A framework for few-shot evaluation of language models.