uptrain

Public

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

autoevaluation evaluation experimentation hallucination-detection jailbreak-detection llm-eval llm-prompting llm-test llmops machine-learning

Creat：2022-11-07T15:29:06

Update：2025-03-26T09:18:33

https://uptrain.ai/

2.3K

Stars

Stars Increase

Related projects

Langfuse

analytics

? Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with OpenTelemetry, Langchain, OpenAI SDK, LiteLLM, and more. ?YC W23

16649

6个月前

+32today

RagaAI Catalyst

agentic-ai

Python SDK for Agent AI Observability, Monitoring and Evaluation Framework. Includes features like agent, llm and tools tracing, debugging multi-agentic system, self-hosted dashboard and advanced analytics with timeline and execution graph view

16077

6个月前

+3today

Opik

langchain

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

14328

6个月前

+47today

Deepeval

evaluation-framework

The LLM Evaluation Framework

11326

6个月前

+20today

Ragas

evaluation

Supercharge Your LLM Application Evaluations ?

10923

6个月前

+22today

Lm Evaluation Harness

evaluation-framework

A framework for few-shot evaluation of language models.

10243

6个月前

+7today

Promptfoo

Test your prompts, agents, and RAGs. Red teaming, pentesting, and vulnerability scanning for LLMs. Compare performance of GPT, Claude, Gemini, Llama, and more. Simple declarative configs with command line and CI/CD integration.

8547

6个月前

+10today