Probabilities-Text-and-Ranking

Supercharge Your LLM Application Evaluations ?

OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

The easiest tool for fine-tuning LLM models, synthetic data generation, and collaborating on datasets.

SuperCLUE: 中文通用大模型综合性基准 | A Benchmark for Foundation Models in Chinese

A unified evaluation framework for large language models

An open-source visual programming environment for battle-testing prompts to LLMs.

Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.

Open-source evaluation toolkit of large multi-modality models (LMMs), support 220+ LMMs, 80+ benchmarks

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.