Popular GitHub Repositories for Evaluate Expressions

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

Easily fine-tune, evaluate and deploy Qwen3, DeepSeek-R1, Llama 4 or any open source LLM / VLM!

Evidently is ??an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

Official PyTorch implementation of PTS/PSRN: Fast and efficient symbolic expression discovery through parallelized tree search. Evaluates millions of expressions simultaneously on GPU with automated subtree reuse.

? Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 ?

Open Source Application for Advanced LLM Engineering: interact, train, fine-tune, and evaluate large language models on your own computer.

A Comprehensive Benchmark to Evaluate LLMs as Agents (ICLR'24)

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

GANimation: Anatomically-aware Facial Animation from a Single Image (ECCV'18 Oral) [PyTorch]

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM

Train, Evaluate, Optimize, Deploy Computer Vision Models via OpenVINO?

[CVPR2024 Highlight] VBench - We Evaluate Video Generation

The collaborative spreadsheet for AI. Chain cells into powerful pipelines, experiment with prompts and models, and evaluate LLM responses in real-time. Work together seamlessly to build and iterate on AI applications.

Evaluate your LLM's response with Prometheus and GPT4 ?

Prompty makes it easy to create, manage, debug, and evaluate LLM prompts for your AI applications. Prompty is an asset class and format for LLM prompts designed to enhance observability, understandability, and portability for developers.

[CVPR 2022] FaceFormer: Speech-Driven 3D Facial Animation with Transformers

A single interface to use and evaluate different agent frameworks

The goal of this library is to generate more helpful exception messages for matrix algebra expressions for numpy, pytorch, jax, tensorflow, keras, fastai.

A multi-platform desktop application to evaluate and compare LLM models, written in Rust and React.