factual-confidence-of-llms

A scikit-learn-compatible library for estimating prediction intervals and controlling risks, based on conformal predictions.

ARCH models in Python

Loki: Open-source solution designed to automate the process of verifying factuality

? Introduction to Modern Statistics - A college-level open-source textbook with a modern approach highlighting multivariable relationships and simulation-based inference. For v1, see https://openintro-ims.netlify.app.

UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection

Statistical Inference via Data Science: A ModernDive into R and the Tidyverse

Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".

Python package for conformal prediction

Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"

Learn fast, scalable, and calibrated measures of uncertainty using neural networks!