Popular GitHub Repositories for Confidence Scores

Keras Attention Layer (Luong and Bahdanau scores).

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

similarity: Text similarity calculation Toolkit for Java. 文本相似度计算工具包，java编写，可用于文本相似度计算、情感分析等任务，开箱即用。

ARCH models in Python

UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection

Python package for conformal prediction

Learn fast, scalable, and calibrated measures of uncertainty using neural networks!

Enabling easy statistical significance testing for deep neural networks.

Anomaly detection using LoOP: Local Outlier Probabilities, a local density based outlier detection method providing an outlier score in the range of [0,1].

Dataset and code of GTSinger(NeurIPS 2024 Spotlight): A Global Multi-Technique Singing Corpus with Realistic Music Scores for All Singing Tasks

? Out-of-Distribution Detection with PyTorch

Neat (Neural Attention) Vision, is a visualization tool for the attention mechanisms of deep-learning models for Natural Language Processing (NLP) tasks. (framework-agnostic)

3D Passive Face Liveness Detection (Anti-Spoofing) & Deepfake detection. A single image is needed to compute liveness score. 99,67% accuracy on our dataset and perfect scores on multiple public datasets (NUAA, CASIA FASD, MSU...).

A package for statistically rigorous scientific discovery using machine learning. Implements prediction-powered inference.

A comprehensive set of LLM benchmark scores and provider prices.

Confidence and Byt5 - based geotagging model predicting coordinates from text alone.

Official Implementation for the "Conffusion: Confidence Intervals for Diffusion Models" paper.

[BEA @ ACL 2023] General-purpose tool for linguistic features extraction; Tested on readability assessment, essay scoring, fake news detection, hate speech detection, etc.

[EMNLP 2021] LingFeat - A Comprehensive Linguistic Features Extraction ToolKit for Readability Assessment

(Experimental, a lot of bugs) Automatic fingering generator for piano scores, determining optimal fingering using Model-Based Reinforcement Learning, written in the Julia language.