Popular GitHub Repositories for Factuality Checking

? A refreshing functional take on deep learning, compatible with your favorite libraries

Type annotations and dynamic checking for a tensor's shape, dtype, names, etc.

Loki: Open-source solution designed to automate the process of verifying factuality

FacTool: Factuality Detection in Generative AI

Benchmarking long-form factuality in large language models. Original code for our paper "Long-form factuality in large language models".

Links to conference/journal publications in automated fact-checking (resources for the TACL22/EMNLP23 paper).

Official implementation for the paper "DoLa: Decoding by Contrasting Layers Improves Factuality in Large Language Models"

RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Language Models.

A package to evaluate factuality of long-form generation. Original implementation of our EMNLP 2023 paper "FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generation"

? No need to keep checking your training - just one import line and you'll know the second it's done.

Paper list of misinformation research using (multi-modal) large language models, i.e., (M)LLMs.

The modern spam protection. Protects your forms from spam by simply checking the content. Open source, Free to use, Accessible, and Self-Hosted.

open-source code for paper: Retrieval Head Mechanistically Explains Long-Context Factuality

DataGene - Identify How Similar TS Datasets Are to One Another (by @firmai)

Motion Planner for Self Driving Cars

Open-Source RAG app with LLM Observability (Langfuse), support for 100+ providers (LiteLLM), Dockerized, Full Type-checking, 100% Test coverage, and more...

Code for the EMNLP 2024 paper "Detecting and Mitigating Contextual Hallucinations in Large Language Models Using Only Attention Maps"

[EMNLP'24] RULE: Reliable Multimodal RAG for Factuality in Medical Vision Language Models

Line bot that checks if a message contains internet rumor.

SemViQA: A Semantic Question Answering System for Vietnamese Information Fact-Checking