Popular GitHub Repositories for Hallucination Hunting

UpTrain is an open-source unified platform to evaluate and improve Generative AI applications. We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.

Loki: Open-source solution designed to automate the process of verifying factuality

Reading list of hallucination in LLMs. Check out our new survey paper: "Siren’s Song in the AI Ocean: A Survey on Hallucination in Large Language Models"

List of papers on hallucination detection in LLMs.

UQLM: Uncertainty Quantification for Language Models, is a Python package for UQ-based LLM hallucination detection

Awesome-LLM-Robustness: a curated list of Uncertainty, Reliability and Robustness in Large Language Models

??Woodpecker: Hallucination Correction for Multimodal Large Language Models

PatrOwl - Open Source, Smart and Scalable Security Operations Orchestration Platform

LettuceDetect is a hallucination detection framework for RAG applications.

RefChecker provides automatic checking pipeline and benchmark dataset for detecting fine-grained hallucinations generated by Large Language Models.

[CVPR 2024 Highlight] OPERA: Alleviating Hallucination in Multi-Modal Large Language Models via Over-Trust Penalty and Retrospection-Allocation

[CVPR'24] HallusionBench: You See What You Think? Or You Think What You See? An Image-Context Reasoning Benchmark Challenging for GPT-4V(ision), LLaVA-1.5, and Other Multi-modality Models

[ICLR'24] Mitigating Hallucination in Large Multi-Modal Models via Robust Instruction Tuning

Semantic Reasoning Engine for LLMs · WFGY 推理引擎 / 萬法歸一

[ICLR 2025] LLaVA-MoD: Making LLaVA Tiny via MoE-Knowledge Distillation

pretrained BERT model for cyber security text, learned CyberSecurity Knowledge

Explore concepts like Self-Correct, Self-Refine, Self-Improve, Self-Contradict, Self-Play, and Self-Knowledge, alongside o1-like reasoning elevation? and hallucination alleviation?.

[ACL 2024] User-friendly evaluation framework: Eval Suite & Benchmarks: UHGEval, HaluEval, HalluQA, etc.

Simplify and improve the job hunting experience by integrating LLMs to automate tasks such as resume and cover letter generation, as well as application submission, saving users time and effort.

Transferable Decoding with Visual Entities for Zero-Shot Image Captioning, ICCV 2023