Popular GitHub Repositories for Faithfulness

TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answering

Evaluating ChatGPT’s Information Extraction Capabilities: An Assessment of Performance, Explainability, Calibration, and Faithfulness

Official Implementation of ACL2024 paper "Direct Evaluation of Chain-of-Thought in Multi-hop Reasoning with Knowledge Graphs"(https://aclanthology.org/2024.findings-acl.168)

The Dataset and Official Implementation for <Discursive Socratic Questioning: Evaluating the Faithfulness of Language Models’ Understanding of Discourse Relations> @ ACL 2024

[EMNLP 2023] FaMeSumm: Investigating and Improving Faithfulness of Medical Summarization. Support BART, PEGASUS, T5, mT5, BioBART, etc.

Evaluation for llama-index based RAG. Focusing on aspects such as faithfulness, relevancy, and correctness in their responses.

[ACL 2025] Reranking-based Generation for Unbiased Perspective Summarization

A production-ready Medical Knowledge Assistant powered by RAG + RAGAS. Enables healthcare professionals to query drug data, clinical guidelines, and medical literature with real-time retrieval-augmented generation. Features safety validation through RAGAS metrics (Faithfulness, Context Precision, Relevancy) and a REST API for seamless deployment.