Towards Unification of Hallucination Detection and Fact Verification for Large Language Models Conference: 2025; Under Review;
Weihang Su, Jianming Long, Changyue Wang, Shiyu Lin, Jingyan Xu, Ziyi Ye, Qingyao Ai, Yiqun Liu · 2025
Read Towards Unification of Hallucination Detection and Fact Verification for Large Language Models Conference: 2025; Under Review; by Weihang Su, Jianming Long, Changyue Wang, Shiyu Lin, Jingyan Xu, Ziyi Ye, Qingyao Ai, Yiqun Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-02772.txt.
Introduction
Weihang Su and seven co-authors join two fields that both fight false statements from language models. Hallucination detection judges a model's own output from the model side. Fact verification checks a written claim against outside evidence, from the text side.
Working apart, each field misses tools the other has built. The authors argue for unification toward a shared framework for trustworthiness. Combined methods could catch errors that pure self checks or pure database checks miss. That need grows as models write more news, code, and advice each day. Two fields that check the same lie in two ways can lend each other tools, tests, and hard won norms for what counts as proof.
Catalog record
| CREATOR | Weihang Su, Jianming Long, Changyue Wang, Shiyu Lin, Jingyan Xu, Ziyi Ye, Qingyao Ai, Yiqun Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 68 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-02772
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Unification of Hallucination Detection and Fact Verification for Large Language Models Conference: 2025; Under Review; Weihang Su, Jianming Long, Changyue Wang, Shiyu Lin, Jingyan Xu, Ziyi Ye, Qingyao Ai, Yiqun Liu Abstract . Large Language Models (LLMs) frequently exhibit hallucinations, generating content that appears fluent and coherent but is factually incorrect. Such errors undermine trust and hinder their adoption in real-world applications. To address this challenge, two distinct research paradigms have emerged: model-centric Hallucination Detection (HD) and text-centric Fact Verification (FV). Despite sharing the same goal, these paradigms have evolved in isolation, using distinct assumptions, datasets, and evaluation protocols. This separation has created a research schism that hinders their collective progress. In this work, we take a decisive step toward bridging this divide. We introduce UniFact 1 1 1 We have open-sourced all the code, data, and baseline implementation at: https://github.com/oneal2000/UniFact/ , a unified evaluation framework that enables direct, instance-level comparison between FV and HD by dynamically generating model outputs and corresponding factuality labels. Through large-scale experiments across multiple LLM families and detection methods, we reveal three key findings: (1) No paradigm is universally superior; (2) HD and FV capture complementary facets of factual errors; and (3) hybrid approaches that integrate both methods consistently achieve state-of-the-art performance. Beyond benchmarking, we provide the first in-depth analysis of why FV and HD diverged, as well as empirical evidence supporting the need for their unification. The comprehensive experimental results call for a new, integrated research agenda toward unifying Hallucination Detection and Fact Verification in LLMs. 1. Introduction Large Language Models (LLMs) have fundamentally reshaped the digital landscape, powering next-generation search engines and automating complex tasks that previously seemed impossible ( 7 ; 62 ; 16 ; 17 ) . However, their deployment in high-stakes, real-world applications is critically hampered by a dangerous failure mode: the generation of fluent yet factually incorrect content, a phenomenon known as hallucination ( 22 ; 61 ; 37 ; 57 ) . In domains like healthcare ( 76 ; 64 ; 43 ) , legal ( 63 ; 55 ; 73 ) , and journalism, where factual reliability is a critical requirement, hallucinations can erode user trust, spread misinformation, and lead to harmful consequences. Therefore, developing robust mechanisms to detect these factual errors is not just a technical challenge but a foundational requirement for building trustworthy and reliable intelligent systems. To address this critical challenge, the research community has developed two distinct paradigms: Fact Verification (FV) ( 65 ; 20 ; 26 ; 30 ) and Hallucination Detection (HD) ( 22 ; 60 ; 8 ; 33 ; 2 ; 18 ; 35 ; 40 ) . Fact Verification is a well-established, text-centric research area rooted in information retrieval ( 9 ; 11 ; 21 ) and fake news detection ( 47 ; 83 ; 42 ) . Typically, FV evaluates a statement’s factuality based on external knowledge sources, such as web documents or databases. A defining characteristic of FV is its origin-agnostic nature: it evaluates a statement’s factuality regardless of whether it is human-authored or machine-generated. In this paradigm, the text is treated as an isolated, static artifact, where factuality is assessed based on the consistency between the claim and retrieved evidence. In contrast, Hallucination Detection is a more recent paradigm that emerged alongside the rise of LLMs. The fundamental distinction lies in the object of evaluation: HD specifically targets content generated by LLMs. Unlike FV, which evaluates text in isolation, HD introduces a new dimension of introspective evaluation by leveraging the generative process itself. While HD methods can also employ external knowledge retrieval similar to FV, the mainstream research focuses on model-centric signals, such as token-level uncertainty, activation dynamics, and consistency across sampled generations ( 60 ; 8 ; 37 ) . Consequently, HD is inherently model-centric, allowing it to identify hallucinations even in the absence of external evidence. Despite sharing the same ultimate goal of identifying factual errors, these two research directions have evolved in surprising isolation, which is evidenced by their use of distinct benchmarks, evaluation metrics, and publication venues. The root of this divergence lies in a fundamental incompatibility between evaluation paradigms. FV is inherently text-centric: its benchmarks, such as FEVER ( 65 ) , consist of claims treated as standalone texts, where their origin is not considered. HD methods, however, depend on internal model states that FV settings cannot provide. Attempts to bridge this gap by constructing static benchmarks of LLM outputs (e.g., HELM ( 61 ) ) remain limited, as such datasets cannot evaluate new or out-of-distribution models, nor capture dynamic generative signals. This incompatibility has led to the development of two parallel research tracks, resulting in redundant efforts and leaving fundamental questions unanswered. It remains unclear whether one paradigm is inherently superior, how their strengths differ, or whether they can be effectively combined. Moreover, their isolation prevents leveraging their complementary nature: HD’s internal model signals could augment FV’s evidence-based reasoning, while FV’s retrieved context could ground HD’s uncertainty signals. To this end, we take a decisive step toward bridging this long-standing divide. We present the first large-scale, systematic empirical study to directly compare Hallucination Detection and Fact Verification under a single, unified setting. Rather than a mere benchmarking effort, our work provides a comprehensive investigation into the fundamental relationship between these paradigms. This unified approach allows us, for the first time, to address three key research questions (RQs) that have remained unexplored due to the fields’ historical separation: (1) Overall Performance (RQ1) : How do Hallucination Detection and Fact Verification methods differ in performance when detecting factual errors on the same LLM outputs? (2) Complementary Strengths (RQ2) : Do HD and FV capture distinct aspects of factual inaccuracy, showing complementary strengths, or do they overlap and fail on similar errors? (3) Hybrid Performance (RQ3) : Can the signals from both paradi-gms be effectively combined? Can such a hybrid detection system surpass either approach in isolation? This comparison was previously considered infeasible due to the paradigms’ fundamental incompatibility. Our work makes this comparison possible by introducing UniFact , a unified evaluation framework designed to overcome the fundamental incompatibility that has historically split the field. Unlike static benchmarks that rely on pre-generated, fixed LLM’s outputs, UniFact adopts a dynamic evaluation process. It prompts any LLM to generate answers to factual questions in real time. The framework then employs an automated labeling system to determine correctness by comparing the generated output against ground-truth answers and their corresponding pre-labeled reference knowledge. This dynamic process is the key: it simultaneously yields both the textual outputs required for FV methods and the internal model signals needed for HD methods. This design enables the direct, instance-level, head-to-head comparison of both paradigms on the same generated content. Our large-scale experiments, conducted via UniFact across diverse datasets, model families (e.g., LLaMA, Qwen), and detection methods, yield several crucial insights that directly answer our research questions. First, addressing RQ1, we find that no single paradigm is universally superior; performance varies significantly with the underlying LLM and the nature of the task. Second, and most critically (addressing RQ2), our analysis provides strong empirical evidence of complementarity. HD and FV methods consistently succeed on different subsets of factual errors, confirming they