Multi-Sourced, Multi-Agent Evidence Retrieval for Fact-Checking DOI: XXXXXXX.XXXXXXX Conference: SIGIR; July 20-24, 2026; MELBOURNE, AUSTRALIA
Shuzhi Gong, Richard Sinnott, Jianzhong Qi, Cecile Paris, Preslav Nakov, Zhuohan Xie · 2026
Read Multi-Sourced, Multi-Agent Evidence Retrieval for Fact-Checking DOI: XXXXXXX.XXXXXXX Conference: SIGIR; July 20-24, 2026; MELBOURNE, AUSTRALIA by Shuzhi Gong, Richard Sinnott, Jianzhong Qi, Cecile Paris, Preslav Nakov, Zhuohan Xie (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-00267.txt.
Introduction
Gong and colleagues propose WKGFC, a multi-agent system for fact-checking that draws evidence from several sources instead of text similarity alone. Earlier methods lean on patterns learned from training data and miss subtle links between evidence and claims, especially across multi-hop relations. Their system uses an authorised open knowledge graph as its core evidence source, topped up with web content. A reasoning language-model agent picks actions step by step under a Markov decision process, tuned by prompt optimisation for fact-checking.
Catalog record
| CREATOR | Shuzhi Gong, Richard Sinnott, Jianzhong Qi, Cecile Paris, Preslav Nakov, Zhuohan Xie |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50153 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.00267
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Multi-Sourced, Multi-Agent Evidence Retrieval for Fact-Checking DOI: XXXXXXX.XXXXXXX Conference: SIGIR; July 20-24, 2026; MELBOURNE, AUSTRALIA Shuzhi Gong, Richard Sinnott, Jianzhong Qi, Cecile Paris, Preslav Nakov, Zhuohan Xie Abstract . Misinformation spreading over the Internet poses a significant threat to both societies and individuals, necessitating robust and scalable fact-checking that relies on retrieving accurate and trustworthy evidence. Previous methods rely on semantic and social-contextual patterns learned from training data, which limits their generalization to new data distributions. Recently, Retrieval Augmented Generation (RAG) based methods have been proposed to utilize the reasoning capability of LLMs with retrieved grounding evidence documents. However, these methods largely rely on textual similarity for evidence retrieval and struggle to retrieve evidence that captures multi-hop semantic relations within rich document contents. These limitations lead to overlooking subtle factual correlations between the evidence and the claims to be fact-checked during evidence retrieval, thus causing inaccurate veracity predictions. To address these issues, we propose a W eb-enhanced K nowledge G raph retrieval F act- C hecking agentic framework ( WKGFC ), which exploits authorized open knowledge graph as a core resource of evidence. LLM-enabled retrieval is designed to assess the claims and retrieve the most relevant knowledge subgraphs, forming structured evidence for fact verification. To augment the knowledge graph evidence, we retrieve web contents for completion. The above process is implemented as an automatic Markov Decision Process (MDP): A reasoning LLM agent decides what actions to take according to the current evidence and the claims. To adapt the MDP for fact-checking, we use prompt optimization to fine-tune the agentic LLM. Our extensive experiments over datasets in three categories (Wikipedia, websites, and article summaries) show that WKGFC outperform several advanced state-of-the-art fact-checking methods in balanced accuracy score by over 5% absolute. These results highlight the effectiveness of knowledge-centric evidence retrieval for fact-checking under open-world settings. 1. Introduction The rapid proliferation of misinformation poses a profound threat to public trust, democratic processes, and public health communication 54 . Efforts to combat misinformation have spanned decades. Traditional studies explored content semantics 16 ; 11 , propagation patterns 38 ; 3 , and user activity contexts 6 ; 12 in a pattern-recognition manner. Such approaches depend heavily on training data distributions and often fail to generalize to unseen domains , as misinformation topics and linguistic styles evolve over time 14 . From an information retrieval perspective, this challenge fundamentally concerns how to retrieve reliable and sufficient evidence from large, evolving information sources to support verification. Figure 1 . Illustration of different fact-checking paradigms; ours is at the bottom. Recent advances in Large Language Models (LLMs) have transformed automated reasoning and generation capabilities across NLP tasks. Fact-checking has emerged as a key frontier where LLMs can expose misinformation and mitigate its societal harms 4 . Yet, LLMs remain limited by their fixed training windows and lack of integration with domain-specific or time-sensitive knowledge, leading to hallucinated factual errors. A step forward is the introduction of Retrieval-Augmented Generation (RAG) 22 , which enriches LLM reasoning with dynamically retrieved external evidence. The effectiveness of RAG-based fact-checking critically depends on the quality of evidence retrieval, making missing supportive evidence and retrieval failures primary sources of verification errors. The RAG framework enables a retrieve–then–verify paradigm: given a claim to be verified, external knowledge is retrieved and presented to the LLM, which then reasons over both the claim and the retrieved evidence to make a prediction on veracity. Figure 1 illustrates this evolution of fact-checking paradigms, highlighting the differences between text-based, graph-based, and our proposed agentic retrieval framework. A lot of work retrieves unstructured textual evidence based on semantic similarity. Systems such as HerO 49 and InFact 32 established strong RAG baselines by sourcing evidence from large textual knowledge bases. Similar pipelines extend to open-web retrieval 41 ; 45 , i.e., to harness web-scale corpora for evidence gathering. Despite their success, these methods face semantic ambiguity and retrieval uncertainty : textual similarity does not guarantee factual relevance between claims and retrieved evidence. Another line of research emphasizes structured reasoning based on knowledge graphs (KGs) . Early, graph-based methods 13 ; 53 leverage Graph Neural Networks (GNNs) for claim verification. They are constrained by limited representational power and dependence on manually curated Knowledge Graphs (KG). More recently, graph-based RAG methods such as GraphRAG 9 combine LLM reasoning with KGs, improving factual consistency assessment in complex domains such as medicine 15 and summary verification 5 . Besides, KG question answering frameworks (e.g., ChatKBQA 24 and SymAgent 23 ) adopt elaborate retrieval mechanisms to extract subgraphs for reasoning, which have been recently adapted to claim verification tasks 31 . While structured methods exhibit stronger factual grounding, they often assume that evidence must exist within the KG, a constraint that does not always hold in open-world settings. Moreover, most of these methods operate on datasets with gold or domain-specific evidence (e.g., biomedical or legal corpora 5 ; 33 , which limits their generalization capability to broader real-world fact-checking scenarios. These limitations indicate that fact-checking poses a distinct retrieval problem that requires structured reasoning over explicit relations and adaptive retrieval strategies beyond one-shot similarity-based search. From a retrieval perspective, RAG-based fact-checking remains constrained by three major issues: (i) Ambiguity in unstructured evidence , as text-based retrieval often fails to ensure accurate claim–evidence alignment, (ii) Lack of adaptive retrieval intelligence , as existing systems lack agentic reasoning to determine what to retrieve and when , and (iii) Insufficient integration of structured and unstructured knowledge , as few frameworks effectively combine KGs with web-scale information to support comprehensive reasoning. To address these issues, we propose a multi-sourced, agentic fact-checking framework that unifies structured KGs and open-web evidence under a single reasoning paradigm. Motivated by the cognitive workflow of human fact-checkers 1 ; 43 , our system dynamically determines how, what, or when to retrieve and reason across heterogeneous sources, operating as a reasoning agent as formulated within a Markov Decision Process (MDP). Given a claim, our agent first performs KG retrieval by issuing SPARQL queries over open-resource KGs (e.g., Wikidata or DBpedia) using an expand-and-prune search guided by LLM reasoning. The retrieved subgraph serves as the agent’s initial observation. If sufficient evidence is found, the LLM directly performs entity-level reasoning to decide the veracity of an input claim. Otherwise, the agent adaptively selects among several actions, including additional KG expansion or targeted web retrieval, to gather complementary information. This formulation explicitly treats evidence acquisition as a sequential information retrieval process under partial observations. Unlike closed-world KG question answering, fact-checking operates under an open-world retrieval assumption, where relevant evidence may not exist in structured knowledge bases. To address incomplete or noisy KG coverage, we introduce a web retrieval module that complements KG evidence. Retrieved passages from the open web are filtered through a coarse-to-fine grained pipeline, combining web information retrieval and LLM-based factual consistency evaluation. The surviving passages are then converted into knowledge triplets aligned with the KG schema. The resulting web-enhanced KG fuses factual precision from structured KGs with the contextual breadth of the web, providing a comprehensive evidence space for reasoning. Building upon the MDP formulation, we further enable policy improvement without model fine-tuning through self-reflection and prompt optimization. After each reasoning trajectory, the agent evaluates