Towards Robust Fact-Checking: A Multi-Agent System with Advanced Evidence Retrieval
Tam Trinh 1 2, Manh Nguyen 3, Truong-Son Hy 2 · 2025
Read Towards Robust Fact-Checking: A Multi-Agent System with Advanced Evidence Retrieval by Tam Trinh 1 2, Manh Nguyen 3, Truong-Son Hy 2 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-17878.txt.
Introduction
Tam Trinh, Manh Nguyen, and Truong-Son Hy build a team of AI agents that fact-check claims together. Their 2025 paper responds to the flood of online misinformation, which human checkers cannot match in volume. Language-model checkers exist, but they often stumble on complex claims and murky sources.
Four agents split the work. One breaks a claim into parts, one writes targeted search queries, one gathers evidence from trusted sources, and one delivers a verdict with a plain explanation. On three benchmark sets the system beat rival methods by about twelve percent on the main score. The authors stress transparency, since each verdict can be traced to its evidence.
Catalog record
| CREATOR | Tam Trinh 1 2, Manh Nguyen 3, Truong-Son Hy 2 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-17878
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Robust Fact-Checking: A Multi-Agent System with Advanced Evidence Retrieval Tam Trinh 1 2, Manh Nguyen 3, Truong-Son Hy 2 Abstract The rapid spread of misinformation in the digital era poses significant challenges to public discourse, necessitating robust and scalable fact-checking solutions. Traditional human-led fact-checking methods, while credible, struggle with the volume and velocity of online content, prompting the integration of automated systems powered by Large Language Models (LLMs). However, existing automated approaches often face limitations, such as handling complex claims, ensuring source credibility, and maintaining transparency. This paper proposes a novel multi-agent system for automated fact-checking that enhances accuracy, efficiency, and explainability. The system comprises four specialized agents: an Input Ingestion Agent for claim decomposition, a Query Generation Agent for formulating targeted subqueries, an Evidence Retrieval Agent for sourcing credible evidence, and a Verdict Prediction Agent for synthesizing veracity judgments with human-interpretable explanations. Evaluated on benchmark datasets (FEVEROUS, HOVER, SciFact), the proposed system achieves a 12.3% improvement in Macro F1-score over baseline methods. The system effectively decomposes complex claims, retrieves reliable evidence from trusted sources, and generates transparent explanations for verification decisions. Our approach contributes to the growing field of automated fact-checking by providing a more accurate, efficient, and transparent verification methodology that aligns with human fact-checking practices while maintaining scalability for real-world applications. Our source code is available at https://github.com/HySonLab/FactAgent . I Introduction The rapid proliferation of misinformation on digital platforms poses a significant threat to the integrity of information and public discourse. As false or misleading content spreads at unprecedented speed, the demand for effective and scalable fact-checking solutions has become increasingly urgent [ 1 ] . Although traditional fact-checking performed by human experts and specialized organizations has played a vital role, it is still insufficient to keep up with the sheer volume and velocity of misinformation in the modern media landscape [ 2 ] . Misinformation, defined as false information presented as factual regardless of intent, has far-reaching consequences in the political, health, and economic domains. In political settings, it can distort democratic processes and exacerbate social polarization [ 3 ] . During public health crises such as the COVID-19 pandemic, misinformation has contributed to vaccine hesitancy and the spread of harmful behaviors [ 4 ] . In economic contexts, unverified claims have been linked to market volatility and misguided consumer decisions [ 5 ] . To address these issues at scale, recent efforts have turned to automated fact-checking systems, bolstered by advances in LLMs [ 6 ] . These models exhibit impressive natural language understanding and generation capabilities, enabling them to process and evaluate claims on a previously unattainable scale. However, deploying LLMs for fact-checking also introduces new challenges. LLMs are prone to hallucinations, generating plausible but incorrect information and often operate as black boxes, making it difficult to interpret or verify their output [ 7 ] . Furthermore, LLMs trained in static corpora may lack access to up-to-date or domain-specific knowledge required for accurate verification [ 8 ] . To mitigate these limitations, researchers have explored hybrid strategies that integrate LLMs with retrieval mechanisms and structured reasoning pipelines. Notable approaches include retrieval-augmented generation [ 9 ] , chain-of-thought prompting [ 10 ] , and tool-based reasoning frameworks [ 11 ] . Despite these advancements, current systems often fall short when handling complex, multi-faceted claims, filtering non-verifiable statements, and ensuring the credibility and completeness of retrieved evidence. Many models also rely on shallow web snippets rather than full-document analysis, limiting the depth and reliability of their verifications [ 12 ] . In this paper, we propose a novel multi-agent framework for automated fact-checking that integrates program-guided reasoning, high-quality evidence retrieval, and interpretable verdict generation. Our system is composed of four specialized agents (Figure 1 ): • Input Ingestion Agent: Decomposes complex claims into sub-claims and identifies their verifiability. • Query Generation Agent: Constructs targeted search queries to retrieve relevant information. • Evidence Retrieval Agent: Sources of credible information from trusted knowledge bases and documents. • Verdict Prediction Agent: Synthesizes retrieved evidence to assess the validity of the claim and generate explanations. Fig. 1: Overview of the multi-agent system. The system comprises an Orchestrator that manages communication and workflow between specialized agents, including Input Ingestion Agent, Query Generation Agent, Evidence Seeking Agent, and Verdict Prediction Agent. The Orchestrator interacts with a knowledge source and integrates their responses to produce a final Veracity Result. The key contributions of this work are as follows. 1. We introduce a structured multi-agent architecture that improves fact-checking precision through decomposable reasoning and modular information processing. 2. We implement a robust evidence retrieval strategy that emphasizes source credibility and leverages full-document content rather than relying solely on search engine snippets. 3. We conducted extensive experiments on three benchmark datasets including FEVEROUS [ 13 ] , HOVER [ 14 ] , and SciFact [ 15 ] , demonstrating that our system achieves superior performance compared to existing baselines by 12.3% relative improvement. II Related Works II-A Traditional Fact-Checking Approaches Fact-checking has its roots in traditional journalism, where professional fact-checkers manually verified claims using rigorous investigation and source analysis [ 2 ] . Organizations like PolitiFact [ 16 ] , Snopes [ 17 ] , and FactCheck.org [ 18 ] pioneered standardized methodologies, particularly for political discourse [ 19 ] . However, these manual approaches face serious scalability issues in the digital age, where content is produced and distributed at unprecedented speed. The emergence of semi-automated fact-checking systems marked the beginning of computational support for human experts. Vlachos and Riedel [ 20 ] conceptualized fact-checking as a classification task and laid the groundwork for early benchmarks. Subsequently, natural language processing (NLP) techniques were incorporated to analyze claims and retrieve relevant evidence. In particular, Hassan et al. [ 21 ] proposed ClaimBuster, a pipeline that identifies checkworthy claims and assists in verification, demonstrating the viability of human-AI collaboration in this domain. II-B Automated Fact-Checking Systems Automated fact-checking systems can generally be divided into content-based and context-based approaches [ 1 ] . Content-based methods analyze linguistic and semantic features within text to detect misinformation, while context-based methods focus on how information spreads, which examine propagation patterns, user interactions, and temporal signals. Advancements in neural architectures have substantially improved system performance. Popat et al. [ 22 ] proposed a deep learning model that evaluates the credibility of claims by analyzing the position and reliability of evidence. Augenstein et al. [ 23 ] introduced MultiFC, a benchmark dataset that emphasizes the importance of verifying claims against multiple and diverse sources. Transformer-based architectures further pushed the boundaries, with models like GEAR [ 24 ] leveraging graph-based aggregation to synthesize multi-evidence reasoning. II-C LLMs for Fact-Checking LLMs have recently become a powerful tool for fact-checking due to their capabilities in language understanding and generation [ 6 ] . Initial LLM-based methods used zero-shot and few-shot prompting to evaluate claims without requiring extensive fine-tuning [ 25 ] . Lee et al. [ 26 ] showed that LLMs could generate natural language explanations, enhancing interpretability. However, LLMs suffer from several critical limitations. A major issue is hallucination, which generates plausible but incorrect information [ 7 ] . Studies such as [ 27 ] have documented how LLMs confidently produce inaccurate results, undermining