ToE: A Hierarchical and Explainable Claim Verification Framework with Dynamic Multi-source Evidence Retrieval and Aggregation

Zhaoqi Wang 1 , Zijian Zhang 1 , Kun Zheng 1 , Zhen Li 1 , Xin Li 1 , Chunlei Li 2 , Jiamou Liu 3 · 2026

Read ToE: A Hierarchical and Explainable Claim Verification Framework with Dynamic Multi-source Evidence Retrieval and Aggregation by Zhaoqi Wang 1 , Zijian Zhang 1 , Kun Zheng 1 , Zhen Li 1 , Xin Li 1 , Chunlei Li 2 , Jiamou Liu 3 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-27736.txt.

Introduction

Fake news increasingly includes AI-crafted content designed to surface in search results. Such poisoning can contaminate the reasoning of language models used for fact-checking. Zhaoqi Wang and six colleagues propose ToE, the Tree of Evidence, in 2026. ToE verifies claims through a hierarchical evidence tree. Each claim grows into an argument tree that expands as checking proceeds.

Three components drive the process. A reinforcement-learning retrieval agent gathers evidence from multiple sources. An evaluation agent scores the evidence found. An aggregation algorithm combines the tree into a verdict with an explainable evidence chain. The authors also analyse retrieval theoretically. Their error bound guarantees the learned policy converges near the information-theoretically optimal one. Experiments span several datasets and backbone models. Improvements over strong baselines ranged from four to twenty-four percentage points. Gains were especially large on adversarially poisoned inputs.

Catalog record

CREATORZhaoqi Wang 1 , Zijian Zhang 1 , Kun Zheng 1 , Zhen Li 1 , Xin Li 1 , Chunlei Li 2 , Jiamou Liu 3
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.27736

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ToE: A Hierarchical and Explainable Claim Verification Framework with Dynamic Multi-source Evidence Retrieval and Aggregation Zhaoqi Wang 1 , Zijian Zhang 1 , Kun Zheng 1 , Zhen Li 1 , Xin Li 1 , Chunlei Li 2 , Jiamou Liu 3 Abstract Content Warning: This paper contains examples of misinformation used only for research purpose. The rapid spread of fake news poses increasing threats to information ecosystems, especially as AI-generated misinformation under Generative Engine Optimization (GEO) poisoning allows adversarially crafted content to be systematically surfaced by retrieval systems, contaminating LLM reasoning. In this paper, we propose Tree of Evidence (ToE), a hierarchical evidence reasoning framework for automated fact-checking that models each claim as a dynamically expanding argument tree. ToE integrates a reinforcement learning-driven multi-source retrieval agent, an evidence evaluation agent, and an argument tree aggregation algorithm to iteratively decompose, retrieve, and verify claims through an explainable evidence chain. We further provide a theoretical analysis of the retrieval process, deriving a formal error bound that guarantees the learned policy converges to a neighborhood of the information-theoretically optimal policy. Experiments across multiple datasets and backbone LLMs demonstrate that ToE achieves improvements ranging from 4 to 24 percentage points over competitive baselines, with particularly pronounced gains on adversarially poisoned inputs. I Introduction Large language models (LLMs), such as the DeepSeek series [ 9 ] and the GPT series [ 1 ] , have demonstrated impressive capabilities across a wide range of tasks. However, due to their reliance on static training data, LLMs lack access to real-time information, which makes them prone to hallucination. To address this limitation, two major lines of work have been proposed. Retrieval-Augmented Generation (RAG) constructs an external knowledge index and retrieves relevant documents at inference time to supply the model with up-to-date context [ 7 ] . Tool calling [ 15 ] , on the other hand, enables LLMs to dynamically invoke external tools such as search engines during generation, thereby grounding responses in freshly retrieved information. Both approaches alleviate the hallucination problem to a certain extent. However, the introduction of third-party information also brings new risks. AI-generated or manually fabricated misinformation can lead LLMs to produce incorrect conclusions [ 21 , 23 , 20 ] . This risk may be further exacerbated by GEO, a technique that structures content to maximize its discoverability by retrieval algorithms such as embedding-based ranking [ 2 ] . Compared to manually written truthful content, adversarially crafted misinformation optimized via GEO can be systematically ranked higher in retrieval results, making it more likely to be consumed by LLMs. For example, as illustrated in Figure 1 , when a user asks “Who is the CEO of OpenAI?” , an attacker can inject a fabricated document claiming that Tim Cook has joined OpenAI as CEO, which once ranked alongside legitimate sources, contaminates the retrieved context and causes the LLM to produce a confidently wrong answer. Fig. 1: Illustration of LLM context pollution via malicious retrieval To combat the spread of misinformation, researchers have proposed a range of detection methods. Early work relies on deep learning-based approaches [ 22 ] , but these methods suffer from limited generalizability, as the inherent diversity of online information across topics, styles, and platforms makes it difficult to transfer models trained on one distribution to unseen data from another [ 10 ] . More recently, LLM-based fake news detection methods have been proposed [ 11 , 10 , 8 , 13 ] , which leverage the reasoning capabilities of LLMs to analyze input content and identify potential misinformation. While these methods achieve promising results on scientific or knowledge-intensive claims, they struggle with time-sensitive news, particularly in the face of AI-generated misinformation where fabricated content is fluent, coherent, and difficult to distinguish from genuine reporting without access to real-time external knowledge. To address this challenge, we propose ToE, a hierarchical evidence reasoning framework for automated fact-checking. ToE models a claim as a dynamically expanding argument tree and verifies it through three core components: a reinforcement learning-driven multi-source retrieval agent that collects evidence across platforms according to the characteristics of the claim under investigation, an evidence evaluation agent that scores the veracity and reliability of the claim based on the collected evidence, and an argument tree aggregation agent that decomposes the claim into sub-claims along dimensions such as who, what, when, where, why, and how, expanding the subtree for deeper verification when the current evidence is insufficient for a reliable judgment. Node-level scores are propagated bottom-up through the tree, and the process terminates when the root node reaches a convergence or decisiveness threshold, yielding a final veracity score along with the full reasoning tree. We summarize our main contributions as follows: • We propose ToE, a hierarchical evidence reasoning framework for automated fact-checking. To the best of our knowledge, this is the first algorithm based on dynamic evidence collection and evaluation, which produces an interpretable argument tree as an explainable evidence chain for each verdict. • We provide a theoretical analysis of the retrieval framework by modeling evidence collection as a Partially Observable Markov Decision Process, and derive a formal error bound showing that the learned policy converges to a neighborhood of the information-theoretically optimal policy. • We construct an adversarial dataset AdvFact to evaluate robustness under GEO poisoning, and conduct experiments across multiple datasets and LLMs with ablation studies on the retrieval action space, demonstrating the effectiveness and generalizability of the proposed approach. II Related Work Fig. 2: An overview of ToE framework. With the rapid development of AI, LLM-based agents address the knowledge staleness problem by invoking external search tools to retrieve relevant information as supplementary context [ 7 , 15 ] . However, this reliance on third-party sources introduces new vulnerabilities. Prior work has demonstrated that AI-generated misinformation injected into retrieval results can mislead LLMs into producing incorrect conclusions, with potentially severe consequences in domains such as medicine and finance [ 23 , 4 ] . While deep learning-based detection methods have been proposed to identify such content [ 22 ] , they rely on surface-level stylistic features and fail to generalize to AI-generated misinformation that differs from truthful content only in subtle factual details. For instance, a claim such as “Tim Cook is Apple’s CEO” can be corrupted to “Tim Cook became OpenAI’s CEO yesterday,” a statement that is stylistically indistinguishable from genuine news yet factually false. Recent work leverages the reasoning capabilities of LLMs to assist in verifying the reliability of information. F3 framework guides LLMs through stepwise logical analysis and evidence consistency assessment via prompt engineering techniques such as zero-shot chain-of-thought reasoning and deductive generation, producing a veracity judgment for the input claim [ 11 ] . TELLER decomposes fake news detection into a set of structured evaluation questions, directing LLMs to analyze news from dimensions including factual accuracy, contextual consistency, and source credibility, then aggregates the dimension-level scores through interpretable logical rules to reach a final verdict [ 10 ] . However, these methods predominantly rely on LLMs to analyze content provided by the claim content, and show limited performance against AI-generated misinformation. STEEL adopts a multi-round retrieval-augmented strategy in which an LLM assesses the confidence of initial retrieval results and automatically generates refined

Read the complete text