Beyond Detection: Exploring Evidence-based Multi-Agent Debate for Misinformation Intervention and Persuasion
Chen Han, Yijia Ma, Jin Tan, Wenzhen Zheng, Xijin Tang · 2025
Read Beyond Detection: Exploring Evidence-based Multi-Agent Debate for Misinformation Intervention and Persuasion by Chen Han, Yijia Ma, Jin Tan, Wenzhen Zheng, Xijin Tang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-07267.txt.
Introduction
Chen Han and four co-authors extend multi-agent debate from merely flagging misinformation to persuading people out of it. Debate systems, where AI agents argue adversarially, detect falsehoods well, but detection alone does not teach users why a judgment was reached or build resilience. The debate transcripts themselves are an underused resource of transparent reasoning. The authors' system, ED2D, adds factual evidence retrieval to the debate and is built as a persuasive system.
ED2D beat current baselines on three misinformation detection benchmarks. When its verdict was correct, its debunking transcripts persuaded readers about as effectively as human expert explanations. Alarmingly, when it misclassified, its explanations could reinforce misconceptions even beside accurate human text. A public community website accompanies the work, and the authors stress both promise and risk.
Catalog record
| CREATOR | Chen Han, Yijia Ma, Jin Tan, Wenzhen Zheng, Xijin Tang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-07267
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Beyond Detection: Exploring Evidence-based Multi-Agent Debate for Misinformation Intervention and Persuasion Chen Han, Yijia Ma, Jin Tan, Wenzhen Zheng, Xijin Tang Abstract Multi-agent debate (MAD) frameworks have emerged as promising approaches for misinformation detection by simulating adversarial reasoning. While prior work has focused on detection accuracy, it overlooks the importance of helping users understand the reasoning behind factual judgments and develop future resilience. The debate transcripts generated during MAD offer a rich but underutilized resource for transparent reasoning. In this study, we introduce ED2D, an evidence-based MAD framework that extends previous approach by incorporating factual evidence retrieval. More importantly, ED2D is designed not only as a detection framework but also as a persuasive multi-agent system aimed at correcting user beliefs and discouraging misinformation sharing. We compare the persuasive effects of ED2D-generated debunking transcripts with those authored by human experts. Results demonstrate that ED2D outperforms existing baselines across three misinformation detection benchmarks. When ED2D generates correct predictions, its debunking transcripts exhibit persuasive effects comparable to those of human experts; However, when ED2D misclassifies, its accompanying explanations may inadvertently reinforce users’ misconceptions, even when presented alongside accurate human explanations. Our findings highlight both the promise and the potential risks of deploying MAD systems for misinformation intervention. We further develop a public community website to help users explore ED2D, fostering transparency, critical thinking, and collaborative fact-checking. Code — https://github.com/hanshenmesen/Debate-to-Detect Introduction Figure 1: A debate example on the claim that toilet flushing releases airborne pathogens. The case demonstrates the ED2D reasoning process, with the affirmative side prevailing based on evidence-grounded argumentation. Misinformation presents a persistent threat to online discourse, public trust, and democratic institutions ( 1 ; 26 ) . In response, researchers have developed a range of computational approaches to automatically detect misleading content. Among these, multi-agent debate (MAD) frameworks have recently gained attention for their ability to simulate adversarial reasoning ( 15 ; 14 ) , where large language model (LLM) agents engage in structured argumentation to expose factual inconsistencies. These multi-agent systems leverage the complementary strengths of competing perspectives and often yield more robust judgments than a single classifier. While prior studies employ MAD frameworks for post-verification tasks that focus on identifying the falsehood of claims, they often neglect the more fundamental challenge of proactive misinformation intervention. In the real world, users are active reasoners rather than passive recipients, requiring persuasive explanations and the capacity to resist future misinformation. ( 3 ) . Simply labeling a claim as false is insufficient to foster resilience against misinformation ( 18 ) . Drawing on the adage that the Truth Becomes Clearer Through Debate ( 10 ; 17 ) , we argue that effective misinformation interventions should prioritize transparent reasoning, evidence grounding, and persuasive debunking. In this study, we introduce ED2D, an evidence-based MAD framework that extends the Debate-to-Detect (D2D) framework ( 10 ) by incorporating an evidence retrieval module. It automatically identifies key entities and relations within a claim, retrieves factual information from external sources, and assesses the stance of the retrieved evidence with respect to the claim. By integrating verifiable facts into the argumentative process, ED2D mitigates hallucinations and achieves superior performance on three standard misinformation detection benchmarks. We further evaluate ED2D’s persuasive effect on human beliefs using Snopes25, a real-world benchmark consisting of fact-checks authored by professional editors from January to June 2025. Snopes25 is collected after the training cut-off of GPT-4o, thereby reducing the risk of data leakage and better reflecting current misinformation trends. Using this dataset, we compare the effects of ED2D-generated debunks and human expert reports on belief correction and sharing intention. We also analyze failure cases in which ED2D misjudges claims yet still successfully persuades users, highlighting potential risks associated with the deployment of MAD systems. In summary, this study makes the following contributions: • We construct Snopes25 , the first real-world benchmark explicitly designed to compare the persuasive impact of LLMs and human experts. Comprising 448 claims and corresponding fact-check reports authored by professional editors between January and June 2025, Snopes25 provides high-quality fact-checking explanations and reflects contemporary misinformation patterns. • We propose ED2D , an evidence-based MAD framework that integrates factual evidence retrieval to generate verifiable and coherent argumentation. ED2D outperforms existing baselines across three benchmarks including Snopes25, demonstrating both high detection accuracy and strong interpretability. • We conduct the first controlled human-subject experiment to evaluate a persuasive multi-agent system , directly comparing the debunking effectiveness of ED2D-generated transcripts with expert-written fact-checks. Results indicate that ED2D achieves expert-level persuasive efficacy when correct, but reinforces misinformation when incorrect, revealing a fundamental tradeoff in the design of persuasive AI systems. • We deploy a public platform that allows users to interactively engage with ED2D’s debate process. The system enhances transparency, fosters epistemic vigilance, and promotes collective fact-checking through discourse generated by LLM-agents. Related Work LLM-based Misinformation Detection Early approaches focused on fine-tuning pretrained transformers such as BERT for binary veracity classification tasks ( 13 ) . While these approaches perform well on benchmark datasets, they often lack interpretability and generalize poorly to novel claims ( 21 ) . To overcome these limitations, recent work has shifted toward prompting-based paradigms using LLMs. Zero-shot and few-shot prompting enable flexible adaptation to misinformation detection tasks without the need for explicit fine-tuning ( 30 ) . Moreover, techniques such as Chain-of-Thought ( 29 ) and Self-Reflection ( 19 ) enhance reasoning transparency by enabling models to decompose complex judgments into intermediate steps or engage in iterative self-critique. However, as these approaches depend entirely on internal model knowledge, they are prone to hallucinations and factual errors ( 11 ) . To address these reliability concerns, an emerging line of research incorporates external evidence into the reasoning process. For example, Retrieval-Augmented Generation (RAG) has been widely adopted to ground LLM outputs in verifiable content. Nevertheless, most existing RAG systems still rely on a fixed knowledge base, which limits their effectiveness in open-domain misinformation detection scenarios ( 28 ) . Multi-Agent Debate for Adversarial Reasoning MAD frameworks have gained traction as an approach to improve the deliberative quality of LLM outputs by simulating adversarial interactions between agents with opposing views ( 5 ; 15 ; 14 ) . Drawing inspiration from human deliberation and dialectical reasoning, such frameworks allow agents to challenge assumptions, correct errors, and elicit deeper justifications. Existing MAD systems vary in structure, ranging from simple two-agent dialogues to more complex setups involving multiple rounds, and role-specific prompting. The D2D framework introduces a five-stage debate process, including Opening, Rebuttal, Free Debate, Closing, and Judgment. Agents are assigned fixed stances and judged across multiple dimensions. While D2D improves factual accuracy and interpretability, the exclusive reliance on internal model knowledge introduces vulnerability to hallucinations and limits robustness when handling emerging or unfamiliar claims. In response, ED2D incorporates an evidence retrieval component that enables agents to support or challenge claims with verifiable external information. This integration strengthens both adversarial reasoning and fact-grounded argumentation, enhancing the reliability and generalizability of the debate process. Figure 2: Architecture of the ED2D framework. Given a news claim, LLM agents with domain-specific profiles engage in a structured debate comprising five stages, including Opening, Rebuttal, Free Debate, Closing, and Judgment. During the Free Debate and Judgment, an evidence retrieval module actively