Multimodal Fact-Checking: An Agent-based Approach
Danni Xu, Shaojing Fan, Harry Cheng, Mohan Kankanhalli · 2025
Read Multimodal Fact-Checking: An Agent-based Approach by Danni Xu, Shaojing Fan, Harry Cheng, Mohan Kankanhalli (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-22933.txt.
Introduction
Danni Xu, Shaojing Fan, Harry Cheng, and Mohan Kankanhalli introduce RW-Post, a benchmark for checking social media posts that mix text with images. Multimodal misinformation often works by pairing misleading words with repurposed or manipulated pictures, and fact-checkers need tests grounded in real posts rather than synthetic ones. RW-Post links each original post to reasoning traces and to specific evidence items drawn from human fact-checking articles.
The annotations were extracted and audited with help from a language model, keeping every claim tied to checkable evidence. Systems can be tested in three regimes: from memory alone, with only the supplied evidence, or with open web access. A reference agent called AgentFact sets the baseline. Experiments with strong open vision-language models show substantial headroom, since models often fail to ground verdicts in the evidence, while evidence-bounded testing improves both accuracy and faithfulness.
Catalog record
| CREATOR | Danni Xu, Shaojing Fan, Harry Cheng, Mohan Kankanhalli |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-22933
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Multimodal Fact-Checking: An Agent-based Approach Danni Xu, Shaojing Fan, Harry Cheng, Mohan Kankanhalli Abstract The rapid spread of multimodal misinformation poses a growing challenge for automated fact-checking systems. Existing approaches, including large vision–language models (LVLMs) and deep multimodal fusion methods, often fall short due to limited reasoning and shallow evidence utilization. A key bottleneck is the lack of dedicated datasets that provide complete real-world multimodal misinformation instances accompanied by annotated reasoning processes and verifiable evidence. To address this limitation, we introduce RW-Post , a high-quality, explainable dataset for real-world multimodal fact-checking. RW-Post aligns real-world multimodal claims with their original social media posts, preserving the rich contextual information in which the claims are made. In addition, the dataset includes detailed reasoning and explicitly linked evidence, which are derived from human-written fact-checking articles via large language model–assisted extraction pipeline, enabling comprehensive verification and explanation. Building upon RW-Post, we propose AgentFact , an agent-based multimodal fact-checking framework designed to emulate the human verification workflow. AgentFact consists of five specialized agents that collaboratively handle key fact-checking subtasks, including strategy planning, high-quality evidence retrieval, visual analysis, reasoning, and explanation generation. These agents are orchestrated through an iterative workflow that alternates between evidence searching, task-aware evidence filtering and reasoning, facilitating strategic decision-making and systematic evidence analysis. Extensive experimental results demonstrate that the synergy between RW-Post and AgentFact substantially improves both the accuracy and interpretability of multimodal fact-checking. I Introduction The proliferation of social media has intensified the spread of persuasive textual and visual misinformation, posing serious risks to public health and behavior [ 6 , 33 , 4 ] . Advances in generative AI further exacerbate this threat by enabling realistic, multimodal fake content [ 12 , 37 , 10 ] . Traditional binary fact-checking is inadequate, as it lacks rationales and evidence that foster public trust [ 5 , 27 ] . Narrow tasks like out-of-context (OOC) detection [ 29 ] and deepfake detection [ 36 , 38 ] fall short in addressing real-world complexities. To enhance transparency and reliability, explainable multimodal fact-checking has become a crucial research focus. Recent work has explored LLM-based methods using techniques such as chain-of-thought prompting, claim decomposition, question-guided prompting, and knowledge distillation [ 24 , 17 , 43 , 15 ] . LVLM-based frameworks have extended these techniques to multimodal settings by incorporating image search and external retrieval, evolving into agent-collaborative systems [ 35 , 39 , 34 , 29 , 9 , 7 ] . While these efforts move toward more interpretable fact-checking, they still oversimplify the reasoning required for fact-checking and rely heavily on LLMs’ direct generation based on superficially retrieved evidence (e.g., retrieved with claim or image queries). Besides, a major bottleneck remains: no existing dataset offers both realistic multimodal claims and fully aligned, explanation-level annotations with source-grounded evidence. This limits the evaluation and development of reasoning-aware fact-checkers. To address this gap, we propose an integrated solution that combines a new dataset with a collaborative fact-checking framework composed of specialized agents. We introduce the Real-World Fact-Checking Dataset ( RW-Post ), which pairs Snopes claims with multimodal (text-image) posts, enriched with fine-grained reasoning, evidence descriptions, and verified source links, allowing agent-based systems to emulate human-like fact-checking with enhanced reasoning and evidence grounding. Complementing the dataset, we present AgentFact , a collaborative agent-based framework that emulates the human fact-checking workflow. AgentFact decomposes verification into a series of specialized modules— Strategy Planning, Visual Retrieval and Analysis, Text Evidence Retrieval, Plan Guided Reasoning , and Explanation Generation —each designed to handle a key subtask. Key strengths of AgentFact include: (1) systematic reasoning grounded in real-world fact-checking practices, (2) modular agents with task-specific expertise, and (3) task-aware utilization of both textual and visual evidence. Our main contributions are: 1. We release RW-Post , a high-quality, real-world dataset for explainable multimodal fact-checking, offering comprehensive annotations of claims, posts, reasoning steps, and source-grounded evidence. 2. We propose a dataset collection and annotation pipeline based on existing fact-checking website articles, enabling the construction of a reliable and explainable multimodal dataset for emerging misinformation. 3. We propose AgentFact , an agent-based framework that models the human verification process via modular, strategy-driven reasoning, supporting robust fact-checking across diverse misinformation types. Experiments on 4 benchmark datasets demonstrate its superiority, especially in multimodal scenario and explanation tasks. The dataset and code will be released at https://github.com/xudanni0927/AgentFact . II Related Work II-A Misinformation and OOC Detection Datasets Misinformation datasets can be broadly grouped into three categories: (1) collected datasets , (2) synthetic datasets , and (3) OOC-specific datasets , as summarized in Table I . Collected datasets. Early datasets compile verified claims from fact-checking sites such as Weibo, PolitiFact, and Snopes (e.g., Weibo [ 22 ] , FakeNewsNet [ 31 ] , LIAR-RAW [ 40 ] , RAWFC [ 40 ] , MuMiN [ 23 ] , MR 2 [ 13 ] ). To balance labels, real claims are sometimes sourced from trusted outlets (e.g., Xinhua News). Most are text-only and suffer from noisy annotations or insufficient context. For example, Twitter, Factify 2, and MuMiN datasets match tweets to claims via keyword or cosine similarity, which fails to preserve actual post context. Larger-scale corpora like Fakeddit [ 21 ] rely on weak labeling from platform tags, resulting in noisy labels. AVERITEC [ 30 ] highlights the importance of claim context and employs a multi-step human annotation procedure, producing context-independent and high-quality explanations by having annotators inspecting fact-checking articles. However, AVERITEC remains text-only and does not address multimodal claims. Several recent efforts attempt to enrich multimodal fact-checking resources. CLAIMREVIEW2024+ (CLAIMREVIEW+) recently curated 140 manually linked images. A few datasets also provide evidence or explanations. For example, Mocheg heuristically extracts rationales from Snopes articles, but unstable heuristics and missing original posts limit the reliability of its annotations. Synthetic and OOC datasets. Synthetic datasets enhance diversity and scale through human or model-generated claims. FEVER, FEVEROUS, and HOVER mutate/paraphrase Wikipedia content to create verified claims with increasing reasoning depth. Recent work leverages LLMs to generate claims (e.g., Multi-News-Fact-Checking (Multi-News FC) [ 8 ] using LLaMA2), but these often rely only on textual entailment, neglecting multimodal cues. OOC-specific datasets focus on mismatches between real images and misleading text, using (1) random mismatches (e.g., MAIM, COSMOS [ 14 , 3 ] ), (2) semantically controlled mismatches (e.g., NewsCLIPpings [ 19 ] ), or (3) entity substitution [ 26 , 20 ] . MMFakeBench introduces both multimodal and multi-type falsified posts (OOC, visual and textual edits) via LLM/VLM generation and recombination. Despite progress, most synthetic or OOC datasets lack realism, interpretability, and explicit explanations. These limitations highlight the need for a more reliable and realistic multimodal fact-checking dataset with accurate context and high-quality explanations. To address this gap, we introduce RW-Post —a real-world dataset of text-image misinformation, featuring authentic image and post context, structured rationales, and rationale-aligned evidence. II-B Misinformation and OOC detection methods Approaches to misinformation and out-of-context (OOC) detection can be classified along two axes: (1) internal estimation vs. external retrieval, and (2) feature-based vs. LLM/LVLM-based reasoning. Feature-based internal methods rely on writing style, propagation patterns, or image-text consistency [ 28 , 32 , 44 , 19 ] , but lack external grounding and robustness. Feature-based external approaches retrieve related content (e.g., captions, images)