ExDR: Explanation-driven Dynamic Retrieval Enhancement for Multimodal Fake News Detection CCS: Information systems Multimedia information systems CCS: Computing methodologies Natural language generation
Guoxuan Ding, Yuqing Li, Ziyan Zhou, Zheng Lin, Daren Zha, Jiangnan Li · 2026
Read ExDR: Explanation-driven Dynamic Retrieval Enhancement for Multimodal Fake News Detection CCS: Information systems Multimedia information systems CCS: Computing methodologies Natural language generation by Guoxuan Ding, Yuqing Li, Ziyan Zhou, Zheng Lin, Daren Zha, Jiangnan Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-15820.txt.
Introduction
Guoxuan Ding and five co-authors detect fake news that mixes text and images in a 2026 arXiv paper. Multimodal fake news spreads fast and poses a serious societal threat. It keeps evolving, which dates static detectors. It also leans on timely factual details. Detection methods that cannot fetch fresh facts fall behind. Their system is called ExDR. It builds on dynamic retrieval-augmented generation.
Dynamic retrieval triggers keyword-based searches as needed. It pulls in external knowledge during detection. The title adds that retrieval is explanation-driven. Good evidence selection serves both accuracy and efficiency. It also helps explain why a story was flagged. For platforms and fact-checkers, a detector that shows its evidence is far more useful than a bare score.
Catalog record
| CREATOR | Guoxuan Ding, Yuqing Li, Ziyan Zhou, Zheng Lin, Daren Zha, Jiangnan Li |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-15820
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ExDR: Explanation-driven Dynamic Retrieval Enhancement for Multimodal Fake News Detection CCS: Information systems Multimedia information systems CCS: Computing methodologies Natural language generation Guoxuan Ding, Yuqing Li, Ziyan Zhou, Zheng Lin, Daren Zha, Jiangnan Li Abstract . The rapid spread of multimodal fake news poses a serious societal threat, as its evolving nature and reliance on timely factual details challenge existing detection methods. Dynamic Retrieval-Augmented Generation provides a promising solution by triggering keyword-based retrieval and incorporating external knowledge, thus enabling both efficient and accurate evidence selection. However, it still faces challenges in addressing issues such as redundant retrieval, coarse similarity, and irrelevant evidence when applied to deceptive content. In this paper, we propose ExDR—an Explanation-driven Dynamic Retrieval-Augmented Generation framework for Multimodal Fake News Detection. Our framework systematically leverages model-generated explanations in both the retrieval triggering and evidence retrieval modules. It assesses triggering confidence from three complementary dimensions, constructs entity-aware indices by fusing deceptive entities, and retrieves contrastive evidence based on deception-specific features to challenge the initial claim and enhance the final prediction. Experiments on two benchmark datasets, AMG and MR 2 \text{MR}^{2} , demonstrate that ExDR consistently outperforms previous methods in retrieval triggering accuracy, retrieval quality, and overall detection performance, highlighting its effectiveness and generalization capability. 1. Introduction The rapid spread of social media has dramatically accelerated the spread of fake news ( 24 ) , especially in multimodal formats combining text and images. Compared to traditional text-based misinformation, multimodal fake news leverages the stronger emotional appeal and vividness of visual content to achieve faster dissemination and broader societal impact. Detecting multimodal fake news has thus emerged as a critical and urgent challenge in the field of information security. Recent Multimodal Fake News Detection (MFND) studies mainly rely on the combination of multiple language and vision models, designing complex and structured architectures to extract and align features from textual and visual modalities ( 8 ; 29 ) , facing challenges in cross-modal feature fusion and requiring aligned multimodal training data. Large Vision-Language Models (LVLMs), with their unified image-text embedding space and rich world knowledge, demonstrate strong adaptability to multimodal tasks ( 18 ) . However, the reliance on internal memory accumulated during training reduces its effectiveness in addressing newly emerging knowledge or long-tail instances, often resulting in hallucinations. Dynamic Retrieval-Augmented Generation (RAG) offers a promising alternative by triggering keyword-based retrieval and incorporating external information retrieval instead of over-relying on the model’s inherent reasoning capabilities ( 1 ; 20 ) . This contrasts with static RAG ( 25 ; 33 ; 15 ) pipelines that retrieve for every input regardless of necessity. With a decoupled retriever that can be updated independently of the model, dynamic RAG is well-suited for LVLMs to handle evolving knowledge and long-tail cases. However, naive application of dynamic RAG introduces three key issues. First, for straightforward or commonsense-based fake news, LVLMs often already possess sufficient knowledge. Blindly triggering retrieval without considering sample difficulty leads to unnecessary noise and computational overhead ( 27 ; 12 ) . Second, most existing retrieval strategies focus on sample-level similarity while neglecting finer-grained internal cues ( 28 ; 20 ) , which are often critical for accurately identifying deceptive content. Finally, retrieved results tend to include only the most similar samples, which often lack deception-specific signals and may introduce useless or misleading evidence, ultimately impairing fake news detection accuracy ( 28 ) . To address these challenges, we propose a novel framework named ExDR : Ex planation-driven D ynamic R etrieval, specifically designed for Multimodal Fake News Detection. Our framework consists of two main modules: the retrieval triggering and the evidence retrieval, both of which leverage an explanation-driven RAG paradigm to better adapt to the requirements of MFND. ExDR places model-generated explanations at the center of the retrieval process and systematically investigates three key questions: when to trigger retrieval, how to construct effective retrieval queries, and what types of deceptive samples to retrieve. Each of these aspects targets a distinct challenge inherent in RAG-based methods, enabling more accurate and efficient detection of multimodal deception. For retrieval triggering , we design a dynamic triggering strategy tailored for MFND. This strategy constructs three confidence dimensions derived from the model-generated explanation, enabling a comprehensive assessment of whether retrieval is necessary for each prediction. To determine the optimal triggering thresholds for these indicators, we develop a two-stage hybrid search strategy that efficiently explores the threshold space. Notably, prior dynamic RAG methods typically iterate retrieval to refine the retrieval target, whereas we adopt a one-shot scheme: a single trigger decision followed by at most one retrieval step per instance, with the retrieved evidence directly used for the final prediction for efficiency. For evidence retrieval , we build an entity-enriched multimodal hybrid indexing strategy and perform contrastive evidence retrieval guided by model-generated explanations. This process integrates visual, textual, and explanation-derived entity information into the index, enabling more deception-relevant and semantically aligned retrieval. Subsequently, based on the inferred fine-grained deception labels, we retrieve both positive and negative evidence to provide the model with more targeted guidance for model decision-making. To comprehensively evaluate dynamic retrieval strategies in our task, we further introduce two metrics: Retrieval Identification Rate , which measures the accuracy of recognizing when retrieval is needed, and Retrieval Efficiency , which quantifies the performance gains attributable to retrieval triggering. We conduct systematic evaluations of the proposed framework on two widely used MFND datasets, AMG and MR2. Experimental results demonstrate that our method significantly outperforms existing approaches in retrieval triggering accuracy, retrieval quality, and final detection performance, highlighting its strong practicality and generalization capabilities. In summary, our main contributions are as follows: • We make the first attempt to apply the dynamic Retrieval-Augmented Generation framework to Multimodal Fake News Detection. Differing from prior supervised methods, our approach enables efficient detection without the need for task-specific training. • We propose ExDR, an explanation-driven framework that innovates on retrieval triggering and contrastive evidence retrieval, achieving more efficient and deception-targeted retrieval. • We design two new metrics to assess the accuracy and necessity of retrieval triggering. Extensive experiments on both in-domain and out-of-domain datasets demonstrate that ExDR achieves state-of-the-art detection performance, while our new metrics confirm its superiority in retrieval precision and necessity. 2. Related Work The goal of multimodal fake news detection is to identify inconsistencies or deceptive content across modalities such as text and images. BMR ( 36 ) employ single-view prediction to disentangle multimodal features and explain which modality plays a critical role in the final decision. NSLM ( 8 ) leverages symbolic logic constraints to unveil deceptive patterns within multimodal fake news. MMDFND ( 29 ) enhances multimodal feature representation by integrating additional vision and language models and applying feature-wise weighting strategies. FKA-Owl ( 18 ) encodes forgery-specific features as learnable continuous vectors and utilizes soft prompt tuning to strengthen the reasoning ability of LVLMs. Although these approaches improve the effectiveness of multimodal fake news detection, they remain limited by challenges in modality alignment and a strong reliance on high-quality deception-specific features. Retrieval-Augmented Generation (RAG) alleviates these issues by incorporating relevant information retrieved from external corpora ( 4 ; 7 ; 14 ; 23 ; 30 ; 31 ) . More recently, dynamic RAG techniques further enhance this capability