E-FreeM 2 : E fficient Training- Free M ulti-Scale and Cross-Modal News Verification via M LLMs ISBN: 978-1-4503-XXXX-X/2018/06 Conference: The 2nd Workshop on Security-Centric Strategies for Combating Information Disorder; August 25–29, 2025; Hanoi, Vietnam The 2nd Workshop on Security-Centric Stra
Van-Hoang Phan, Long-Khanh Pham, Dang Vu, Anh-Duy Tran, Minh-Son Dao · 2025
Read E-FreeM 2 : E fficient Training- Free M ulti-Scale and Cross-Modal News Verification via M LLMs ISBN: 978-1-4503-XXXX-X/2018/06 Conference: The 2nd Workshop on Security-Centric Strategies for Combating Information Disorder; August 25–29, 2025; Hanoi, Vietnam The 2nd Workshop on Security-Centric Stra by Van-Hoang Phan, Long-Khanh Pham, Dang Vu, Anh-Duy Tran, Minh-Son Dao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-20944.txt.
Introduction
Van-Hoang Phan and co-authors check news truth with big sight-and-word models and no fresh teach runs. The work dates to 2025. False news spreads fast on phones and air webs, a hard guard task. Taught guards can be fooled by crafted strikes or taint in their teach sets.
Their frame pulls trust facts live and cross-checks claims at more than one scale. It weighs sight and word signs as one. The frame is light, so edge gear can host it with no heavy on-site work. Tests on two fact sets hit top marks. It also stood firm when struck in set ways.
Catalog record
| CREATOR | Van-Hoang Phan, Long-Khanh Pham, Dang Vu, Anh-Duy Tran, Minh-Son Dao |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-20944
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
E-FreeM 2 : E fficient Training- Free M ulti-Scale and Cross-Modal News Verification via M LLMs ISBN: 978-1-4503-XXXX-X/2018/06 Conference: The 2nd Workshop on Security-Centric Strategies for Combating Information Disorder; August 25–29, 2025; Hanoi, Vietnam The 2nd Workshop on Security-Centric Strategies for Combating Information Disorder (SCID ’25), August 25–29, 2025, Hanoi, Vietnam DOI: 10.1145/3709020.3734834 ISBN: 979-8-4007-1417-7/2025/08 CCS: Security and privacy Social aspects of security and privacy CCS: Computing methodologies Knowledge representation and reasoning CCS: Computing methodologies Natural language processing CCS: Computing methodologies Multi-agent systems Van-Hoang Phan, Long-Khanh Pham, Dang Vu, Anh-Duy Tran, Minh-Son Dao Abstract . The rapid spread of misinformation in mobile and wireless networks presents critical security challenges. This study introduces a training-free, retrieval-based multimodal fact verification system that leverages pretrained vision-language models and large language models for credibility assessment. By dynamically retrieving and cross-referencing trusted data sources, our approach mitigates vulnerabilities of traditional training-based models, such as adversarial attacks and data poisoning. Additionally, its lightweight design enables seamless edge device integration without extensive on-device processing. Experiments on two fact-checking benchmarks achieve SOTA results, confirming its effectiveness in misinformation detection and its robustness against various attack vectors, highlighting its potential to enhance security in mobile and wireless communication environments. 1. Introduction In recent years, the proliferation of media manipulation technologies, such as Deepfakes, has captured significant attention due to their qualities and their role in amplifying the spread of false information ( Shao et al. 2023 ; Tolosana et al. 2020 ; Wang et al. 2022 ; Zhao et al. 2021 ) . These technologies, powered by advancements in artificial intelligence, including video, image, and speech synthesis, have raised concerns about their potential misuse in generating fake news and facilitating financial fraud, prompting responses from both regulatory authorities and industry stakeholders to mitigate their impact. However, one of News Verification’s most pervasive yet understudied challenges is out-of-context (OOC) misinformation, where authentic, unaltered images are repurposed with misleading or false narratives ( Fazio 2020 ) . For instance, during the recent Israel-Hamas conflict, social media platforms witnessed numerous cases of OOC misinformation, with old images from unrelated conflicts or even video game footage falsely presented as current events ( Sample 2020 ) . Unlike manipulated media, OOC misinformation is challenging to detect because the visual content remains authentic, and the deception arises solely from the misleading context provided by accompanying text. Addressing this “infodemic” requires multifaceted strategies, with news verification playing a pivotal role through fact-checking and debunking false claims ( Nikolov et al. 2020 ; Liu and Huang 2020 ) . Misinformation, which is shared unintentionally, and disinformation, deliberately disseminated to deceive often for political motives, both thrive in digital ecosystems ( Evanega et al. 2020 ) . Social media platforms, such as TikTok, have emerged as significant vectors for disinformation, particularly among younger audiences, through formats like Deepfakes and less sophisticated “Cheapfakes” ( Alonso-López et al. 2021 ) . As these platforms amplify the reach of false narratives, developing robust news verification techniques becomes essential to ensure the integrity of information. This research aims to address the critical challenges of detecting and mitigating OOC misinformation and manipulated media, leveraging advancements in artificial intelligence to enhance the accuracy and reliability of news verification systems. Recent advancements in Out-of-Context (OOC) detection—which focuses on determining whether an authentic image is accurately represented within a given claim—have increasingly relied on external information retrieval through custom search engines such as the Google API ( Papadopoulos et al. 2023b ; Yuan et al. 2023 ; Zhang et al. 2023 ) . These methods have demonstrated significant improvements by incorporating additional contextual evidence. In contrast, earlier approaches that lacked external data integration ( Aneja et al. 2023 ; Mu et al. 2023 ; Pham et al. 2024 ; Vo-Hoang et al. 2024 ) depended solely on the intrinsic features of image-claim pairs, which limited their effectiveness in verifying claims. Professional fact-checkers typically assess both internal image features and external contextual information to determine the validity of an image-claim relationship. However, leveraging retrieved evidence efficiently remains a major challenge in OOC detection, particularly in identifying subtle inconsistencies between images and associated claims. To address this, recent studies ( Abdelnabi et al. 2022 ; Qi et al. 2024 ; Tahmasebi et al. 2024 ; Pham et al. 2024 ) have investigated the integration of retrieved evidence into classifiers, pretrained models, and large vision-language models (LVLMs). While these enhancements improve accuracy, they often come at the cost of increased architectural complexity and computational overhead. Several prior studies ( Pham et al. 2024 ; Abdelnabi et al. 2022 ; Tahmasebi et al. 2024 ; Tonglet et al. 2024 ) have made significant contributions to fact verification in multimodal tasks. By leveraging pretrained knowledge, reasoning capabilities, and generative abilities, these approaches effectively detect factual inconsistencies in image-text pairs while generating coherent, natural language-based explanations. Building on this foundation, recent works ( Qi et al. 2024 ) enhance fact-checking models by augmenting input data with external information retrieved via tool-based methods before applying instruction tuning for training OOC misinformation detectors. However, training models on curated fact-checking datasets for OOC misinformation detection presents several challenges. One major drawback of relying on fixed datasets is their inability to keep up with evolving misinformation trends. Since these datasets must undergo collection, preprocessing, and publication before they can be used, they quickly become outdated. Additionally, they are vulnerable to static data poisoning attacks, reducing their adaptability, security, and effectiveness in real-time fact-checking. Another critical challenge is the high computational cost of training or adapting Multimodal Large Language Models (MLLMs). Furthermore, to remain effective against rapidly evolving misinformation, frequent retraining is necessary, further increasing computational and storage overhead. To address these challenges, we introduce E-FreeM 2 , a specialized Multimodal Large Language Model (MLLM) designed for real-time OOC misinformation detection with high accuracy. Our approach enhances verification by leveraging a cross-modal, multi-scale framework to retrieve and generate high-quality candidate information. E-FreeM 2 first conducts external searches to gather additional evidence, employing cross-modal strategies for candidate ranking and multi-stage filtering to refine the retrieved data. The final decision-making process follows a two-stage chain-of-thought reasoning mechanism: the first stage validates the retrieved candidates against the input, while the second stage detects OOC misinformation based on consolidated judgments and explanations from the previous step. Our contribution can be summarized as follows: • Cross-Modal Data Pipeline : We design a novel cross-modal data pipeline that operates on both local and global scales, assisted by a Filter Module, to transform OOC image-text pairs into high-quality candidate sets. These refined candidates serve as the foundation for accurate judgments and coherent explanations. • Training-Free Adaptation for MLLMs : We propose E-FreeM 2 , a practical, training-free approach to adapt existing MLLMs for out-of-context misinformation detection using a two-stage chain-of-thought instruction mechanism. Our method efficiently leverages retrieved cross-modal candidates, effectively modeling both internal image-text relationships and external claim-evidence connections, enabling simultaneous OOC detection and explanation. • SOTA Performance Without Training Data : Comprehensive experiments demonstrate that E-FreeM 2 significantly outperforms state-of-the-art (SOTA) methods in detection accuracy, all while requiring no training data or additional computational resources. Moreover, it generates precise and persuasive explanations, enhancing the interpretability of its decisions. The remainder of this paper