CAM-VFD: Cross-Attention Multimodal Video Forgery Detection

Hoda Osama Elkhodary, Sherin Mostafa Youssef, Marwa Elshenawy, Dalia Sobhy · 2026

Read CAM-VFD: Cross-Attention Multimodal Video Forgery Detection by Hoda Osama Elkhodary, Sherin Mostafa Youssef, Marwa Elshenawy, Dalia Sobhy (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-17133.txt.

Introduction

Elkhodary and colleagues attack forged video by comparing what a clip shows, how it moves and how deep its scene looks. Their CAM-VFD system lets appearance features question motion and depth features through cross-attention, exposing mismatches that single-signal detectors miss. On two generated-video benchmarks it tops 93 percent accuracy and holds up under compression and noise, the authors report.

Catalog record

CREATORHoda Osama Elkhodary, Sherin Mostafa Youssef, Marwa Elshenawy, Dalia Sobhy
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52217
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.17133

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CAM-VFD: Cross-Attention Multimodal Video Forgery Detection Hoda Osama Elkhodary, Sherin Mostafa Youssef, Marwa Elshenawy, Dalia Sobhy Abstract The rapid advancement of Deepfake technologies and video manipulation tools poses a critical challenge to multimedia forensics, judicial evidence integrity, and information authenticity. Current detectors rely on single-modality signals, treating appearance, geometry, and motion independently. However, advanced generators maintain within-modality consistency while producing cross-modal contradictions, which are forensically discriminative but invisible to any single-modal detector. We propose CAM-VFD, a Cross-Attention Multimodal Video Forgery Detection framework that models cross-modal contradiction as a directional forensic signal. The framework uses a cross-attention fusion mechanism in which CLIP-based appearance representations serve as queries against VideoMAE motion features and MiDaS depth features, enabling the identification of contradictions between visual, temporal, and geometric evidence. We examine this design through cross-modal attention discrepancy analysis, observing statistically separable real and fake distributions ( p < 0.001 p<0.001 , Cohen’s d = 0.68 d=0.68 ). Experimental results on two generative video benchmarks indicate consistent performance, with 95.31% Top-1 accuracy on GenVidBench and 93.43% accuracy, 90.63% F1-score, and 96.56% AUROC on GenVideo. Moreover, CAM-VFD demonstrates stable performance under compression, noise, blur, and adversarial perturbations, suggesting that cross-modal reasoning may improve robustness in media forensics. The code is publicly available at https://github.com/Hoda-Osama/CAM-VFD/tree/main . Keywords: Deepfake, Forgery Detection, Forensic, AI-generated content detection, Video Forensics, content authenticity detection, Multimodal Fusion, CLIP, VideoMAE, MiDaS, Cross-Attention Fusion, cross-modal contradiction. 1 Introduction Recent evolution in artificial intelligence, particularly deep learning-based techniques such as Generative Adversarial Networks (GANs), diffusion models, and auto-regressive architectures, has enabled AI-based synthetic video generators to emerge. Deepfakes—realistic yet fabricated synthetic videos—are becoming increasingly difficult to distinguish with the human eye, challenging the validity of digital media in courts [ 18 ] . The consequences are severe: fabricated videos have appeared as forensic evidence in legal proceedings, been exploited to spread political disinformation, and used to impersonate individuals without consent [ 1 ] . Consequently, there is an urgent need for reliable and scalable methods for Deepfake detection. Previous work in video forensics has progressed from detecting spatial artifacts in individual frames [ 16 , 27 ] to capturing temporal inconsistencies in facial dynamics [ 3 , 10 , 23 ] . More recent approaches have explored spatio-temporal feature learning [ 29 , 2 ] and semantic coherence analysis [ 5 , 33 ] . However, these approaches fail to generalize to the next-generation generators, which can now synthesize entire semantically rich scenes rather than modifying facial regions using generative models of text-to-video (T2V) [ 45 ] or image-to-video (I2V) [ 17 ] . Although some recent approaches designed for full-frame manipulations have been developed [ 21 ] , a fundamental limitation persists in nearly all of them: they treat the video as a collection of signals from a single modality dimension, overlooking cross-modal contradictions and misalignment between appearance, geometry, and motion. These cross-modal contradictions cause a detection failure in current-generation AI video detection models because most AI-generated videos may appear locally plausible in any single modality while containing cross-modal contradictions rarely found in physically captured authentic footage. Although multimodal detection technologies are introduced in some recent works [ 44 , 25 ] , they are still incapable of combining appearance, depth, and motion cues through effective fusion mechanisms. Specifically, most existing multimodal frameworks are not designed to explicitly detect cross-modal contradiction as a forensic signal; they seek to benefit from complementary information without querying one modality for evidence that contradicts another. In response to these challenges, we propose CAM-VFD (Cross-Attention Multimodal Video Forgery Detection), which treats cross-modal contradiction as an explicit, directional forensic signal. Appearance is the richest semantic forensic channel as it integrates semantic content, texture, illumination, and object identity, so appearance tokens serve as a forensic query channel while motion and depth provide the key evidence against which appearance is tested. The model computes, for each appearance token, the degree to which the motion and depth context are consistent with that appearance. Our proposed framework provides the following contributions: • We introduce cross-modal contradiction as a directional forensic signal for Deepfake detection, and validate its forensic separability via attention discrepancy analysis. The results demonstrate a clear and consistent separation between real and fake samples. • We propose a cross-attention fusion module in which CLIP [ 34 ] appearance representations serve as queries against VideoMAE [ 41 ] motion and MiDaS [ 36 , 35 ] depth as keys and values, operationalizing the directional forensic relationship. • We conduct a comprehensive evaluation on two benchmarks to prove the efficacy of our proposed framework for fake video detection compared to state-of-the-art methods. We tested the model across GenVidBench and GenVideo, achieving higher accuracy compared to the state-of-the-art. • We perform robustness and security analysis under real-world conditions, including compression, noise, blurring, and adversarial perturbations, with direct SOTA comparison against DeMamba under identical settings. The findings suggest improved robustness to challenging degradations while preserving reliable detection performance. The remainder of this paper is structured as follows. Section 2 discusses the related work. Section 3 describes the proposed CAM-VFD framework. Section 4 presents the experimental results and ablation studies. Section 5 presents the cross-modal attention discrepancy analysis validating our forensic premise. Section 6 reports robustness and adversarial evaluation. Section 7 concludes the paper. 2 Related Work Table 1: Summary of existing literature. Ref. Target Content Modalities Fusion Strategy [ 29 , 2 , 39 , 53 ] Face Single (Spatio-Temp.) None [ 51 , 28 ] Face Single (Spatio-Temp.) None [ 3 , 5 , 33 , 43 , 15 ] Face Single (Semantic/Motion) None [ 44 , 31 , 7 ] Face Two Simple/Static [ 12 , 26 , 49 ] Face/Scene Two–Three Advanced/Static Ours Scene Three Cross-attention In this section, we provide a discussion related to major research directions for detecting synthetic videos: (i) spatio-temporal inconsistencies (Section 2.1 ), which focus on defects across space and time; (ii) semantic and dynamic inconsistency (Section 2.2 ), which captures unnatural human motion, action dynamics, or semantic mismatches; and (iii) multimodal fusion (Section 2.3 ), which integrates complementary cues across modalities to expose manipulation traces. Table 1 summarizes the landscape and positions CAM-VFD relative to prior work. 2.1 Spatio-Temporal Inconsistencies Early detection methods analyzed video frames individually, exploiting trace patterns left by generators in convolutional feature maps [ 16 , 27 ] or frequency-domain statistics. Research then shifted to spatio-temporal inconsistencies, motivated by the observation that temporal consistency is difficult for generative models to maintain. For instance, early work by [ 29 ] used a 3D convolutional neural network (CNN) on stacked face regions from consecutive frames to capture unnatural transitions. Similarly, [ 2 ] proposed a spatio-temporal CNN that analyzes both RGB spatial features and temporal dynamics from optical flow maps. [ 39 ] combined three ResNet-50 models targeting spatial, temporal, and structural anomalies with fuzzy logic to handle uncertainty. [ 53 ] targeted inter-frame illumination inconsistencies by proposing a learnable Illumination Decomposition Module (IDM) that separates frames into illumination and reflection components. Recently, [ 51 ] proposed a dynamic data augmentation strategy guided by forgery heatmaps produced by a Swin Transformer, combined with Cross-Frame Multi-Head Attention (CMA) and a Bidirectional GRU to model sequential spatio-temporal dependencies.

Read the complete text