DYMAPIA: A Multi-Domain Framework for Detecting AI-based Video Manipulation
Md Shohel Rana, Andrew H. Sung · 2026
Read DYMAPIA: A Multi-Domain Framework for Detecting AI-based Video Manipulation by Md Shohel Rana, Andrew H. Sung (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-24426.txt.
Introduction
Rana and Sung present DYMAPIA, a multi-domain deepfake detection framework fusing spatial, spectral, and temporal cues. Dynamic anomaly masks combine Fourier spectra, texture, edge irregularities, and optical flow to highlight tampered regions accurately. The masks guide DistXCNet, a lightweight Xception-distilled classifier with depthwise separable convolutions. Accuracy and F1 scores exceed 99 percent on FF++, Celeb-DF, and VDFD benchmarks, with a compact model fit for real-time use.
Catalog record
| CREATOR | Md Shohel Rana, Andrew H. Sung |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33769 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.24426
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DYMAPIA: A Multi-Domain Framework for Detecting AI-based Video Manipulation Md Shohel Rana, Andrew H. Sung Abstract AI-generated media are advancing rapidly, raising pressing concerns for content authenticity and digital trust. We introduce DYMAPIA, a multi-domain Deepfake detection framework that fuses spatial, spectral, and temporal cues to capture subtle traces of manipulation in visual data. The system builds dynamic anomaly masks by combining evidence from Fourier spectra, local texture descriptors, edge irregularities, and optical flow consistency, which highlight tampered regions with fine spatial accuracy. These masks guide DistXCNet, a lightweight classifier distilled from Xception and optimized with depthwise separable convolutions for fast, region-focused classification. This joint design achieves state-of-the-art results, with accuracy and F1-scores exceeding 99% on FF++, Celeb-DF, and VDFD benchmarks, while keeping the model compact enough for real-time use. Beyond outperforming existing full-frame and multidomain detectors, DYMAPIA demonstrates deployment readiness for time-critical forensic tasks, including media verification, misinformation defense, and secure content filtering. 1 Introduction The rapid progress of generative models 37 ; 40 ; 34 , particularly Generative Adversarial Networks (GANs) 10 and diffusion-based synthesis, has made it possible to generate photorealistic images and videos that are often indistinguishable from authentic content. These so-called Deepfakes are no longer confined to research labs; they are widely accessible through open source tools and user-friendly platforms. As a result, manipulated media have already been exploited in disinformation campaigns, identity fraud, and even falsified evidence, posing serious threats to journalism, digital forensics, and national security 25 ; 2 . In this context, ensuring the authenticity of visual media has become a pressing research challenge with direct societal implications. Over the last few years, many detection strategies have been proposed, ranging from convolutional neural networks (CNNs) to attention-based models and frequency-domain filters. While these approaches have advanced the field, two common limitations remain. First, most methods rely heavily on single-domain forensic cues, such as pixel-level irregularities or frequency distortions. These cues can be easily suppressed by advanced synthesis pipelines that are deliberately designed to hide such artifacts. Second, detection systems often process full frames of images or videos. This not only adds significant computational overhead but also dilutes the forensic signal with irrelevant background information, making detection less reliable in unconstrained or long-form media. To address these gaps, we introduce DYMAPIA (Dynamic Masking and Pixel-wise Inconsistency Analysis), a unified multi-domain framework for detecting manipulations in both images and videos. Instead of depending on a single forensic signal, DYMAPIA fuses complementary cues from three perspectives: • Frequency domain analysis to capture spectral distortions that arise from frame interpolation and content blending 16 ; 17 . • Texture, edge, and contour analysis using Local Binary Patterns (LBP) 15 , which reveal subtle inconsistencies in skin details, facial boundaries, and background textures. • Temporal consistency evaluation with dense optical flow 24 , which exposes abrupt transitions or implausible motion patterns across consecutive frames. Each of these analyses generates an anomaly mask, and the masks are merged into a dynamic composite mask that highlights manipulated regions at pixel-level granularity. This approach improves interpretability by showing where a manipulation occurs, while also strengthening robustness by combining cues that are difficult to suppress simultaneously. For classification, we propose DistXCNet , a compact convolutional architecture distilled from XceptionNet 6 . Unlike conventional detectors that operate on entire frames, DistXCNet learns directly from the dynamic masks, focusing on regions most likely to contain forensic evidence. Its design is based on depthwise separable convolutions, which drastically reduce the parameter count (fewer than 14K) while preserving discriminative power across multiple scales. This allows the model to run efficiently on resource-limited hardware, enabling real-time deployment. The DYMAPIA is designed with practical deployment in mind. We conduct runtime and memory profiling to evaluate its readiness for applications such as forensic triage, misinformation suppression, and secure content verification. Unlike most prior work, which targets only video detection, our framework generalizes naturally to manipulated images, expanding its usefulness across a broader range of multimedia forensics tasks. Our main contributions can be summarized as follows: • A unified detection framework (DYMAPIA) : We combine spectral, spatial, temporal cues into anomaly masks that pinpoint manipulated regions. • A lightweight classifier (DistXCNet) : We introduce a distilled Xception-based CNN that operates on sparse masks, achieving strong accuracy with < 14K parameters. • Comprehensive validation : We evaluate our approach on FF++, Celeb-DF, and VDFD datasets, showing consistent improvements in accuracy, F1-score, and generalization over state-of-the-art baselines. • Deployment-oriented analysis : We profile runtime, memory usage, and resilience under compression and low-motion conditions, demonstrating real-world viability for forensic and security applications. Our experiments confirm that DYMAPIA significantly improves detection accuracy and interpretability while remaining lightweight and fast enough for deployment. Beyond cybersecurity, the framework has implications for journalism, law enforcement, and digital forensics, where trustworthy media verification is critical to countering the risks of AI-generated disinformation. The rest of this paper is organized as follows: Section 2 reviews prior Deepfake detection methods; Section 3 details the DYMAPIA framework; Section 4 presents experimental validation and performance analysis; and Section 5 concludes with key findings and directions for future work. 2 Related Work The growing sophistication of Deepfake technology has raised serious concerns about the integrity and reliability of digital media. As generation techniques advance, detection research has evolved from early heuristic approaches to modern deep learning–driven methods. In this section, we review prior work across five categories: handcrafted feature–based methods, deep learning models, multi-domain strategies, limitations of existing frameworks, and adaptive approaches. Together, these studies highlight the research gaps that motivate the design of DYMAPIA. 2.1 Early Detection Methods Based on Handcrafted Features The first generation of Deepfake detection relied heavily on handcrafted features, often focusing on physiological or geometric inconsistencies. For example, eye-blinking irregularities and facial landmark distortions were among the earliest cues used to separate authentic and manipulated videos 20 . While these techniques were initially effective, they quickly became obsolete as generative methods improved. Advanced frameworks such as DeepFaceLab and the First Order Motion Model (FOMM) 33 introduced realistic facial reenactment and lip synchronization, masking the kinds of irregularities that handcrafted detectors relied on. Neural rendering approaches, such as Neural Voice Puppetry 36 , further increased realism, making purely heuristic detection infeasible. 2.2 Deep Learning (DL)-Based Detection Models With the limitations of handcrafted features, deep learning emerged as a dominant direction. Afchar et al. introduced MesoNet 1 , one of the first CNN-based models purpose-built for Deepfake detection, while Rossler et al. created FaceForensics++ (FF++) 32 , which remains a cornerstone dataset for benchmarking. These methods demonstrated the potential of convolutional architectures to capture subtle synthetic artifacts. At the same time, researchers have emphasized that deep learning is not a complete solution. Several studies 27 ; 28 ; 29 point out that classical machine learning techniques, when paired with carefully engineered features, can still outperform deep networks in specific settings. Such methods offer interpretability and lower computational cost, leading to growing interest in hybrid approaches that combine the strengths of both machine learning (ML) and deep learning (DL) 31 ; 30 . 2.3 Multi-Domain Approaches in Deepfake Detection To improve robustness, researchers have increasingly turned to multi-domain feature analysis. Frequency-domain methods, such as those by Durall et al. 9