VAAS: Vision-Attention Anomaly Scoring for Image Manipulation Detection in Digital Forensics Journal: DFRWS EU 2026
Opeyemi Bamigbade, Mark Scanlon, John Sheppard · 2025
Read VAAS: Vision-Attention Anomaly Scoring for Image Manipulation Detection in Digital Forensics Journal: DFRWS EU 2026 by Opeyemi Bamigbade, Mark Scanlon, John Sheppard (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-15512.txt.
Introduction
Opeyemi Bamigbade, Mark Scanlon, and John Sheppard present VAAS, a system for spotting manipulated images for forensic work, in a 2025 paper. New image generators can forge pictures that look consistent and fool detectors tuned to pixel or compression traces. Most detectors also give no sense of how severe a manipulation is.
VAAS pairs a global attention based score from a Vision Transformer with a patch level consistency score from SegFormer embeddings. Together they give a continuous, readable anomaly score showing both where and how much an image was altered. Tests on the DF2023 and CASIA v2.0 data sets show competitive detection scores, plus attention maps that help explain each verdict.
Catalog record
| CREATOR | Opeyemi Bamigbade, Mark Scanlon, John Sheppard |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-15512
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
VAAS: Vision-Attention Anomaly Scoring for Image Manipulation Detection in Digital Forensics Journal: DFRWS EU 2026 Opeyemi Bamigbade, Mark Scanlon, John Sheppard Abstract Recent advances in AI-driven image generation have introduced new challenges for verifying the authenticity of digital evidence in forensic investigations. Modern generative models can produce visually consistent forgeries that evade traditional detectors based on pixel or compression artefacts. Most existing approaches also lack an explicit measure of anomaly intensity, which limits their ability to quantify the severity of manipulation. This paper introduces Vision-Attention Anomaly Scoring (VAAS) , a novel dual-module framework that integrates global attention-based anomaly estimation using Vision Transformers (ViT) with patch-level self-consistency scoring derived from SegFormer embeddings. The hybrid formulation provides a continuous and interpretable anomaly score that reflects both the location and degree of manipulation. Evaluations on the DF2023 and CASIA v2.0 datasets demonstrate that VAAS achieves competitive F1 and IoU performance, while enhancing visual explainability through attention-guided anomaly maps. The framework bridges quantitative detection with human-understandable reasoning, supporting transparent and reliable image integrity assessment. The source code for all experiments and corresponding materials for reproducing the results are available open source. 1 Introduction The reliability of digital images as admissible evidence has become a critical concern in modern forensic investigations. Multimedia forensic techniques can play a central role in verifying the authenticity of visual content presented in legal, journalistic, and intelligence contexts ( 28 ) . In these contexts, one of the primary objectives is the detection and localisation of image manipulations, ensuring that digital evidence remains trustworthy in court. In the 2024 digital forensic practitioner survey ( 14 ) , \sim 20% of practitioners report they encounter deepfakes “occasionally" or “often” in their investigations. Recent advances in generative models such as GANs and diffusion networks have significantly increased the difficulty of detecting tampered or fabricated images, as these models produce semantically coherent and artefact-free edits that evade traditional forensic cues. Traditional image manipulation techniques are broadly classified into three categories: (1) splicing , where content from one image is copied into another; (2) copy-move , which involves duplicating a region within the same image; and (3) inpainting , which fills missing regions with synthetic or reconstructed content ( 33 ; 31 ; 18 ) . Examples of these manipulations are shown in Figure 1 . Early forensic methods relied on identifying pixel-level inconsistencies, compression artefacts, or metadata discrepancies. However, these cues are often removed or concealed in AI-enhanced manipulations that employ diffusion models or adversarial synthesis pipelines. With the increasing accessibility of generative AI tools, images can now be modified with remarkable realism and semantic coherence ( 18 ) . These models adjust fine-grained features, such as texture, illumination, and object boundaries, leaving minimal forensic traces. As a result, conventional forensic algorithms focused solely on low-level features struggle to capture the spatial and contextual relationships that define visual authenticity. Addressing this challenge requires methods capable of learning high-level spatial dependencies and detecting subtle inconsistencies in attention and feature representation. In this context, attention mechanisms and Vision Transformers (ViTs) provide a promising foundation for forensic analysis. Their ability to capture global context and model long-range dependencies makes them suitable for identifying inconsistencies between authentic and manipulated regions. Building on this principle, this paper introduces a hybrid framework that couples global attention analysis with local manipulation segmentation for interpretable anomaly detection. 1.1 Contributions of this Work The proposed VAAS framework introduces a novel hybrid anomaly-scoring formulation that integrates global attention deviations with local self-consistency, offering a unified and interpretable measure of image manipulation that has not been addressed in the literature. The key contributions are summarised as follows: 1. Dual-module forensic architecture: A unified design integrating a Vision Transformer-based Forensic Attention Extractor (Fx) for global anomaly representation and a SegFormer-based Manipulation Segmentor (Px) for localised tampering analysis. 2. Hybrid anomaly scoring mechanism: A principled fusion strategy that combines global attention deviation and local spatial inconsistency into a single hybrid score quantifying image integrity. 3. Explainable forensic interpretability: The generation of attention-driven anomaly maps that provide visual and interpretable evidence, thereby improving transparency and trust in forensic decision-making. 4. Empirical validation and benchmarking: A comprehensive evaluation on two datasets demonstrates competitive image manipulation detection, stable localisation, and strong generalisation across traditional ( CASIA v2.0 ) and generative manipulation types ( DF2023 ). All experimental code and reproducibility resources are available open source at https://github.com/OBA-Research/VAAS-experiments . 2 Background The authenticity of digital images remains a central concern in forensic investigations, where visual evidence must be traceable, reproducible, and defensible. Traditional forensic methods focused on low-level signal artefacts, while modern manipulation techniques increasingly rely on generative models that alter global semantics without leaving obvious pixel-level traces. This section summarises the evolution of image manipulation detection, highlighting why global–local reasoning is needed for contemporary forensic analysis. 2.1 Classical Forensic Approaches Early forensic techniques relied on analysing pixel-level disturbances introduced by editing workflows. Examples include DCT-block inconsistencies, CFA artefact disruption, and resampling traces ( 21 ; 19 ) . Copy–move detection using SIFT/SURF descriptors ( 24 ; 5 ) and splicing detection using boundary or texture irregularities ( 3 ) provided interpretable results suitable for forensic reporting. However, these handcrafted cues degrade when images are recompressed, filtered, or regenerated through AI pipelines, limiting their robustness. 2.2 AI-Generated Manipulations and Modern Challenges Generative models such as GANs and diffusion networks can modify lighting, structure, and scene semantics while preserving pixel-level coherence ( 18 ) . Such manipulations lack the artefacts exploited by traditional detectors and often evade signal-based methods, especially when trained on large-scale synthetic datasets. This shift has created a need for forensic approaches that reason about spatial coherence rather than relying solely on low-level noise patterns. 2.3 Deep Learning in Image Forensics CNN-based forensic models improve robustness by learning discriminative features directly from data ( 23 ; 37 ) . More recent transformer-based systems leverage attention mechanisms to capture long-range dependencies and semantic inconsistencies, making them effective for generative manipulations ( 13 ; 32 ) . Despite strong performance, most deep models act as black boxes and do not provide an interpretable, continuous measure of tampering intensity. This gap motivates hybrid approaches that combine global context, local consistency, and interpretable scoring. 2.4 Motivation for VAAS The proposed Vision-Attention Anomaly Scoring (VAAS) framework builds on these developments by combining global attention analysis with local self-consistency scoring. VAAS introduces a hybrid mechanism that quantifies the likelihood of manipulation while producing visually interpretable evidence maps. In doing so, it bridges the gap between quantitative performance and qualitative transparency, aligning computational detection with the practical requirements of digital forensic validation. 3 Related Work The continuous advancement in artificial intelligence, particularly in computer vision, has driven substantial progress in image forgery detection. Traditional methods for digital image integrity verification, which rely on pixel-level anomaly detection, compression artefacts, or metadata analysis, are increasingly inadequate against the complex manipulations produced by modern generative models. This section reviews major research directions in image manipulation detection, authenticity verification, and the emerging role of attention and cross-attention mechanisms in forensic image analysis. 3.1 Image Manipulation Detection AI-driven image manipulation detection has become an essential field across journalism, law enforcement, and national security, where visual authenticity is critical ( 27