Spectral Forensics of Diffusion Attention Graphs for Copy-Move Forgery Detection

H. M. Shadman Tabib, Tasriad Ahmed Tias, Nafis Tahmid, [3pt] Department of Computer Science, EngineeringBangladesh University of Engineering and Technology (BUET)Dhaka, Bangladesh · 2026

Read Spectral Forensics of Diffusion Attention Graphs for Copy-Move Forgery Detection by H. M. Shadman Tabib, Tasriad Ahmed Tias, Nafis Tahmid, [3pt] Department of Computer Science, EngineeringBangladesh University of Engineering and Technology (BUET)Dhaka, Bangladesh (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17287.txt.

Introduction

Tabib, Tias, and Tahmid present GraphSpecForge, a training-free system spotting copy-move forgery from focus graph spectra in a Stable Diffusion U-Net. Copy-move edits induce subgraph copying in the focus graph, causing shifts in spectra. The authors prove this link with nudge cases and build an anomaly finder using earth-mover gaps between image spectra and a baseline spread. Tested on four copy-move benchmarks with no retrain, the best setup reaches AUROC 0.606 on RecodAI-LUC, with higher scores on MICC-F220, CoMoFoD, and COVERAGE.

Catalog record

CREATORH. M. Shadman Tabib, Tasriad Ahmed Tias, Nafis Tahmid, [3pt] Department of Computer Science, EngineeringBangladesh University of Engineering and Technology (BUET)Dhaka, Bangladesh
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70381
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.17287

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Spectral Forensics of Diffusion Attention Graphs for Copy-Move Forgery Detection H. M. Shadman Tabib, Tasriad Ahmed Tias, Nafis Tahmid, [3pt] Department of Computer Science, EngineeringBangladesh University of Engineering and Technology (BUET)Dhaka, Bangladesh Abstract Copy-move forgery, where a region within an image is duplicated to conceal or fabricate content, remains a persistent threat to visual media integrity. We introduce GraphSpecForge , a training-free forensic framework that detects copy-move forgery by analysing the spectral properties of attention graphs extracted from a pretrained Stable Diffusion U-Net. Our key theoretical insight is that copy-move manipulation induces approximate subgraph duplication in the self-attention affinity graph, causing detectable spectral redistribution in the normalized graph Laplacian. We formalise this connection via perturbation-theoretic arguments and construct an image-level anomaly detector based on Wasserstein transport distances between per-image Laplacian spectra and an authentic reference distribution. We validate GraphSpecForge across four copy-move benchmarks without forgery-specific retraining. On the large-scale RecodAI-LUC benchmark (5,128 images), our best configuration achieves AUROC = 0.606 =0.606 ( 95 % 95\% CI: 0.580 0.580 – 0.638 0.638 ; permutation p = 0.005 p=0.005 ), with the normalized Laplacian consistently outperforming raw attention spectra by + 0.057 +0.057 AUROC. On three additional public benchmarks—MICC-F220, CoMoFoD, and COVERAGE—the same training-free pipeline attains AUROCs of 0.752 0.752 , 0.774 0.774 , and 0.673 0.673 , respectively; on CoMoFoD the detector further reaches AUPRC = 0.833 =0.833 , balanced accuracy = 0.712 =0.712 , and MCC = 0.499 =0.499 , with TPR @ ​ 1 % @1\% FPR = 32.5 % =32.5\% . The Laplacian advantage and the decoder-heavy layer concentration are reproduced on every benchmark, while the optimal feature bundle and fusion depth adapt to dataset scale—establishing a portable spectral anomaly mechanism rather than a brittle recipe. Extended ablation and falsification experiments on a 400-image subset further confirm the signal’s specificity and monotonic sensitivity to manipulation strength, and null-graph controls rule out trivial-statistic explanations. We provide comprehensive ablations over spectral representations, feature groups, layer fusion strategies, and scoring methods, and present an honest assessment of the signal strength and remaining challenges for purely spectral forensic approaches. 1 Introduction Copy-move forgery (CMF) is one of the most common and pernicious forms of image manipulation, in which a region of an image is duplicated and pasted elsewhere within the same image to conceal or fabricate visual content fridrich2003detection ; christlein2012evaluation . The duplicated regions may undergo geometric transformations, compression artefacts, or blending, making detection challenging. Traditional CMF detectors rely on hand-crafted features such as block matching popescu2004exposing , keypoint descriptors amerini2011sift , or dense field methods cozzolino2015efficient . More recent approaches leverage deep learning to learn discriminative representations wu2018busternet ; chen2021serial , but these require task-specific training data and may not generalise across manipulation types. A parallel line of research has explored foundation models as forensic tools wang2023dire ; ojha2023towards , recognising that large pretrained models encode rich structural priors about natural images. Diffusion models ho2020denoising ; rombach2022high ; uddin2025cryo , in particular, build detailed internal representations through their denoising process, and their self-attention maps capture fine-grained spatial relationships. Recent work has shown that diffusion attention maps can ground semantic concepts tang2023daam ; hertz2023prompt and detect out-of-distribution manipulations wang2023dire . In this paper, we pursue a fundamentally different approach: rather than using diffusion models as feature extractors for a downstream classifier, we analyse the graph-spectral structure of their attention maps directly. Our core hypothesis is: Copy-move forgery induces approximate duplicated-subgraph perturbations in the self-attention affinity graph of a pretrained diffusion model, and these perturbations produce detectable spectral redistribution in the normalized graph Laplacian. We formalise this hypothesis through perturbation-theoretic arguments ( Section 3 ), showing that subgraph duplication compresses local eigenvalue spacings and redistributes spectral mass. We then construct GraphSpecForge , a fully training-free forensic pipeline ( Section 4 ) that: 1. Extracts self-attention affinity matrices from 16 layers of a pretrained Stable Diffusion v1.5 U-Net; 2. Constructs normalized graph Laplacians and computes their eigenvalue spectra; 3. Measures per-image spectral anomaly via Wasserstein transport distance to an authentic reference; 4. Fuses scores across layers using reliability-weighted aggregation. Contributions. • A theoretical framework connecting copy-move forgery to spectral perturbation of attention-derived graph Laplacians, grounded in classical results on graph duplication and eigenvalue interlacing. • A training-free image-level detector achieving AUROC 0.606 on the large-scale RecodAI-LUC benchmark ( n=5{,}128 ), with the normalized Laplacian consistently outperforming raw attention spectra ( +0.057 AUROC, permutation p=0.005 ). • A Forgery Spectral Expert Layer (FSEL) selection methodology combining distributional, causal, and stability criteria to identify the most forensically informative attention layers, and a reproducible decoder-heavy ranking that transfers across datasets. • Multi-benchmark cross-dataset validation on three additional public copy-move datasets (MICC-F220, CoMoFoD, COVERAGE) spanning JPEG compression, geometric transforms, and natural-scene duplications, reaching AUROCs of 0.752 , 0.774 , and 0.673 and MCC up to 0.499 without any forgery-specific retraining , while a controlled Laplacian-vs.-raw comparison at matched configuration reveals dataset-dependent but consistently non-negative Laplacian advantage on the two larger-manipulation benchmarks. • Comprehensive ablations and falsification tests over spectral representations, feature groups, layer fusion strategies, normalisation methods, null-graph controls, non-copy-move corruption negatives, and a controlled severity sweep—giving an honest multi-dataset assessment of signal strength and remaining limitations. Figure 1 : Sample images from the RecodAI-LUC dataset. Top row: authentic images. Bottom row: corresponding forged copies with copy-move manipulations. The duplicated regions are visually subtle, making detection challenging even for human observers. For anonymity and to avoid cluttering the figure, only the dataset identifier is stated here; individual source filenames are omitted. 2 Related Work Copy-move forgery detection. Classical methods detect duplicated regions through block matching with DCT fridrich2003detection , PCA popescu2004exposing , or Zernike moments ryu2010detection , followed by keypoint-based approaches using SIFT amerini2011sift or SURF features. Dense-field methods cozzolino2015efficient estimate pixel-level correspondence maps. Deep learning approaches include BusterNet wu2018busternet , which uses a two-branch architecture, and DOA-GAN islam2020doa , which synthesises training data. These methods typically require task-specific training and may struggle with unseen manipulation parameters. Diffusion models for image forensics. Wang et al. wang2023dire proposed DIRE, which reconstructs images through a diffusion process and uses reconstruction error for detection. Ojha et al. ojha2023towards demonstrated that features from large pretrained models generalise across manipulation types. Corvi et al. corvi2023detection studied artefacts specific to diffusion-generated images. Our approach differs fundamentally: we do not use the diffusion model as a feature extractor for classification, but analyse the structural properties of its internal attention representations. Spectral methods in graph analysis. The normalized graph Laplacian L=I-D^{-1/2}AD^{-1/2} is central to spectral graph theory chung1997spectral . Its eigenvalues encode connectivity, clustering structure, and symmetries von2007tutorial . Perturbation theory for graph spectra stewart1990matrix provides bounds on eigenvalue shifts under structural modifications. The Weyl interlacing theorem constrains how eigenvalues change when vertices or edges are added haemers1995interlacing . We leverage these classical results to predict how copy-move duplication should perturb attention graph spectra. Attention map analysis. Self-attention mechanisms in vision transformers and diffusion models create implicit graphs over spatial tokens. DAAM tang2023daam and related methods hertz2023prompt extract and interpret attention for semantic grounding. The Seg4Diff framework seg4diff2025 identifies “expert layers” in diffusion architectures whose attention maps best ground semantic regions. We adapt this expert-layer concept to forensics, defining the Forgery Spectral Expert Layer (FSEL)

Read the complete text