DiffusionPrint: Learning Generative Fingerprints for Diffusion-Based Inpainting Localization
Paschalis Giakoumoglou, Symeon Papadopoulos · 2026
Read DiffusionPrint: Learning Generative Fingerprints for Diffusion-Based Inpainting Localization by Paschalis Giakoumoglou, Symeon Papadopoulos (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-12443.txt.
Introduction
Paschalis Giakoumoglou and Symeon Papadopoulos hunt fake edits made by diffusion inpainting tools. Inpainting rebuilds a whole image, wiping camera noise clues that forensics use. Their DiffusionPrint method learns a fingerprint shared by edits from the same tool. A contrastive setup trains that print to survive decoding damage. Added to three prior forensic tools, it sharpens edit maps a lot. Gains reach up to 28 percent on mask types unseen in fine-tuning.
Catalog record
| CREATOR | Paschalis Giakoumoglou, Symeon Papadopoulos |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40723 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.12443
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
DiffusionPrint: Learning Generative Fingerprints for Diffusion-Based Inpainting Localization Paschalis Giakoumoglou, Symeon Papadopoulos Abstract Modern diffusion-based inpainting models pose significant challenges for image forgery localization (IFL), as their full regeneration pipelines reconstruct the entire image via a latent decoder, disrupting the camera-level noise patterns that existing forensic methods rely on. We propose DiffusionPrint, a patch-level contrastive learning framework that learns a forensic signal robust to the spectral distortions introduced by latent decoding. It exploits the fact that inpainted regions generated by the same model share a consistent generative fingerprint, using this as a self-supervisory signal. DiffusionPrint trains a convolutional backbone via a MoCo-style objective with cross-category hard negative mining and a generator-aware classification head, producing a forensic feature map that serves as a highly discriminative secondary modality in fusion-based IFL frameworks. Integrated into TruFor, MMFusion, and a lightweight fusion baseline, DiffusionPrint consistently improves localization across multiple generative models, with gains of up to +28% on mask types unseen during fine-tuning and confirmed generalization to unseen generative architectures. Code is available at https://github.com/mever-team/diffusionprint 1 Introduction Figure 1 : Positive pair construction for the two image categories in our contrastive framework. An image generated by a generator g_{i} is inpainted using the corresponding inpainting variant of g_{i} . Natural images are also inpainted. For generated images, we extract the inpainted patches and pair them as positives with patches from the exact same spatial position in the source image. For natural images, positive pairs are formed by sampling patches outside the inpainting mask in both the source and the inpainted image. Digital image manipulation has undergone a fundamental shift with the rise of generative AI. While convincing forgeries once required expertise in tools like Adobe Photoshop or specialized deepfake pipelines, modern text-guided inpainting models such as Stable Diffusion 46 , FLUX 5 , and Adobe Firefly 1 allow non-experts to produce photorealistic edits through simple textual prompts. The resulting images are increasingly indistinguishable from authentic content 6 , posing serious risks for disinformation, fraud, and the fabrication of visual evidence 49 . Among the manipulation strategies enabled by these models, text-guided inpainting is particularly challenging for forensic analysis. In traditional splicing workflows, only the pixels within the manipulated region are replaced, leaving the rest of the image untouched and preserving low-level forensic traces such as sensor noise. However, modern latent diffusion-based inpainting operates in a fully-regenerative manner: generation and blending occur entirely within a compressed latent space 2 ; 27 , and the final output is produced by decoding the entire latent representation through a Variational Autoencoder (VAE) decoder. As a result, all pixels are globally reconstructed, even in regions outside the inpainting mask that remain semantically unchanged. This process destroys and renders ineffective the localized forensic traces that traditional image forgery localization (IFL) methods depend on 39 ; 21 . Existing forensic methods are designed around the splicing threat model. A dominant family of approaches suppresses image content to reveal low-level acquisition artifacts, treating discontinuities in these signals as evidence of manipulation 13 ; 36 ; 23 . These signals are reliable when authentic regions preserve their original noise statistics, but the global latent reconstruction induces a pervasive spectral shift across all pixels 40 , eliminating the distributional contrast these methods depend on. We argue that fully-regenerative inpainting leaves a qualitatively different forensic trace that existing pipelines are not designed to capture. An effective forensic signal must be invariant to the global spectral shift imposed by latent reconstruction, while remaining sensitive to whether a region is authentic or generated. To achieve this, we propose DiffusionPrint , a patch-level contrastive learning framework that learns a generative fingerprint suited to this setting. To achieve this, we design a contrastive pairing strategy, illustrated in Figure 1 , with two complementary components: (a) for authentic patches, we pair the original content with its latent-reconstructed counterpart, explicitly teaching the encoder to suppress VAE reconstruction artifacts and become invariant to the global spectral shift; (b) for generated patches, we start from a fully AI-generated image, perform inpainting, and pair the newly inpainted patch with its pre-inpainting counterpart at the same spatial location. Since both views originate from the same latent diffusion model, they share the same underlying generative fingerprint 52 , providing the diverse views necessary for robust contrastive learning 9 . DiffusionPrint trains a convolutional backbone via a MoCo 24 style objective with cross-category hard negative mining and a generator-aware classification head, serving as a drop-in replacement for noise-based modalities in fusion-based IFL frameworks. We evaluate on the TGIF 39 benchmark across SD 2.1, SDXL, and Flux variants, integrated into three fusion-based IFL frameworks. Our contributions are as follows: • We propose DiffusionPrint, a patch-level contrastive learning framework with asymmetric positive pair construction and a generator-aware classification head, designed to learn a forensic signal that is invariant to latent reconstruction artifacts on authentic regions while capturing the generative fingerprint of inpainted content. • We introduce a MoCo-style training procedure with a cross-category hard negative queue and top- k mining, enabling effective contrastive learning across generative model fingerprints. • We evaluate DiffusionPrint integrated into three fusion-based IFL frameworks on the TGIF benchmark, demonstrating consistent improvements of up to +28% over Noiseprint++ as a forensic signal, with generalization to unseen generative architectures confirmed. 2 Related Work 2.1 Generative Inpainting Text-guided inpainting has advanced rapidly through diffusion and flow-based architectures 46 ; 43 ; 5 , with methods ranging from training-free latent blending 2 , to fine-tuned inpainting models 41 ; 43 ; 50 , to adapter-based approaches 27 ; 37 ; 66 . In all cases, the generation process operates entirely in latent space and the final image is obtained by decoding the full latent representation through a VAE decoder, including regions outside the inpainting mask. This global latent reconstruction modifies all pixels, destroying the noise statistics that IFL methods rely on 39 ; 21 and inducing a pervasive spectral shift that detectors tend to exploit as a shortcut rather than identifying locally synthesized content 40 . Some pipelines apply post-hoc blending to embed the generated region back onto the original image 27 ; 66 ; 58 ; 37 , producing effectively spliced outputs where existing IFL methods remain applicable 21 ; 39 ; our work targets the harder fully-regenerative setting. Several datasets support forensic research on text-guided inpainting 23 ; 26 ; 57 ; 47 ; 51 , yet few address the fully-regenerative setting 21 ; 39 ; 38 , and prior work has shown that existing localization models fail on such images without retraining 21 ; 38 . 2.2 Forgery Localization and Forensic Fusion Early IFL approaches relied on handcrafted signal processing to detect manipulation artifacts, including structural inconsistencies 54 ; 8 ; 31 ; 59 , acquisition traces such as sensor noise and CFA patterns 17 ; 10 ; 35 ; 63 , and statistical artifacts from processing and compression 12 ; 4 ; 16 ; 25 ; 42 . Recent deep learning methods, both CNN-based 55 ; 32 ; 44 ; 62 ; 15 ; 53 and transformer-based 30 ; 34 ; 23 ; 48 , have substantially advanced the state of the art across splicing, copy-move, and conventional inpainting. Another line of work combines multiple