TAG-WM: Tamper-Aware Generative Image Watermarking via Diffusion Inversion Sensitivity

Yuzhuo Chen, Zehua Ma, Han Fang, Weiming Zhang, Nenghai Yu · 2025

Read TAG-WM: Tamper-Aware Generative Image Watermarking via Diffusion Inversion Sensitivity by Yuzhuo Chen, Zehua Ma, Han Fang, Weiming Zhang, Nenghai Yu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-23484.txt.

Introduction

Yuzhuo Chen and co-authors present a watermarking method for AI-generated images that can also locate tampering, published in 2025. Generated images raise risks for copyright and authenticity. Watermarks can verify source and integrity, but new editing tools make malicious tampering easier and detection harder at the same time.

Their method, TAG-WM, has four parts. A joint sampling step embeds both a copyright mark and a localization mark in the latent space, keeping image quality. A reconstruction step reverses that process to read the marks back. A detector uses sensitivity to diffusion inversion to find altered regions from statistical shifts. A final decoder is guided by those regions. Tests show strong robustness and localization, even under distortion, with no loss in generation quality.

Catalog record

CREATORYuzhuo Chen, Zehua Ma, Han Fang, Weiming Zhang, Nenghai Yu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-23484

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

TAG-WM: Tamper-Aware Generative Image Watermarking via Diffusion Inversion Sensitivity Yuzhuo Chen, Zehua Ma, Han Fang, Weiming Zhang, Nenghai Yu Abstract AI-generated content (AIGC) enables efficient visual creation but raises copyright and authenticity risks. As a common technique for integrity verification and source tracing, digital image watermarking is regarded as a potential solution to above issues. Among these, watermarking methods capable of preserving the generation quality are receiving increased attention. However, the proliferation and high performance of generative image editing applications have elevated the risks of malicious tampering, creating new demands. 1) The tamper robustness of current lossless visual quality watermarks remains constrained by the modification-sensitive diffusion inversion process, necessitating enhanced robustness. 2) The improved tampering quality and rapid iteration cycles render passive tampering detection methods inadequate, making proactive tampering localization capability a desired feature for watermarks. To address these requirements, this paper proposes a T amper- A ware G enerative image W ater M arking method named TAG-WM. The proposed method comprises four key modules: a dual-mark joint sampling (DMJS) algorithm for embedding copyright and localization watermarks into the latent space while preserving generative quality, the watermark latent reconstruction (WLR) utilizing reversed DMJS, a dense variation region detector (DVRD) leveraging diffusion inversion sensitivity to identify tampered areas via statistical deviation analysis, and the tamper-aware decoding (TAD) guided by localization results. The experimental results indicate that TAG-WM achieves SOTA tampering robustness and tampering localization capability with distortions while maintaining lossless generation quality and a considerable capacity of 256 bits. 1 Introduction The rise of AI-generated content (AIGC) has garnered significant attention across various fields, creating substantial commercial value. Particularly in visual content generation, the advent of diffusion models [ 3 , 5 , 22 ] has sparked the emergence of numerous image generation and manipulation applications [ 30 ] , enabling individuals across industries to easily and efficiently perform customized generation or editing of images with high quality. However, this technological accessibility inevitably leads to uncertainties in the provenance and authenticity of images in the AIGC era, resulting in copyright risks and disinformation threats. For instance, users might use free image generators to create similar graphics to copyrighted work and falsely claim ownership. Furthermore, malicious actors could create lifelike images to spread false information about non-existent events. As a common technique for integrity verification and source tracing, digital image watermarking has gained increasing prominence in AIGC. Existing image watermarking methods were primarily designed by traditional image processing algorithms [ 15 , 1 ] or deep neural networks [ 14 , 9 ] , both of which embed robust watermarks through post-processing cover images. However, such post-processing embedding approaches inevitably introduce visual artifacts. Considering that the quality of generated images is the goal pursued by image generation models at a high computational cost, such watermarking methods contradict the application scenarios of generative models. With the rise of diffusion models, new watermarking paradigms have emerged to protect AI-generated content. Recent advancements focus on model fine-tuning [ 7 , 10 , 27 ] and latent space-based watermarks [ 24 ] , watermarking directly during the generative process itself. Such watermarking methods embedded in the generative process can better integrate watermark information with image content while significantly reducing the impact of watermark embedding on the visual quality of generated images. The Gaussian Shading (GS) proposed by Yang et al. [ 28 ] takes a significant step forward, achieving provably visual quality lossless watermarking for generated images. By employing distribution-preserving sampling to map watermarks into latent space representations, GS ensures the watermarked latent becomes statistically indistinguishable from the original one, thereby maintaining the visual quality equivalent to the original generative images. Meanwhile, the emergence of generative models like ControlNet [ 30 ] , which enable high-quality image modifications, has made malicious tampering an increasingly critical issue, imposing stricter requirements for watermark robustness and tamper localization capabilities. Unlike common image distortions, malicious alterations fundamentally alter pixel values. Unfortunately, the DDIM inversion process demonstrates sensitivity to pixel modifications (Sec. 3.2 ), rendering inversion-based generative watermarking methods like GS less robust against image manipulation distortions (e.g., cropping, tampering). On the other hand, as generative model-based image manipulations become increasingly indistinguishable, applying watermarks to achieve more generalizable proactive tamper localization has emerged as a novel and practical demand in watermark functionality. For instance, MaLP [ 2 ] achieves tamper detection and pixel-level localization through learned template embedding. EditGuard [ 33 ] simultaneously embeds both identification watermarks and tampering localization watermarks into images, decoding them in parallel to accomplish dual objectives of copyright verification and tamper localization. To address the aforementioned challenges while introducing tamper localization capabilities, we propose a tamper-aware generative image watermarking named TAG-WM. This framework leverages the sensitivity of DDIM inversion to pixel modifications to design tamper localization strategies, and further employs the localization results as confidence guidance for watermark decoding, thereby enhancing the accuracy of watermark extraction under tampering distortions. The main contributions of this paper are as follows: • We propose a dual-mark joint sampling algorithm to simultaneously embed copyright watermark and localization watermark into the latent space of diffusion models. This strategy preserves standard normal distributions of latent representation, ensuring lossless visual quality while introducing tampering localization capability. • We develop a dense variation region detector for tampering localization, leveraging the sensitivity of diffusion inversion to image modifications. By analyzing statistical deviations between original/reconstructed localization watermarks, the proposed detection method demonstrates strong generalization capability. • We introduce tamper-aware message decoding guided by tampering localization results, which improves the robustness of such generated image watermarking methods against image modifications. 2 Related Works Diffusion-based Image Generation The explosive growth of diffusion models has revolutionized image synthesis, with frameworks like DDPM [ 13 ] enabling high-fidelity generation, DDIM [ 23 ] enabling fast deterministic sampling via non-Markov processes, LDMs [ 22 ] compressing data into latent space for efficiency, text-guided models like Stable Diffusion and Imagen [ 3 ] leveraging large-scale pretraining for diverse generations, while ControlNet [ 30 ] facilitating controllable creation and manipulation. These advancements have made diffusion models the standard for generative tasks, yet their very success intensifies the urgency of addressing copyright risks in generated content. Watermarking for Generative Models While post-processing methods [ 36 , 34 , 26 ] suffer from capacity-quality trade-offs, Tree-Ring [ 24 ] proposed in-generation approaches for popular DMs, which bases on the non-Markov process and deterministic of DDIM inversion [ 23 ] . Gaussian Shading [ 28 ] uses it and achieves provable quality-lossless multi-bit watermarking. However, their reliance on noise patterns makes them vulnerable to image manipulations — a critical limitation given the prevalence of image editing tools. This motivates our tamper-aware watermarking that inherits in-generation advantages while resisting post-hoc manipulations. Tampering Localization Passive methods detect specific manipulation traces [ 25 ] or general artifacts [ 8 ] . As diffusion-based manipulation [ 20 , 30 ] increasingly produces undetectable forgeries, passive detectors face diminishing returns. Proactive solutions like EditGuard [ 33 ] bypass this through steganography but introduce generation-time overheads and image quality degradation, and struggle with out-of-distribution (OOD) samples (e.g. non-trained degraded samples). Our work bridges this gap by integrating localization watermarks directly into the diffusion pipeline. Figure 1 : The proposed TAG-WM framework. It

Read the complete text