Towards Robust Content Watermarking Against Removal and Forgery Attacks
Yifan Zhu, Yihan Wang, Xiao-Shan Gao · 2026
Read Towards Robust Content Watermarking Against Removal and Forgery Attacks by Yifan Zhu, Yihan Wang, Xiao-Shan Gao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-06662.txt.
Introduction
Zhu, Wang, and Gao harden image watermarks against removal and forgery attacks. Text-to-image diffusion watermarks already detect well, but adversaries can strip them or fake them. Their ISTS paradigm, instance-specific watermarking with two-sided detection, times injections and picks patterns from each user's prompt meaning. A new two-sided detector then strengthens detection robustness, and experiments show the design beats rival watermarks under both attack types.
Catalog record
| CREATOR | Yifan Zhu, Yihan Wang, Xiao-Shan Gao |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50700 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.06662
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Robust Content Watermarking Against Removal and Forgery Attacks Thanks: Academy of Mathematics and Systems Science, Chinese Academy of Sciences and University of Chinese Academy of Sciences. Yifan Zhu, Yihan Wang, Xiao-Shan Gao Abstract Generated contents have raised serious concerns about copyright protection, image provenance, and credit attribution. A potential solution for these problems is watermarking. Recently, content watermarking for text-to-image diffusion models has been studied extensively for its effective detection utility and robustness. However, these watermarking techniques are vulnerable to potential adversarial attacks, such as removal attacks and forgery attacks. In this paper, we build a novel watermarking paradigm called Instance-Specific watermarking with Two-Sided detection ( ISTS ) to resist removal and forgery attacks. Specifically, we introduce a strategy that dynamically controls the injection time and watermarking patterns based on the semantics of users’ prompts. Furthermore, we propose a new two-sided detection approach to enhance robustness in watermark detection. Experiments have demonstrated the superiority of our watermarking against removal and forgery attacks. 1 Introduction Diffusion models have become the dominant class of generative models for visual tasks, powering many popular text-to-image and text-to-video systems such as Stable Diffusion ( Rombach et al. 2021 ) , DALL-E ( Ramesh et al. 2021 ) , Midjourney, and Sora ( Liu et al. 2024b ) . Content produced by these models has become widespread across social media and even traditional publications ( Liu 2022 ) . Notably, a synthetically generated image has even won a world photography award ( Glynn 2023 ) . The photorealistic quality of such generated media has raised serious concerns about intellectual property protection, including issues of image provenance, authorship, and credit attribution. Watermarking has emerged as a promising solution for verifying whether an image originates from a specific diffusion model ( Wen et al. 2023 ; Yang et al. 2024b ; Gunn et al. 2024 ) . In this approach, identity markers are embedded into the generated outputs during the synthesis process without degrading their semantics or perceptual quality. During detection, model providers can confirm the provenance of an image by detecting or recovering these markers. Researches on watermarking for diffusion models have grown rapidly in recent years, with many works focusing on improving detection accuracy, image fidelity, and robustness against natural variations such as transformations, noise, or compression ( Zhang et al. 2024a ; Ci et al. 2025 ; Wang et al. 2025 ) . However, since ownership and credit for generated content can carry reputational and even financial implications, malicious adversaries have strong incentives to circumvent watermarking mechanisms. Such attackers may attempt to remove identity markers from watermarked images or to forge watermarked images from unmarked ones. These attacks often exploit gradients propagated through the diffusion process and the statistical properties of large sets of watermarked samples, achieving high success rates in watermark removal and forgery ( Müller et al. 2024 ; Yang et al. 2024a ; Jain et al. 2025 ; Kassis and Hengartner 2025 ) . Such vulnerability presents severe challenges to the reliability of current watermarking methods. To address these challenges, we propose Instance-Specific watermarking with Two-Sided detection ( ISTS ), which achieves enhanced resilience against forgery and removal attacks while maintaining comparable utility in non-adversarial settings. Our key insight is that, despite existing attacks being frequently characterized by black-box access, in which the adversary does not know the underlying generative model or watermarking approach, the prevailing use of static, single-type watermarking methods effectively grants the attacker additional prior knowledge. For instance, the well-known Tree-Ring watermarking ( Wen et al. 2023 ) injects a fixed ring pattern into the Fourier space of latent noises for all prompts. This unintended leakage allows adversaries to more easily infer the watermark’s structural characteristics, facilitating its removal or the creation of forged watermarks. To mitigate this vulnerability, we propose a strategy that customizes both the watermark pattern and the injection time for each generation. Concretely, given a prompt, we first generate a non-watermarked image and encode it into a semantic feature vector using the CLIP encoder. We then determine the watermarking parameters, such as the pattern position and the injection time step, based on this semantic vector through a pretrained semantic-based selector. Finally, using the selected parameters, we generate the corresponding watermarked image from the same prompt. For detection, we first encode the suspicious image into its semantic feature vector, retrieve the corresponding watermarking parameters, and then compare the target region with the predefined watermark pattern. Since watermark injection minimally affects image semantics, the semantic features of watermarked and non-watermarked images remain closely aligned, ensuring that the recovered parameters are consistent with those used during the watermark injection process. In addition, we observe that the commonly adopted one-sided detection introduces a critical vulnerability to removal attacks. To address this issue, we propose a two-sided detection scheme that captures opposite latent representations, effectively strengthening robustness against such attacks while preserving the watermark’s utility. We conduct experiments on various content watermarking with our ISTS against three representative removal attacks and three forgery attacks. Evaluation results demonstrate the superior performance of our proposed ISTS, achieving state-of-the-art detection AUC and TPR@1%FPR across removal and forgery attacks in both average and worst-case scenarios. Figure 1 : Overview of our ISTS method. The top row shows the original Tree-Ring watermarking. To generate watermarked images, it injects tree-ring patterns in the center of the frequency domain at the initial noisy space. Such a static scheme leaks information about the watermark pattern and thus exposes high vulnerability to removal and forgery attacks. The bottom row shows our dynamic approach. For each generation, we first generate a non-watermarked image and decide time and location parameters (t,l) using a semantic-based selector . Then, we execute the first T-t steps of DDIM, inject watermarks at coordinate l in the frequency domain, and continue the rest of DDIM generation. During detection, we retrieve the parameters from a suspicious image and extract the watermarking area, followed by two-sided detection . In adversarial settings, an attacker unaware of time and location parameters fails to extract the ground-truth watermark patterns from reference images. Thus, the proposed approach achieves enhanced robustness against removal and forgery attacks. 2 Related Works Watermarking. Watermarking on generative models has been widely studied in recent years. In text-to-image generative models, a representative watermarking method called Tree-Ring ( Wen et al. 2023 ) injects a specific ring pattern into the Fourier space of the latent representation, achieving higher robustness compared with traditional image watermarking methods ( Cox et al. 2002 ; Zhang et al. 2019 ; Tancik et al. 2020 ) . Followed up with many content watermarking methods, such as ZoDiac ( Zhang et al. 2024a ) , RingID ( Ci et al. 2025 ) , ROBIN ( Huang et al. 2024 ) , Gaussian-Shading ( Yang et al. 2024b ) , and Shallow Diffuser ( Li et al. 2024 ) . More works ( Guo et al. 2024 ; Yang et al. 2025 ; Arabi et al. 2025a ; Wang et al. 2025 ; Pautov et al. 2025 ) have been proposed to further enhance content watermarking in diffusion models. Other works try to inject watermarking into text-to-image generative models by finetuning the model ( Zhao