SemBind: Binding Diffusion Watermarks to Semantics Against Black-Box Forgery Attacks

Xin Zhang, Zijin Yang, Kejiang Chen, Linfeng Ma, Weiming Zhang, Nenghai Yu · 2026

Read SemBind: Binding Diffusion Watermarks to Semantics Against Black-Box Forgery Attacks by Xin Zhang, Zijin Yang, Kejiang Chen, Linfeng Ma, Weiming Zhang, Nenghai Yu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20310.txt.

Introduction

Xin Zhang and five colleagues present SemBind, a defense for watermarks placed inside AI-generated images. Latent watermarks are built into the generation process of diffusion models, which makes detection and attribution easy. But black-box forgery attacks can lift a provider's watermark from one real image and stamp it onto images the provider never made.

That forgery breaks trust in provenance, since a watermark would no longer prove origin. SemBind binds the watermark to the meaning of the image itself, so copying it onto other content fails. The work matters as platforms rely on watermarks to sort real media from fake.

Catalog record

CREATORXin Zhang, Zijin Yang, Kejiang Chen, Linfeng Ma, Weiming Zhang, Nenghai Yu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE92 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-20310

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SemBind: Binding Diffusion Watermarks to Semantics Against Black-Box Forgery Attacks Xin Zhang, Zijin Yang, Kejiang Chen, Linfeng Ma, Weiming Zhang, Nenghai Yu Abstract Latent-based watermarks, integrated into the generation process of latent diffusion models (LDMs), simplify detection and attribution of generated images. However, recent black-box forgery attacks, where an attacker needs at least one watermarked image and black-box access to the provider’s model, can embed the provider’s watermark into images not produced by the provider, posing outsized risk to provenance and trust. We propose SemBind, the first defense framework for latent-based watermarks that resists black-box forgery by binding latent signals to image semantics via a learned semantic masker. Trained with contrastive learning, the masker yields near-invariant codes for the same prompt and near-orthogonal codes across prompts; these codes are reshaped and permuted to modulate the target latent before any standard latent-based watermark. SemBind is generally compatible with existing latent-based watermarking schemes and keeps image quality essentially unchanged, while a simple mask-ratio parameter offers a tunable trade-off between anti-forgery strength and robustness. Across four mainstream latent-based watermark methods, our SemBind-enabled anti-forgery variants markedly reduce false acceptance under black-box forgery while providing a controllable robustness–security balance. † † affiliationnotice: Equal contribution 1 Introduction Latent diffusion models (LDMs) ( 15 ; 29 ; 30 ) now generate images that are virtually indistinguishable from real photographs, enabling a wide range of creative and assistive applications. At the same time, such realism raises acute concerns about misleading content and deepfakes ( 8 ; 11 ) , which can be used to deceive individuals, sway public opinion, and facilitate fraud. Figure 1 : Black-box forgery attack and SemBind overview. Latent-based watermarking embeds a pattern in the initial latent noise, which a black-box attacker can transfer to forged images from at least one watermarked example. SemBind additionally binds the latent watermark to a semantic bitstring, causing verification to fail when the forged semantics deviate from the original. Watermarking aims to mitigate these risks by embedding information into generated images for later copyright authentication and provenance tracking. It is already being piloted by governments ( 3 ; 1 ) and major AI providers ( 2 ; 5 ) as a key mechanism for responsible deployment. Watermarking for diffusion models falls into three broad categories. Post-processing methods ( 6 ; 38 ) modify robust image features after generation, while fine-tuning methods ( 7 ; 9 ; 34 ; 40 ) amalgamate the watermark embedding process with the image generation process. Latent-based schemes ( 33 ; 36 ; 13 ; 37 ) instead encode a pattern in the initial noise and recover it by inverting the denoising process. This design keeps the diffusion model unchanged, is typically more robust to image transformations, and, more importantly, has provable undetectability ( 4 ) . In particular, undetectability implies that the watermarked outputs are statistically indistinguishable from non-watermarked ones, and thus the watermark does not introduce a systematic degradation in generation quality. However, latent-based watermarks are highly susceptible to black-box forgery attacks ( 23 ; 17 ) . As illustrated in Figure 1 , an attacker with only black-box access and at least one single watermarked image can transfer the watermark to large volumes of illicit content, undermining both watermark owners and AI service providers. Within this latent-based paradigm, there is no effective defense against black-box forgery. Naïve countermeasures such as tightening detection thresholds ( 23 ) are largely ineffective: since the watermark lives purely in the initial latent, both natural perturbations and forgery operations only manifest as modifications to this latent, making them hard to distinguish at verification time. As robustness is improved to tolerate more natural perturbations, the scheme simultaneously becomes more tolerant to forged latents and thus less resistant to black-box forgery. A key motivation of this work is to strengthen latent-based watermarks against black-box forgery without sacrificing their key advantage: for schemes that admit provable undetectability, we preserve the same guarantee under the same setting. In this work, we propose SemBind , the first defense framework for latent-based watermarks that resists black-box forgery by binding latent watermark signals to image semantics via a learned semantic masker. The masker is trained contrastively to produce near-invariant codes for images from the same prompt and near-orthogonal codes across prompts. During watermarking, SemBind generates an auxiliary clean image for the target prompt, extracts a semantic code, expands and permutes it under a secret key, and uses the resulting mask to multiplicatively modulate the watermarked latent produced by any standard scheme. This design preserves image quality, while a single mask-ratio parameter controls the trade-off between anti-forgery strength and robustness to natural distortions. We validate SemBind on four representative latent-based schemes—Tree-Ring ( 33 ) , Gaussian Shading ( 36 ) , PRC ( 13 ) , and Gaussian Shading++ ( 37 ) , by instantiating SemBind-enabled variants for each. Our evaluation covers robustness to common perturbations, resistance to imprinting and reprompting attacks, and image quality and semantic alignment measured by FID ( 14 ) and CLIP scores ( 25 ) . Across all four schemes, SemBind substantially reduces false acceptance under black-box forgery while preserving watermark robustness and keeping FID and CLIP essentially unchanged, yielding a controllable robustness–security trade-off via the mask ratio. Moreover, for base schemes that admit provable undetectability, we theoretically prove that SemBind preserves the same undetectability guarantee under the same setting. In summary, we make the following contributions: • We propose SemBind, the first defense for latent-based diffusion watermarks against black-box forgery. By learning a semantic masker via contrastive learning and introducing a mask-ratio parameter, SemBind binds latent signals to image semantics, providing strong resistance to forgery while enabling a controllable trade-off with watermark robustness. • We instantiate SemBind on four representative latent-based schemes. For schemes that admit provable undetectability, We theoretically prove that the SemBind-enabled variants preserve the same undetectability guarantee under the same setting, and empirically confirm that FID and CLIP remain on par with the original baselines. • We evaluate SemBind under common perturbations and two canonical black-box forgery strategies (imprinting and reprompting), showing substantially reduced false acceptance while preserving robustness and enabling a tunable robustness–security trade-off. 2 Related Work 2.1 Diffusion Models and Inverse DDIM Diffusion models synthesize images by iteratively denoising a latent variable that is initially drawn from a Gaussian prior. In latent diffusion models (LDMs) ( 26 ) , the diffusion process operates in a latent space \mathcal{Z} . An encoder \mathcal{E} maps an image x\in\mathbb{R}^{H\times W\times 3} to its latent representation z_{0}=\mathcal{E}(x)\in\mathbb{R}^{h\times w\times c} , and a decoder \mathcal{D} reconstructs the image as x=\mathcal{D}(z_{0}) . A pretrained LDM therefore consists of the tuple \Theta=(\mathcal{E},u,\mathcal{D}) , where u denotes the noise-prediction network (UNet). Starting from an initial latent z_{T}\sim\mathcal{N}(0,I) , DDIM sampling ( 15 ) runs a deterministic denoising trajectory: at each step t it uses the trained noise predictor u(z_{t},t,C) and the noise schedule \{\alpha_{t}\} to update z_{t} until reaching a clean latent z_{0} . We denote the full forward denoising process that maps z_{T} to z_{0} by z_{0}=\mathcal{G}_{T\to 0}(z_{T};u) . Conversely, inverse DDIM ( 22 ) approximately retraces this trajectory in reverse: given an image latent z_{0} , it iteratively adds noise using the same predictor u and schedules to obtain an

Read the complete text