StableGuard: Towards Unified Copyright Protection and Tamper Localization in Latent Diffusion Models

Haoxin Yang, Bangzhen Liu, Xuemiao Xu, Cheng Xu, Yuyang Yu, Zikai Huang, Yi Wang, Shengfeng He, Homepage: https://github.com/Harxis/StableGuard · 2025

Read StableGuard: Towards Unified Copyright Protection and Tamper Localization in Latent Diffusion Models by Haoxin Yang, Bangzhen Liu, Xuemiao Xu, Cheng Xu, Yuyang Yu, Zikai Huang, Yi Wang, Shengfeng He, Homepage: https://github.com/Harxis/StableGuard (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-17993.txt.

Introduction

Haoxin Yang and 7 co-authors bake a copyright mark into AI image making, so fakes can be traced. Their 2025 frame, StableGuard, works with latent diffusion models, which build images from a compact code. Past marks were added after the fact, which hurts trust in checks.

A tweaked auto-encoder makes paired marked and clean images in one pass. Masked blends of the pairs train a checker net that needs no tag of how an image was faked. That net mixes mark cues, local fake traces, and tone cues. Both parts train as one, in a self-taught way.

Catalog record

CREATORHaoxin Yang, Bangzhen Liu, Xuemiao Xu, Cheng Xu, Yuyang Yu, Zikai Huang, Yi Wang, Shengfeng He, Homepage: https://github.com/Harxis/StableGuard
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-17993

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

StableGuard: Towards Unified Copyright Protection and Tamper Localization in Latent Diffusion Models Haoxin Yang, Bangzhen Liu, Xuemiao Xu, Cheng Xu, Yuyang Yu, Zikai Huang, Yi Wang, Shengfeng He, Homepage: https://github.com/Harxis/StableGuard Abstract The advancement of diffusion models has enhanced the realism of AI-generated content but also raised concerns about misuse, necessitating robust copyright protection and tampering localization. Although recent methods have made progress toward unified solutions, their reliance on post hoc processing introduces considerable application inconvenience and compromises forensic reliability. We propose StableGuard, a novel framework that seamlessly integrates a binary watermark into the diffusion generation process, ensuring copyright protection and tampering localization in Latent Diffusion Models through an end-to-end design. We develop a Multiplexing Watermark VAE (MPW-VAE) by equipping a pretrained Variational Autoencoder (VAE) with a lightweight latent residual-based adapter, enabling the generation of paired watermarked and watermark-free images. These pairs, fused via random masks, create a diverse dataset for training a tampering-agnostic forensic network. To further enhance forensic synergy, we introduce a Mixture-of-Experts Guided Forensic Network (MoE-GFN) that dynamically integrates holistic watermark patterns, local tampering traces, and frequency-domain cues for precise watermark verification and tampered region detection. The MPW-VAE and MoE-GFN are jointly optimized in a self-supervised, end-to-end manner, fostering a reciprocal training between watermark embedding and forensic accuracy. Extensive experiments demonstrate that StableGuard consistently outperforms state-of-the-art methods in image fidelity, watermark verification, and tampering localization. 1 Introduction The unprecedented capabilities of latent diffusion models (LDMs) have revolutionized image synthesis, redefining artistic creation and visual content production [ 1 , 2 , 3 , 4 , 5 , 6 ] . However, as these models become more accessible, concerns over unauthorized use and malicious content tampering have intensified, necessitating solutions to safeguard intellectual property and ensure content authenticity. Traditional copyright protection relies on watermarking techniques [ 7 , 8 , 9 ] , which embed identifiable information into images through post-hoc processing. While effective in some cases, these methods introduce computational overhead and image degradation due to their detachment from the generative process. Recent approaches to diffusion-native watermarking integrate embedding mechanisms directly within the generation pipeline [ 10 , 11 , 12 , 13 , 14 ] , but they fail to support advanced forensic needs such as quantifying tampering severity or precisely localizing manipulations [ 15 , 16 , 17 , 18 , 19 , 20 ] . Although recent works have attempted to unify copyright protection and tampering localization in a single framework [ 21 , 22 , 23 ] , they remain inherently post-hoc, with generation and forensics optimized independently. This decoupled optimization prevents mutual enhancement between the two tasks, thereby limiting both the overall forensic robustness and practical applicability. The absence of a seamless framework that integrates these functionalities in an LDM-native manner remains a major gap, hindering real-world deployment in security-sensitive applications. Figure 1: (a) Unlike other post-hoc methods that add external watermarking, introducing overhead and detaching from the generative process. (b) StableGuard embeds a holistic binary watermark directly into the diffusion pipeline and adaptively extracts intrinsic perturbation patterns via collaborative forensic experts, enabling unified, precise, and seamless protection within LDMs. To bridge the gap between copyright protection and content forensics in LDMs, we propose StableGuard , a unified framework that integrates holistic watermark directly into the generative process. Our core insight is twofold: (i) holistically distributed watermarks exhibit inherent robustness against localized manipulations due to spatial redundancy, and (ii) the subtle perturbations introduced by these watermarks can serve as reliable cues for tampering localization through missing feature detection. These complementary properties make holistic watermarking a compelling foundation for jointly addressing ownership verification and fine-grained forensic analysis in a unified LDM-native manner. StableGuard achieves this integration through two key components: the Multiplexing Watermark Variational Autoencoder (MPW-VAE) for embedding watermarks during generation, and the Mixture-of-Experts Guided Forensic Network (MoE-GFN) for tamper-agnostic forensic analysis. MPW-VAE extends the standard LDM architecture by incorporating a trainable watermark adapter within the VAE decoder and employs a multiplexing strategy to generate both visually indistinguishable watermarked and watermark-free images, facilitating self-supervised training without manual annotations. MoE-GFN performs watermark extraction and tampering localization via a Mixture-of-Forensic-Experts (MoFE) block comprising three specialized experts: a Watermark Extraction Expert , a Tampering Localization Expert , and a Boundary Enhancement Expert . These experts are dynamically fused by a Dynamic Soft Router , allowing for precise and holistic forensic predictions. The MPW-VAE and MoE-GFN are trained jointly in an end-to-end manner, enabling mutual reinforcement between watermark embedding and forensic performance. Extensive experiments across multiple benchmarks demonstrate that StableGuard outperforms existing methods in both watermark retrieval and tampering localization, validating its effectiveness for real-world security-sensitive applications. In summary, our main contributions are as follows: • We introduce StableGuard, a unified proactive forensics framework for LDMs, seamlessly integrating copyright protection and tampering localization into LDM-based image generation. • We propose a simple yet effective self-supervised forensic learning framework that embeds an imperceptible, holistic bit watermark via a multiplexing watermark VAE. This enables precise copyright protection and tampering localization without requiring labeled data. • We develop a tampering-agnostic mixture-of-experts forensic network that synergistically integrates holistic, subtle, and boundary features to extract forensic cues, ensuring robust watermark retrieval and precise tampering localization across various attack scenarios. • Extensive experiments demonstrate that StableGuard outperforms state-of-the-art methods in both forensic accuracy and robustness while preserving the visual fidelity of generated images. 2 Related Work 2.1 Image Watermark Image watermarking has long served as a foundational technique for intellectual property protection [ 24 , 25 , 26 , 27 , 28 ] . Traditional approaches typically rely on encoder and decoder architectures [ 8 , 7 ] , flow-based models [ 29 , 21 ] , or per-image encoding strategies [ 30 , 7 ] . These methods are often implemented as separate steganographic modules applied after image generation, introducing additional processing overhead and potential degradation in visual quality. In parallel, diffusion models, particularly latent diffusion models (LDMs), have recently achieved remarkable progress across diverse domains [ 1 , 2 , 31 , 32 , 33 , 34 , 35 ] . Motivated by this success, recent studies have explored embedding watermarks directly into the generative process [ 36 , 14 , 10 , 11 , 12 ] . For example, Tree-Ring [ 36 ] modifies the initial noise vector, CRoSS [ 14 ] employs image-to-image steganography, and methods such as Stable Signature [ 10 ] , WOUAF [ 11 ] , and WaDiff [ 12 ] fine-tune LDMs to embed watermarks in latent space. While these LDM-native approaches improve integration and visual fidelity, they generally neglect tampering localization—a key aspect for assessing manipulation severity and enabling forensic content reuse. Our work introduces a unified framework that jointly addresses copyright protection and tampering localization in LDMs, leveraging mutual optimization between watermark and forensic analysis to deliver robust, high-fidelity image forensics. 2.2 Tampering Localization Tampering localization aims to detect and localize manipulated regions, crucial for verifying image authenticity and quantifying alterations [ 15 , 16 , 17 , 18 , 19 , 21 , 37 , 20 , 38 ] . Existing methods fall into two broad categories: passive detection and proactive defense. Passive methods rely solely on visual artifacts. For instance, MVSSNet [

Read the complete text