SuperMark: Robust and Training-free Image Watermarking via Diffusion-based Super-Resolution

Runyi Hu, Jie Zhang, Yiming Li, Jiwei Li, Qing Guo, Han Qiu, and Tianwei Zhang · 2024

Read SuperMark: Robust and Training-free Image Watermarking via Diffusion-based Super-Resolution by Runyi Hu, Jie Zhang, Yiming Li, Jiwei Li, Qing Guo, Han Qiu, and Tianwei Zhang (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-10049.txt.

Introduction

Hu and co-authors propose SuperMark, a watermarking method for images that needs no training yet resists tampering. Watermarks protect ownership as AI images mix with real ones, but trained methods struggle to balance clarity and toughness. Their 2024 framework hides the mark inside random noise, then uses a pretrained upscaling diffusion model to turn that noise into the final image.

To read the mark, the image is run backward to the noisy start and the mark is recovered. The backward step's stability gives toughness, the team argues. Tests reached about 99.5 percent correct extraction under standard distortions and about 89 percent under adaptive attacks, with image quality matching rival methods. The scheme transfers across datasets, models, and sizes.

Catalog record

CREATORRunyi Hu, Jie Zhang, Yiming Li, Jiwei Li, Qing Guo, Han Qiu, and Tianwei Zhang
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-10049

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SuperMark: Robust and Training-free Image Watermarking via Diffusion-based Super-Resolution Runyi Hu, Jie Zhang, Yiming Li, Jiwei Li, Qing Guo, Han Qiu, and Tianwei Zhang Abstract In today’s digital landscape, the intermingling of AI-generated and authentic content has heightened the importance of copyright protection and content authentication. Watermarking has emerged as a crucial technology to address these challenges, offering a general approach to safeguard both generated and real content. To be effective, watermarking methods must withstand various distortions and attacks. While current deep watermarking techniques typically employ an encoder–noise layer–decoder architecture and incorporate various distortions to enhance robustness, they often struggle to balance robustness and fidelity, and remain vulnerable to adaptive attacks, despite extensive training. To overcome these limitations, we propose SuperMark, a novel robust and training-free watermarking framework. Our approach draws inspiration from the parallels between watermark embedding/extraction in watermarking models and the denoising/noising processes in diffusion models. Specifically, SuperMark embeds the watermark into initial Gaussian noise using existing techniques and then applies pretrained Super-Resolution (SR) models to denoise the watermarked noise, producing the final watermarked image. For extraction, the process is reversed: the watermarked image is converted back to the initial watermarked noise via DDIM Inversion, from which the embedded watermark is then extracted. This flexible framework supports various noise injection methods and diffusion-based SR models, allowing for enhanced performance customization. The inherent robustness of the DDIM Inversion process against various perturbations enables SuperMark to demonstrate strong resilience to many distortions while maintaining high fidelity. Extensive experiments demonstrate SuperMark’s effectiveness, achieving fidelity comparable to existing methods while significantly surpassing most in terms of robustness. Under normal distortions, SuperMark achieves an average watermark extraction bit accuracy of 99.46%, and 89.29% under adaptive attacks. Furthermore, SuperMark exhibits strong transferability across different datasets, SR models, watermark embedding methods, and resolutions. 1 Introduction With the rapid advancement of text-to-image (T2I) models ( Saharia et al., 2022 ; Rombach et al., 2022 ) and image-to-image (I2I) models ( Brooks et al., 2023 ; Mokady et al., 2023 ) , AI-generated content (AIGC) has been increasingly prevalent and harder to be distinguished from real images. To mitigate the challenges posed by this trend, various regulations ( European Parliament, 2023 ; PBS NewsHour, 2024 ; Reuters, 2024 ) have emerged that mandate the embedding of watermarks into AI-generated images. These watermarks serve as a proactive measure for ensuring transparency, traceability, and copyright verification. There are two emerging approaches for watermarking: embedding watermarks during the image generation process ( Fernandez et al., 2023 ; Wen et al., 2024 ; Yang et al., 2024 ) and applying watermarks to the generated images via post-processing ( Rahman, 2013 ; Zhang et al., 2019 ; Jia et al., 2021 ) . The latter approach is more flexible and general, as it can be applied to both AIGC and real images, which is the focus of this paper. Figure 1: (a) The pipeline of traditional watermarking methods, which are trained in an encoder-noise layer-decoder manner. (b) The pipeline of our proposed training-free SuperMark. Here, m represents for the watermark information. The performance of general watermarking is evaluated along two key dimensions: robustness and fidelity. Robustness refers to the watermark’s ability to remain detectable and intact even when subjected to various distortions or attacks on the watermarked image, while fidelity means the visual consistency between the watermarked image and the cover image. Deep learning-based watermarking methods typically adopt an encoder-noise layer-decoder framework, introducing various distortions during training to enhance robustness. However, achieving a balance between strong robustness and high fidelity remains a significant challenge for these models. Furthermore, adaptive attacks ( Zhao et al., 2023 ) based on VAE ( Ballé et al., 2018 ; Cheng et al., 2020 ) and diffusion models ( Brooks et al., 2023 ) can easily circumvent most existing watermarking methods. Although some works have attempted to enhance robustness against such attacks, they often require extensive training with carefully designed differentiable distortions (e.g., StegaStamp ( Tancik et al., 2020 ) , RoSteALS ( Bui et al., 2023 ) , and Robust-Wide ( Hu et al., 2024 ) ) or they compromise fidelity (e.g., StegaStamp ( Tancik et al., 2020 ) and RoSteALS ( Bui et al., 2023 ) ). We reveal that their limitations are mostly stemmed from the disentanglement between robustness and fidelity due to the the encoder–noise layer–decoder architecture and the joint training strategy. Moreover, we have two interesting observations: 1) there exists an inherent symmetry between the embedding/extraction of watermarks and the denoising/noising processes in diffusion models, and 2) diffusion process holds inherent robustness against different distortions. Based on these, we propose SuperMark to design a novel diffusion-based general watermarking framework, which can inherently achieve robustness and fidelity in a unified manner. Briefly, the embedding and extraction of a watermark essentially involve a reversible transformation between the watermark information and watermarked image. Similarly, in diffusion models, the processes of denoising and noising represent transformations between the Gaussian noise and sampled image. Leveraging this insight, SuperMark injects the watermark information into the initial Gaussian noise, and defaultly employs the Denoising Diffusion Implicit Model (DDIM) as the sampling method for watermark embedding, this process is deterministic and exhibits strong reversibility with the denoising process. Most importantly, its corresponding reversible process, known as DDIM Inversion, has demonstrated remarkable robustness against various perturbations ( Wen et al., 2024 ; Yang et al., 2024 ) . Thus, SuperMark applies DDIM Inversion to cover the sampled image back into the initial watermarked noise for inherent roboust extraction. To satisfy the fidelity requirement, we feed both the watermarked noise and the cover image into a pretrained diffusion-based Super-Resolution (SR) model to generate the watermarked image. Moreover, this entire process can be executed without any fine-tuning of the SR model. Figure 1 shows a comparison between SuperMark and the traditional watermarking framework. Extensive experimental results demonstrate that SuperMark achieves strong robustness against both normal distortions (e.g., JPEG compression and Gaussian noise) and adaptive attacks (e.g., VAE-based and diffusion-based attacks). It achieves high watermark extraction accuracy, with 99.46% accuracy under normal distortions and 89.29% accuracy even under adaptive attacks on the MS-COCO dataset. Additionally, SuperMark maintains high fidelity, with a PSNR of 32.49 and an SSIM of 0.93. We also evaluate its transferability across different datasets, SR models, watermark injection methods, and image resolutions. In summary, our key contributions are as follows: • Our research uncovers a critical insight into current deep watermarking techniques: the encoder-noise layer-decoder architecture and joint training strategy create a trade-off between robustness and fidelity. • We introduce SuperMark, a novel and training-free watermarking framework based on diffusion-based super-resolution models. SuperMark’s simplicity and effectiveness allow it to seamlessly integrate with various watermark injection methods and pre-trained diffusion-based SR models. • Extensive experiments demonstrate that SuperMark offers superior robustness against both normal distortions and adaptive attacks compared to most existing watermarking methods, while maintaining high fidelity. 2 Background 2.1 Diffusion Models Diffusion Models (DMs) are designed to predict and gradually remove varying levels of noise added to images during training. During inference, they iteratively denoise randomly sampled Gaussian noise x_{T}\sim\mathcal{N}(0,1) , progressively generating high-quality images x_{0} . Denoising Diffusion Probabilistic Models (DDPMs ( Ho et al., 2020 ) ) are

Read the complete text