Learning to Watermark in the Latent Space of Generative Models

Sylvestre-Alvise Rebuffi, Tuan Tran, Valeriu Lacatusu, Pierre Fernandez, Tomáš Souček, Nikola Jovanović, Tom Sander, Hady Elsahar, Alexandre Mourachko · 2026

Read Learning to Watermark in the Latent Space of Generative Models by Sylvestre-Alvise Rebuffi, Tuan Tran, Valeriu Lacatusu, Pierre Fernandez, Tomáš Souček, Nikola Jovanović, Tom Sander, Hady Elsahar, Alexandre Mourachko (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-16140.txt.

Introduction

Sylvestre-Alvise Rebuffi and coauthors hide marks in the deep code of image models. Their 2026 preprint deals with marks that tag AI made pics. Past marks are oft put on the pic at the end. End marks add cost and can leave flaws in the pic. The team puts the mark in the latent code in its place.

Their tool, named DistSeal, works for more than one model type. It fits both spread type and step type image models. A mark in the code should leave less trace on the pic. It should also save the cost of an end step. The work seeks marks that hold up in real use.

Catalog record

CREATORSylvestre-Alvise Rebuffi, Tuan Tran, Valeriu Lacatusu, Pierre Fernandez, Tomáš Souček, Nikola Jovanović, Tom Sander, Hady Elsahar, Alexandre Mourachko
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-16140

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning to Watermark in the Latent Space of Generative Models Sylvestre-Alvise Rebuffi, Tuan Tran, Valeriu Lacatusu, Pierre Fernandez, Tomáš Souček, Nikola Jovanović, Tom Sander, Hady Elsahar, Alexandre Mourachko Abstract Existing approaches for watermarking AI-generated images often rely on post-hoc methods applied in pixel space, introducing computational overhead and visual artifacts. In this work, we explore latent space watermarking and introduce DistSeal , a unified approach for latent watermarking that works across both diffusion and autoregressive models. Our approach works by training post-hoc watermarking models in the latent space of generative models. We demonstrate that these latent watermarkers can be effectively distilled either into the generative model itself or into the latent decoder, enabling in-model watermarking. The resulting latent watermarks achieve competitive robustness while offering similar imperceptibility and up to 20 × \times speedup compared to pixel-space baselines. Our experiments further reveal that distilling latent watermarkers outperforms distilling pixel-space ones, providing a solution that is both more efficient and more robust. Code and model are available at https://github.com/facebookresearch/distseal . † † affiliationnotice: Equal contribution 1 Introduction The rapid advancement of generative models has enabled the creation of increasingly realistic synthetic content, raising serious concerns about potential misuse, including the generation of harmful content, deepfakes, and intellectual property violations ( Chesney & Citron 2019 ; Somepalli et al. 2023 ) . As outputs of these models become more indistinguishable from authentic content, the need for reliable provenance mechanisms grows. Invisible watermarking offers a promising solution by embedding imperceptible signals into generated content that can later verify its synthetic origin, enabling accountability while preserving the utility and quality of generated outputs. Recent watermarking research can be categorized into post-hoc methods that modify already-generated content in pixel-space ( Bui et al. 2023a ; Fernandez et al. 2024 ) , out-of-model generation-time methods that alter the sampling process ( Wen et al. 2023 ; Yang et al. 2024 ; Jovanović et al. 2025 ; Lukovnikov et al. 2025 ) , and in-model methods where watermarks are directly integrated into the generative model weights ( Yu et al. 2022b ; Fernandez et al. 2023 ; Kim et al. 2024 ) . While post-hoc pixel-space watermarking has emerged as the method of choice for industry deployment ( Gowal et al. 2025 ; Castro 2025 ) due to its flexibility and model-agnostic nature, it faces fundamental limitations. First, it incurs substantial computational overhead and latency as it operates on high-resolution pixel representations (e.g., 512 \times 512 \times 3 ). Second, it provides weak to no security for open-source deployments, as users can trivially bypass watermarking by removing a single line of code. To this end, we explore whether it is possible to directly embed the watermarking into the generative models in such a way that (a) the watermarking does not introduce a latency penalty, and (b) it cannot be disabled even in the case of open-source models. Unlike the work of Fernandez et al. 2023 , which adds watermarking capability into the Stable Diffusion decoder, we strive to watermark the latent outputs of a diffusion or autoregressive model directly. In this work, we introduce DistSeal , a unified framework for latent watermarking that operates across both diffusion and autoregressive generative models. DistSeal works by adapting post-hoc watermarking methods for latent space, allowing us to watermark both continuous latent representations of diffusion models and discrete token sequences of autoregressive models. We show that these latent watermarkers can be distilled directly into the generative model itself, while retaining the robustness characteristics of the teacher watermarkers. Not only that, we demonstrate that latent watermarks are easier to distill than their pixel-space counterparts. In detail, our contributions are: • We introduce DistSeal —a unified latent watermarking framework for both diffusion and autoregressive models. We show that DistSeal delivers up to 20× speedup compared to pixel-space methods while achieving competitive robustness. • We demonstrate that latent watermarkers can be effectively distilled into model weights (generative model or decoder). Critically, we show that distilling latent watermarkers is more effective than distilling pixel-space ones, allowing us to achieve state-of-the-art in-model watermarking for open-source generative models. • We conduct a comprehensive study of post-hoc and in-model watermarking trade-offs, multi-watermarking compatibility, and watermark forgetting, providing actionable guidance for real-world deployment. Figure 1: Overview of DistSeal . We train a post-hoc embedder/extractor pair, where the embedder operates in the latent space (top). We may then distill the embedder into the diffusion or autoregressive model (bottom). Fig. 2 details the distillation in the latent decoder. 2 Related Work Image generative models. Modern image generation relies on several paradigms, with diffusion models and autoregressive models being the most prominent. Diffusion models ( Ho et al. 2020 ; Song et al. 2020 ; Dhariwal & Nichol 2021 ) learn to reverse a noise diffusion process, with Latent Diffusion Models (LDMs) ( Rombach et al. 2022 ) like Stable Diffusion operating in a compressed latent space via a Variational Autoencoder (VAE) ( Kingma & Welling 2013 ) . Some recent works improve compression autoencoders for efficient high-resolution generation ( Chen et al. 2024a ; Xie et al. 2024 ) . Autoregressive models ( Esser et al. 2021 ; Ramesh et al. 2021 ; Yu et al. 2022a ) predict image tokens sequentially, with recent work including RAR-XL ( Yu et al. 2024 ) and MaskBit ( Weber et al. 2024 ) . This approach notably allows for interleaved multimodal generation ( Chameleon Team 2024 ; Zhan et al. 2024 ; Wu et al. 2024 ) . Our work focuses on watermarking both diffusion and autoregressive models. Post-hoc image watermarking. Traditional image watermarking methods operate in either the spatial domain by directly modifying pixels ( Van Schyndel et al. 1994 ; Bas et al. 2002 ) , or the frequency domain by embedding watermarks in transform coefficients such as DFT, DCT, DWT, etc. ( Cox et al. 1997 ; Barni et al. 1998 ; Xia et al. 1998 ) . Deep learning-based post-hoc watermarking methods have emerged as robust alternatives, typically employing encoder-decoder architectures trained end-to-end to embed imperceptible watermarks while maintaining robustness to various transformations ( Zhu et al. 2018 ; Zhang et al. 2019 ; Zhang et al. 2020 ; Yu 2020 ; Luo et al. 2020 ; Ma et al. 2022 ; Jia et al. 2021 ) . They are the method of choice for the industry ( Bui et al. 2023a ; Xu et al. 2024 ; Gowal et al. 2025 ; Sander et al. 2025 ; Fernandez et al. 2024 ) due to their flexibility and ease of deployment. Our work adapts current post-hoc watermarking schemes for watermarking the latent space of generative models, offering computational efficiency while maintaining competitive robustness. Generation-time image watermarking. Generation-time watermarking methods embed watermarks directly during content generation, eliminating post-processing overhead. For diffusion models, Stable Signature ( Fernandez et al. 2023 ) performed in-model watermarking by fine-tuning the latent decoder, followed by extensions using hypernetworks ( Kim et al. 2024 ) and adapters ( Ci et al. 2024a ; Rezaei et al. 2024 ) . Out-of-model approaches like Tree-Ring ( Wen et al. 2023 ) and its variants ( Hong et al. 2024 ; Ci et al. 2024b ; Lei et al. 2024

Read the complete text