Unified attacks to large language model watermarks: spoofing and scrubbing in unauthorized knowledge distillation
Xin Yi, Yue Li, Shunfan Zheng, Linlin Wang, Xiaoling Wang, Liang He · 2025
Read Unified attacks to large language model watermarks: spoofing and scrubbing in unauthorized knowledge distillation by Xin Yi, Yue Li, Shunfan Zheng, Linlin Wang, Xiaoling Wang, Liang He (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-17480.txt.
Introduction
Xin Yi and co-authors show how to wash a watermark out of a language model, or forge one, by copying it. Watermarks tag machine text so owners can spot misuse, and they leak into student models trained on a teacher's output, a quirk called radioactivity. That leak lets owners detect unauthorized copying, but it may also invite attack.
Their method decodes with contrast, pitting the student against weakly marked reference text to extract spoiled or boosted watermark samples. Fresh students trained on those samples learn either to scrub marks or to fake them, while keeping general skill intact. The authors warn that future marks must be both hard to remove and hard to counterfeit.
Catalog record
| CREATOR | Xin Yi, Yue Li, Shunfan Zheng, Linlin Wang, Xiaoling Wang, Liang He |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 76 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-17480
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Unified attacks to large language model watermarks: spoofing and scrubbing in unauthorized knowledge distillation Xin Yi, Yue Li, Shunfan Zheng, Linlin Wang, Xiaoling Wang, Liang He Abstract Watermarking has emerged as a critical technique for combating misinformation and protecting intellectual property in large language models (LLMs). A particularly promising property, known as watermark radioactivity, offers potential for preventing the unauthorized use of LLM outputs in downstream distillation pipelines. However, the robustness of watermarking against scrubbing attacks and its unforgeability under spoofing attacks in unauthorized knowledge distillation settings remain underexplored. Existing attack methods either assume access to model internals or fail to support both attack types simultaneously. In our work, we propose Contrastive Decoding-guided Knowledge Distillation ( CDG-KD ), a unified framework that enables dual-path attacks under unauthorized knowledge distillation. At the core of CDG-KD is a novel contrastive decoding mechanism with token-level constraint fusion, which integrates a learned watermark discriminator and probability-based constraint component to selectively manipulate watermark-relevant logits. This allows for fine-grained control of watermark strength during generation without compromising fluency or semantics. Our approach employs contrastive decoding to extract corrupted or amplified watermark texts via comparing outputs, followed by dual-path distillation to train new student models capable of watermark removal and watermark forgery, respectively. Extensive experiments show that CDG-KD effectively performs attacks while preserving the general performance of the distilled model. Our findings underscore critical need for developing watermarking schemes that are robust and unforgeable. keywords Large language model ,Watermark ,Knowledge distillation † † corresponding: Corresponding author 1 Introduction Large language models (LLMs) have been widely deployed across diverse domains, such as code generation [ 1 , 2 ] , literary creation [ 3 ] , news writing [ 4 , 5 ] , and human-robot interaction [ 6 , 7 ] . While these advancements have greatly enhanced productivity, they also raises concerns regarding misinformation spread [ 8 , 9 ] and the protection of intellectual property [ 10 ] . As a response, watermarking has emerged as a promising technique for distinguishing AI-generated text from human-authored content. Among existing approaches, generative watermarking is particularly appealing due to its integration during generation time, thereby avoiding the overhead of post-processing [ 11 ] . Most generative watermarking methods operate at the token level by either perturbing token probability distributions through green-red vocabulary partitioning or modifying the sampling process [ 12 , 13 , 14 , 15 , 16 ] . These watermarks have traditionally been designed for post-hoc detection, enabling model owners to verify whether a suspicious output was generated by a marked model. However, recent work uncovers a more proactive and persistent property of watermarks known as watermark radioactivity . This phenomenon refers to the phenomenon where watermark signals embedded in teacher models are unintentionally inherited by student models during knowledge distillation, thus enabling traceability even after unauthorized knowledge distillation. Originally proposed by Sablayrolles et al. [17] in the context of small CNNs, the concept was later extended to text generation by Sander et al. [18] , showing that watermark radioactivity is broadly applicable across diverse watermarking schemes. Notably, Gu et al. [19] demonstrate that both logit-based and sampling-based watermarks retain comparable detectability in the student models. While this property has been leveraged as a tool to detect and deter model theft, it simultaneously reveals a critical vulnerability: the inherited watermarks can be extracted, spoofed, or removed by adversaries, even in black-box settings. Despite recent progress, existing watermarking schemes remain limited in two key aspects: robustness (resistance to removal) and unforgeability (resistance to imitation). Most prior work has focused on defending against watermark scrubbing attacks that attempt to erase ownership signals [ 20 , 21 ] , while relatively few methods address spoofing attacks that aim to falsely attribute harmful content to victim models [ 22 , 23 ] . Moreover, the robustness and unforgeability of watermarks under distillation-based attacks remains underexplored. In practice, many LLM providers deploy their models as APIs with limited access, making direct attacks on internal watermarking mechanisms impractical. Nevertheless, indirect attacks may still be possible. For example, Pan et al. [11] show that a student model trained via distillation from a watermarked API can not only inherit the watermark but also subsequently remove it. However, their method relies on altering the model’s output probability distribution at inference time, thereby incurring extra computational costs and limiting its applicability primarily to scrubbing attacks. Another line of work by Jovanović et al. [23] achieves both scrubbing and spoofing attacks by querying a watermarked model’s API to reverse-engineer its hidden watermark pattern. Nevertheless, this approach requires access to both the watermarked and unwatermarked versions of the model’s output probability distribution, allowing for precomputing the next-token probability distributions over prefix sequences. In summary, most existing methods either (1) address only one type of attack (scrubbing or spoofing) without providing a unified framework, or (2) rely on access to output distributions or a reference model, making them impractical for real-world black-box scenarios. These limitations significantly hinder their applicability in black-box deployment. To overcome these limitations, we propose a unified attack strategy that leverages the inherent radioactivity of watermarks, a property that causes watermarked models to exhibit detectable generation biases even under indirect queries. Our approach is compatible with standard black-box settings and, importantly, enables both scrubbing and spoofing attacks within a single framework. Technically, we extend standard contrastive decoding [ 24 , 25 ] to support uniform attacks by dynamically estimating watermark strength at each generation step and updating the candidate token subset accordingly. Therefore, ensuring the probability mass over the watermark-critical token subset is precisely controlled, while minimizing interference from irrelevant tokens. As illustrated in Fig. 1 , our approach demonstrates that the radioactivity of watermarks can be exploited to indirectly extract and manipulate watermarking schemes, which poses a substantial threat to both the robustness and unforgeability of existing watermarking methods. In this paper, we introduce a novel framework called contrastive decoding-guided knowledge distillation ( CDG-KD ), a dual-path attack paradigm for both watermark scrubbing and spoofing in unauthorized knowledge distillation settings. CDG-KD requires neither modifications to the decoding process nor access to internal parameters of the victim model, making it broadly applicable and practically efficient in real-world black-box scenarios. The framework consists of three sequential steps: (1) Watermark model initialization, where a medium watermark model is first distilled from a victim model, followed by the application of an existing scrubbing attack to produce a weak watermark model; (2) Contrastive decoding, which extracts corrupted or amplified watermark traces by enforcing discriminator-based and probability-based constraints during generation, enabling the separation of watermark-relevant and watermark-irrelevant content; (3) Dual-path knowledge distillation, where the student model is trained using both corrupted and amplified watermark outputs, supporting two distinct attack objectives: removal and forgery. Importantly, the entire CDG-KD pipeline functions without reliance on internal watermarking mechanisms or modifications to the model’s generation strategy, making it a versatile and scalable black-box attack framework. Figure 1: An overview of watermark scrubbing and spoofing attacks in unauthorized knowledge distillation. In this setting, attackers can exploit watermark radioactivity to transfer watermarking schemes from victim models to student models. ① Scrubbing attack removes detectable traces to bypass ownership verification. ② Spoofing attack generates harmful outputs while retaining