Can LLM Watermarks Robustly Prevent Unauthorized Knowledge Distillation?

Leyi Pan, Aiwei Liu, Shiyu Huang, Yijian Lu, Xuming Hu, Lijie Wen, Irwin King, Philip S. Yu · 2025

Read Can LLM Watermarks Robustly Prevent Unauthorized Knowledge Distillation? by Leyi Pan, Aiwei Liu, Shiyu Huang, Yijian Lu, Xuming Hu, Lijie Wen, Irwin King, Philip S. Yu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-11598.txt.

Introduction

Leyi Pan and co-authors test whether watermarks can stop rivals from copying a language model by distillation, in this 2025 paper. Watermarked text carries a hidden signal that students trained on it inherit. That radioactivity, as it is called, can expose unauthorized training.

The team ask whether a thief can scrub the mark while keeping the skill. They design two families of removal attacks, applied before distillation. Some attacks are blind; others aim at the watermark itself. Results probe how sturdy the radioactivity defense really is. Model owners rely on such marks to guard huge training investments. Weak marks would call for stronger legal or technical shields.

Catalog record

CREATORLeyi Pan, Aiwei Liu, Shiyu Huang, Yijian Lu, Xuming Hu, Lijie Wen, Irwin King, Philip S. Yu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-11598

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Can LLM Watermarks Robustly Prevent Unauthorized Knowledge Distillation? Leyi Pan, Aiwei Liu, Shiyu Huang, Yijian Lu, Xuming Hu, Lijie Wen, Irwin King, Philip S. Yu Abstract The radioactive nature of Large Language Model (LLM) watermarking enables the detection of watermarks inherited by student models when trained on the outputs of watermarked teacher models, making it a promising tool for preventing unauthorized knowledge distillation. However, the robustness of watermark radioactivity against adversarial actors remains largely unexplored. In this paper, we investigate whether student models can acquire the capabilities of teacher models through knowledge distillation while avoiding watermark inheritance. We propose two categories of watermark removal approaches: pre-distillation removal through untargeted and targeted training data paraphrasing (UP and TP), and post-distillation removal through inference-time watermark neutralization (WN). Extensive experiments across multiple model pairs, watermarking schemes and hyper-parameter settings demonstrate that both TP and WN thoroughly eliminate inherited watermarks, with WN achieving this while maintaining knowledge transfer efficiency and low computational overhead. Given the ongoing deployment of watermarking techniques in production LLMs, these findings emphasize the urgent need for more robust defense strategies. † † footnotetext: † Corresponding authors. 1 Introduction Figure 1: LLM watermarking has been proposed as a safeguard against unauthorized knowledge distillation. However, our pre- and post-distillation watermark removal attacks allow student models to perform untraceable knowledge distillation, emphasizing the need for more robust design. The bar chart displays the effectiveness of watermark removal and knowledge preservation for our three proposed attacks. The capability of Large Language Models (LLMs) to rapidly generate high-quality text at scale makes them valuable sources of training data Zoph et al. 2022 . However, many leading LLM services explicitly prohibit the use of their outputs for training competing models through knowledge distillation in their terms of service. Notable examples include OpenAI, Anthropic and Meta Llama, as detailed in Appendix A . Watermarking has emerged as a solution to monitor unauthorized usage Kirchenbauer et al. 2023 ; Zhao et al. 2024 ; Liu et al. 2024c ; Zhao et al. 2023 . Research has shown that watermarked LLMs exhibit radioactivity - student models trained on their outputs inherit detectable watermarks Sander et al. 2024 ; Gu et al. 2024 . This traceability has led to increasing practical implementations, such as Google DeepMind’s integration of SynthID-Text Dathathri et al. 2024 into Gemini chatbots Team et al. 2023 . As watermarking emerges as a promising approach to protect model copyrights from knowledge distillation, its robustness against adversarial actors remains largely unexplored. We conduct the first systematic investigation into watermark resilience and propose two categories of watermark removal attacks: pre-distillation removal through untargeted and targeted training data paraphrasing ( UP and TP ), and post-distillation removal through inference-time watermark neutralization ( WN ), as illustrated in the upper part of Figure 1 . Experiments show that TP and WN can thoroughly eliminate inherited watermarks, with WN achieves watermark removal while preserving distilled knowledge and maintaining low computational overhead - raising important questions about the reliability of preventing unauthorized knowledge distillation through watermarks. Given that both TP and WN require knowledge of watermark rules, we propose a watermark stealing technique. Unlike existing methods Jovanović et al. ; Wu and Chandrasekaran 2024 ; Zhang et al. 2024 , our approach (1) does not need access to the watermarking scheme or its hyper-parameters, and (2) assigns weights by analyzing factors affecting watermark radioactivity, allowing for more targeted rule extraction. In TP, we integrate the inverse of extracted watermark rules into paraphrase models like Dipper Krishna et al. 2023 to remove watermark. In contrast, UP simply employs standard paraphrasing tools without considering rules. For post-distillation removal, we develop watermark neutralization that directly counteracts inherited watermarks by applying inverse rules during the student model’s decoding phase. Extensive experiments were conducted across 2 Teacher-Student model pairs \times 2 leading watermarking schemes \times 3 hyperparameter settings. The comparative results are summarized in the bottom part of Figure 1 . Both TP and WN effectively eliminate inherited watermarks, reducing detection significance to levels similar to non-watermarked conditions (above 10^{-2} ) across all settings. Evaluations on benchmark datasets, including ARC challenge Clark et al. 2018 , TruthfulQA Lin et al. 2022 , and MTBench Zheng et al. 2023 show that WN exhibits superior knowledge preservation, achieving comparable performance to baseline student models trained without any watermark removal techniques. This indicates that student models can leverage WN to remove watermarks without sacrificing model performance, posing a significant challenge to the practical deployment of watermark as a copyright protection mechanism. Key Contributions Our main contributions are: • We conduct the first systematic investigation into the robustness of watermarking schemes against adversarial actors in monitoring unauthorized knowledge distillation, proposing pre-distillation and post-distillation attacks. • Our proposed targeted paraphrasing and watermark neutralization methods achieve thorough watermark removal, with the latter demonstrating superior knowledge preservation. This raises concerns about the reliability of current watermarking schemes for monitoring unauthorized knowledge distillation. • Further discovery of watermark collisions in multi-source knowledge distillation scenarios reveals additional limitations of watermarking schemes in monitoring unauthorized knowledge distillation (Section 7 ). Given the ongoing deployment of watermarking techniques in production LLMs, these findings highlight the urgent need for more robust defense strategies (Section 5.3 ). 2 Background Figure 2: An illustration of the proposed watermark removal attacks. 2.1 LLM Watermarking Schemes Most of the existing watermarking schemes follow the n -gram paradigm, modifying the next token’s probability prediction based on the preceding n-1 tokens, thereby influencing the final sampling outcome Kirchenbauer et al. 2023 ; Zhao et al. 2024 ; Dathathri et al. 2024 ; Liu et al. 2024c ; Liu et al. 2024b ; Lee et al. 2024 ; Hu et al. 2024 ; Wu et al. 2023 ; Aaronson and Kirchner 2022 ; Kuditipudi et al. 2024 ; Liu et al. 2024d ; Lu et al. 2024 ; Pan et al. 2025 . Watermark schemes tested in this work are: KGW Kirchenbauer et al. 2023 sets the ground work for generative LLM watermarking. For the t^{th} token generation, it computes a hash h_{t}=H(x_{t-n+1:t-1}) from the previous n-1 tokens. This hash partitions the vocabulary \mathcal{V} into a green list \mathcal{V}_{g} and a red list \mathcal{V}_{r} . A constant bias \delta is then added to the logits of green tokens: l^{\prime(i)}_{t}=l^{(i)}_{t}+\delta\text{\; if \;}v_{i}\in\mathcal{V}_{g}\text{\; else \;}l^{(i)}_{t}. (1) As a result, watermarked text will statistically contain more green tokens, and can be detected by computing the z-score: z=(|s|_{G}-\gamma T)/(\sqrt{\gamma(1-\gamma)T}), (2) where |s|_{G} counts green tokens in text length T , and \gamma=|\mathcal{V}_{g}|/|\mathcal{V}| . SynthID-Text Dathathri et al. 2024 , recently announced by Google DeepMind, is the first watermarking algorithm deployed in production, and has been integrated into the Gemini and Gemini Advanced chatbots. For the t^{th} token generation, it computes a hash h_{t}=H(x_{t-n+1:t-1}) to seed m binary classifiers g_{1},g_{2},...,g_{m} , which randomly assign 0 or 1 to vocabulary tokens. It then samples 2^{m} tokens from the original distribution P(x_{t}|x_{1:t-1}) and conducts tournament sampling: tokens compete in pairs based on g_{1} values in the first round, with subsequent rounds using g_{2},g_{3},...,g_{m} until one token remains. The watermark manifests as a statistical bias toward tokens with higher g values, detectable by computing their mean: \overline{g}=\sum_{t=1}^{T}\sum_{\ell=1}^{m}g_{\ell}(x_{t})/mT. (3) 2.2 Watermark Radioactivity Research has shown that

Read the complete text