RLSpoofer: A Lightweight Evaluator for LLM Watermark Spoofing Resilience.
Hanbo Huang, Xuan Gong, Yiran Zhang, Hao Zheng, Shiyu Liang · 2026
Read RLSpoofer: A Lightweight Evaluator for LLM Watermark Spoofing Resilience. by Hanbo Huang, Xuan Gong, Yiran Zhang, Hao Zheng, Shiyu Liang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-11546.txt.
Introduction
Huang and four colleagues present RLSpoofer, a light black-box test of LLM watermark spoofing. Current tests demand large datasets and white-box access, leaving black-box spoofing poorly measured. From a distributional view, they prove a local capacity bottleneck on mass movable under KL-bounded updates without losing meaning. RLSpoofer, a reinforcement-learning attack, needs only 100 human-watermarked pairs and zero internals access. It lets a 4B model reach a 62.0 percent spoof success rate on PF-marked texts, dwarfing the 6 percent of baselines trained on up to 10,000 samples.
Catalog record
| CREATOR | Hanbo Huang, Xuan Gong, Yiran Zhang, Hao Zheng, Shiyu Liang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 90648 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.11546
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
RLSpoofer: A Lightweight Evaluator for LLM Watermark Spoofing Resilience. Hanbo Huang, Xuan Gong, Yiran Zhang, Hao Zheng, Shiyu Liang Abstract Large language model (LLM) watermarking has emerged as a promising approach for detecting and attributing AI-generated text, yet its robustness to black-box spoofing remains insufficiently evaluated. Existing evaluation methods often demand extensive datasets and white-box access to algorithmic internals, limiting their practical applicability. In this paper, we study watermark resilience against spoofing fundamentally from a distributional perspective. We first establish a local capacity bottleneck , which theoretically characterizes the probability mass that can be reallocated under KL-bounded local updates while preserving semantic fidelity. Building on this, we propose RLSpoofer, a reinforcement learning-based black-box spoofing attack that requires only 100 human-watermarked paraphrase training pairs and zero access to the watermarking internals or detectors. Despite weak supervision, it empowers a 4B model to achieve a 62.0% spoof success rate with minimal semantic shift on PF-marked texts, dwarfing the 6% of baseline models trained on up to 10,000 samples. Our findings expose the fragile spoofing resistance of current LLM watermarking paradigms, providing a lightweight evaluation framework and stressing the urgent need for more robust schemes. $\dagger$ $\dagger$ footnotetext: Corresponding author. 1 Introduction With the rapid advancement and increasing availability of large language models (LLMs), they are being widely applied across diverse applications to generate fluent and human-like content [ 34 , 8 ] . However, this widespread use raises major concerns about model misuse, including the generation of misinformation [ 2 ] , copyright violations [ 33 ] , data contamination [ 28 ] , and academic dishonesty [ 5 ] . As a safeguard, text watermarking has become an important defense. By subtly embedding statistical signals into model outputs, watermarking enables reliable AI text detection and source tracking while maintaining the quality of the text [ 15 , 37 ] . Most existing watermarking schemes predominantly operate on a generate-and-detect paradigm, utilizing detection algorithms to identify hidden patterns that differentiate AI-generated text from human authorship [ 21 , 18 ] . However, this paradigm inadvertently creates an avenue for watermark spoofing. Malicious actors can query a watermarked LLM to gather text samples, using this data to construct a surrogate model capable of approximating the underlying watermarking rules [ 14 ] . By successfully forging the watermark, such attacks pose a fundamental threat to the reliability of existing watermarking systems. To rigorously assess the spoofing resistance of LLM watermarking schemes, researchers have investigated various attack paradigms. However, existing methods typically suffer from at least one of three major limitations: (1) reliance on partial algorithmic knowledge or detector API access [ 15 , 3 ] ; (2) the need for large training corpora [ 1 , 9 ] (up to 10k); or (3) an inability to generate semantically coherent text that seamlessly matches the original context [ 23 , 7 ] . These limitations reduce their practicality as evaluation tools for watermark spoofing resilience. As LLMs continue to advance, there is an urgent need for a practical, generalizable, and data-efficient methodology for benchmarking the robustness of watermarking schemes. In this paper, we investigate the resilience of LLM watermarks to spoofing attacks. In the black-box setting, direct instance-level spoofing is intractable because the adversary has no access to the watermark details or the detector. Motivated by recent evidence that watermarked text exhibits systematic distributional discrepancy from human-written text [ 11 ] , even for distortion-free watermarking schemes [ 19 ] , we take a distributional view of watermark spoofing. Specifically, the attacker seeks to shift the paraphraser’s output distribution away from the human-like distribution and toward the watermarked distribution. Figure 1: Overview of RLSpoofer. Given human–watermarked rewrite pairs, RLSpoofer jointly optimizes sequence-level semantic rewards, capacity-aware token-level rewards, and a cross-entropy anchor, shifting the policy distribution P_{\theta} from the human-like distribution P_{h} toward the watermarked distribution P_{wm} , thereby effectively spoofing the watermark. Leveraging the autoregressive structure of LLM generation, we establish a local capacity bottleneck that characterizes how much token-level probability mass can be reallocated under KL-bounded local updates while preserving semantic fidelity. Building on this insight, we propose RLSpoofer, a reinforcement-learning-based black-box attack that requires no access to the watermarking internals or the detector. As illustrated in Figure 1 , RLSpoofer jointly optimizes semantic fidelity, capacity-aware token-level reward, and a cross-entropy anchor, thereby shifting the model outputs toward the target watermarked distribution. Using only 100 training pairs , RLSpoofer enables a compact 4B model to achieve a 62.0% spoof success rate against PF-Watermark, substantially surpassing the 6.0% of baseline trained on 10,000 examples . Extensive experiments across five attacker models and six watermarking schemes show that RLSpoofer provides a practical, sample-efficient stress test for spoofing resilience, exposing critical vulnerabilities in current watermarking defenses. Our contributions are as follows: • We establish a local capacity bottleneck that characterizes the token-level bottleneck on probability mass reallocation under KL-bounded local updates while preserving semantic integrity. (Sec. 3.1 .) • We propose RLSpoofer, an effective and sample-efficient black-box attack. It successfully spoofs watermarks with high semantic fidelity, requiring only limited human-watermarked rewrite pairs and zero access to the watermarking scheme or detector. (Sec. 3.2 .) • We conduct extensive experiments across five architectures and six watermarking schemes from both logit-based and sampling-based families. The results demonstrate the broad effectiveness of RLSpoofer, exposing critical vulnerabilities in current watermark defense. (Sec. 4 .) 2 Preliminaries LLM Paraphraser and Logit-based Watermark. Let \mathcal{V} be a finite vocabulary and \mathcal{V}^{*} denote the space of all finite token sequences. For a source input \mathbf{X}\in\mathcal{V}^{*} , an autoregressive paraphraser \pi_{\theta} induces a probability distribution over generated output sequences \mathbf{X}^{\prime}=(x^{\prime}_{1},\dots,x^{\prime}_{|\mathbf{X}^{\prime}|})\in\mathcal{V}^{*} : P_{\theta}(\mathbf{X}^{\prime}\mid\mathbf{X}):=\prod_{t=1}^{|\mathbf{X}^{\prime}|}\pi_{\theta}(x^{\prime}_{t}\mid x^{\prime}_{<t},\mathbf{X}). Independent of the paraphrasing model, a watermark is embedded into generated text using a secret key s and a target green-token rate q\in(0,1) . At each generation step, key s defines a prefix-dependent pseudorandom subset of the vocabulary with expected size q|\mathcal{V}| , whose tokens are softly upweighted during sampling. Given a sequence \mathbf{X}^{\prime} , the detector f computes a score f(\mathbf{X}^{\prime},s) under the key s and flags the sequence watermarked whenever f(\mathbf{X}^{\prime},s)>\delta , where \delta is a fixed detection threshold. Threat Model: Semantics-Preserving Paraphrasing. We consider a black-box adversary aiming to spoof the watermark into an unwatermarked sequence \mathbf{X} via paraphrasing. The adversary is defined by: (1) Objective : Generate an output \mathbf{X}^{\prime} that preserves the semantic meaning of \mathbf{X} while triggering the watermark detector. (2) Knowledge : The adversary lacks access to the secret key s , the detector function f , and the threshold \delta , but can observe watermarked text by querying the generator. (3) Capability : The adversary can construct a training set by querying the watermarked model for paraphrases of given texts, and can subsequently fine-tune a paraphrasing model \pi_{\theta} without requiring access to the detector. Adversarial Objective. Let d:\mathcal{V}^{*}\times\mathcal{V}^{*}\to[0,\infty) be a distance metric where smaller values indicate higher semantic similarity. For a tolerance \varepsilon>0 , we define the instance-level spoof success rate as: \operatorname{SSR}_{\mathbf{X}}(\theta):=P_{\theta}(\{\mathbf{X}^{\prime}\in\mathcal{V}^{*}:d(\mathbf{X}^{\prime},\mathbf{X})\leq\varepsilon,\,f(\mathbf{X}^{\prime},s)>\delta\}\mid\mathbf{X}) . The adversary seeks to maximize this rate. However, without access to f and s , direct optimization is intractable. Distributional Surrogate. Prior work suggests a distributional discrepancy between watermarked and human-written text [ 11 , 19 ] . Since the