Linear Ensembles Wash Away Watermarks: On the Fragility of Distributional Perturbations in LLMs
Zhihao Wu, Gracia Gong, Qinglin Zhu, Yudong Chen, Runcong Zhao · 2026
Read Linear Ensembles Wash Away Watermarks: On the Fragility of Distributional Perturbations in LLMs by Zhihao Wu, Gracia Gong, Qinglin Zhu, Yudong Chen, Runcong Zhao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30501.txt.
Introduction
Zhihao Wu and four co-authors reveal a basic weakness in marking AI-made text: when users access multiple models, marks easily fail. In theory, mixing output spreads regains the unmarked spread. They present WASH, a method solving word-list mismatch and token-split gaps. Tests across six marking schemes and three LLMs show mixing across 3 models cuts spot z-scores from 5 to 300 to below 2, below the spot threshold of 4. It reduces true hit rate at 5 percent false positive rate to below 50 percent.
Catalog record
| CREATOR | Zhihao Wu, Gracia Gong, Qinglin Zhu, Yudong Chen, Runcong Zhao |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69430 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30501
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Linear Ensembles Wash Away Watermarks: On the Fragility of Distributional Perturbations in LLMs Zhihao Wu, Gracia Gong, Qinglin Zhu, Yudong Chen, Runcong Zhao Abstract Watermarking embeds statistical signatures in AI-generated text for detection and attribution. We reveal a fundamental vulnerability: when users access multiple models (today’s reality), watermarks trivially fail. Watermarks perturb output distributions away from the original, and in competitive markets, these perturbations are typically independent across providers. We theoretically prove that averaging output probability distributions recovers the unwatermarked distribution with up to a second-order error term. Empirically, simply averaging 3-5 models cancels out these perturbations. We introduce WASH (Watermark Attenuation via Statistical Hybridisation), which solves practical challenges in ensemble generation: vocabulary misalignment and tokenisation differences across heterogeneous models. Experiments across six watermarking schemes and three LLMs show that averaging across 3 models suppresses detection z-scores from 5-300 to below 2 (below the detection threshold of 4) and reduces TPR@5%FPR to below 50% , while improving quality by 27.5% and running 6 × \times faster than the best baseline on the long sequence generation. Our results suggest that robust AI-text detection via watermarking requires either accepting this fundamental vulnerability or unprecedented coordination among model providers. † † affiliationnotice: Equal contribution 1 Introduction The rapid deployment of large language models (LLMs) across critical applications, from educational assessment to content creation, has made reliable attribution mechanisms an urgent necessity ( 27 ; 12 ; 28 ) . Can we determine whether a given text was generated by an AI system? In an era where synthetic text has become increasingly indistinguishable from human writing, these questions have profound implications for academic integrity, content authenticity, and intellectual property protection ( 29 ; 34 ) . Watermarking has emerged as the technical solution to this attribution problem ( 13 ; 18 ) . By embedding statistical signatures during text generation, unbiased watermarking promises to make AI-generated content detectable while minimising quality degradation and avoiding architectural changes ( 9 ; 19 ) . However, current watermarking research relies on a critical simplifying assumption: adversaries have access to only a single watermarked model. In reality, users today can easily and freely access 10+ frontier LLMs through unified platforms (e.g., Hugging Face), such as GPT, LLaMA, Qwen, Mistral, and dozens of other capable models. The modern LLM landscape is not a monopoly but a hyper-competitive marketplace with multiple providers, and this competitive structure is the Achilles’ heel of watermarking. Figure 1 : Effect of Linear Ensembles. The ensemble average \bar{p}_{N} (Right) neutralises the independent watermark perturbations p_{i} (Middle) , effectively recovering the original consensus p^{*} (Left) , which is calculated by averaging the unwatermarked models. Our key insight is deceptively simple: watermarking works by perturbing a model’s output distribution, and these perturbations are independent across providers due to different secret keys and architectural design. By querying multiple models in parallel and averaging their output distributions, these independent perturbations cancel out, recovering the original unwatermarked distribution (as illustrated in Figure 1 ). We formalise this by proving that for any unbiased watermarking scheme with independent per-model perturbations, linear ensembling recovers the consensus distribution up to a second-order error with convergence rate O(1/\sqrt{N}) . This establishes a fundamental limit rooted in market structure: competitive providers must use secret keys for provenance verification (guaranteeing independence) and maintain quality to retain users (bounding perturbation magnitude). Under these constraints, watermark signals are mathematically guaranteed to vanish under averaging. While theoretical result guarantees asymptotic removal, practical deployment faces critical obstacles in efficiency and coherence. Frameworks that seek to approximate watermark parameters via “random selection probing” ( 2 ) require extensive iterative querying, causing prohibitive inference latency. Meanwhile, attacks that concatenate tokens from heterogeneous models require predicting additional tokens at every time step and re-encoding the entire context at every switch ( 10 ) , incurring significant computational inefficiency. To bridge these gaps, we introduce WASH (Watermark Attenuation via Statistical Hybridisation). WASH employs fluency-aware routing to overcome vocabulary mismatches, enabling effective probability aggregation across distinct tokenisers. Furthermore, by leveraging parallel inference with response caching, WASH eliminates the need for iterative probing or context re-encoding, achieving constant-time per-token complexity regardless of the ensemble size N . Extensive experiments demonstrate that WASH improves generation quality by 27.5\% while running 6\times faster than state-of-the-art removal baselines. Our analysis reveals that watermarking faces a fundamental choice: True robustness that distinguishes AI from human text regardless of model mixing requires coordinated watermarking , namely some common signal shared across all models. This paper rigorously characterises this fundamental limitation through the following contributions: 1. We theoretically prove that linear ensembling asymptotically recovers the original unwatermarked distribution. We demonstrate the convergence rate is O(1/\sqrt{N}) with N independent models, revealing fundamental limits of unbiased watermarking in multi-provider settings. 2. We introduce WASH , a novel algorithm that overcomes the vocabulary mismatch problem in heterogeneous model ensembles. By employing fluency-aware routing and context re-synchronisation, WASH preserves semantic integrity while neutralising watermark signals. 3. We conduct a systematic evaluation across six representative watermarking schemes and three LLMs under two complementary detection settings. Experiments demonstrate near-complete detection failure: (a) for generation-time detection, WASH suppresses z-scores from 5-300 (strongly detectable) to <2 (near random choice) with just 3 models; (b) for final-text detection, WASH lowers the TPR@5%FPR on native sequence detectors to below 50%, rendering the watermarks statistically undetectable. 2 Methodology Watermarking exhibits a structural statistical vulnerability when outputs from multiple independently watermarked models are aggregated. Formally, we conceptualise watermarking as a stochastic perturbation applied to a shared underlying distribution p^{*} . While these perturbations are necessary for detection, they act as uncoordinated noise across different providers. Consequently, when outputs from multiple models are combined, the watermark signals interfere destructively, allowing the underlying consensus distribution to be asymptotically recovered. We now formalise this perspective by characterising the relationship between the consensus distribution, the perturbed watermarked distributions, and their aggregation. Let \mathcal{V} be the vocabulary and \mathcal{X} be the space of possible contexts (i.e., sequences of tokens). We denote the probability distributions over the vocabulary as \Delta(\mathcal{V})=\left\{\mathbf{p}\in\mathbb{R}^{|\mathcal{V}|}\;\middle|\;p_{v}\geq 0,\sum_{v\in\mathcal{V}}p_{v}=1\right\} . 2.1 Problem Formulation Conceptually, the probability distribution of any model i deviates from the ideal semantic distribution p_{GT} (align with human expert) due to shared systematic errors and provider-specific variations. We model this as: p_{i}(v|x)\propto p_{GT}(v|x)\cdot\exp\left(\underbrace{\delta_{sys}(v,x)}_{\text{Shared Model Bias}}+\underbrace{\delta_{i}(v,x)}_{\text{Watermark}}\right). Here, \delta_{sys} represents common biases inherent to current LLM architectures, while \delta_{i} encapsulates the provider-specific signal, primarily the watermarking signal, but also including model-specific characteristics. Definition 2.1 (Consensus Distribution and Watermarked Perturbation) . We define the consensus distribution p^{*}(\cdot|x)\in\Delta(\mathcal{V}) as the effective baseline of current models, absorbing the shared systematic bias: p^{*}(v|x)\propto p_{GT}(v|x)\cdot\exp(\delta_{sys}(v,x)) . Consequently, the output distribution of a specific watermarked model i defines a perturbed distribution p_{i}(\cdot|x) : p_{i}(v|x)=\frac{p^{*}(v|x)\cdot\exp(\delta_{i}(v,x))}{Z_{i}(x)}, (1) where \delta_{i}:\mathcal{V}\times\mathcal{X}\to\mathbb{R} is the provider-specific perturbation function (the watermark signal), and Z_{i}(x) is the normalisation term. The key insight enabling watermark removal is that perturbations across independent providers are statistically unbiased. We formalise this assumption below. Assumption 2.2 (Unbiased Perturbations) . Consider a discrete set of providers indexed by i , where each provider is associated with a random perturbation vector \delta_{i}(\cdot,x) that modulates the output distribution. We assume the following properties hold for \{\delta_{i}\}_{i=1}^{N} : (a) Bounded Magnitude: The perturbation magnitude is uniformly bounded by a constant