Robust LLM Watermarking with Minimal Semantic Distortion for IP Protection

Kieu Dang, Phung Lai, NhatHai Phan, Yelong Shen, Ruoming Jin · 2026

Read Robust LLM Watermarking with Minimal Semantic Distortion for IP Protection by Kieu Dang, Phung Lai, NhatHai Phan, Yelong Shen, Ruoming Jin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-23175.txt.

Introduction

Dang and four coauthors propose SAFESEAL, a keyed watermarking framework that protects private language models from copying via input-output harvest. It preserves names while swapping word terms for context-aware synonyms through keyed contest sampling, keeping meaning and facts intact. A keyed paired detector jointly encodes text and key for provider checks. Theory bounds the utility-finding trade-off, and light models, batching, and parallel runs cut latency. Tests report a 98.2 percent detection rate, high text quality scores, and latency near the fastest baseline.

Catalog record

CREATORKieu Dang, Phung Lai, NhatHai Phan, Yelong Shen, Ruoming Jin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74853
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.23175

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Robust LLM Watermarking with Minimal Semantic Distortion for IP Protection Kieu Dang, Phung Lai, NhatHai Phan, Yelong Shen, Ruoming Jin Abstract Proprietary large language models (LLMs) face risks of intellectual property (IP) violation, as adversaries can replicate an LLM by collecting input-output pairs to train a surrogate model, causing financial setbacks. Watermarks offer a promising defense to verify ownership, but existing methods often struggle with semantic distortion, factual inconsistency, and adversarial attacks. In addition, key-conditioned watermarks for provider-specific detection, especially in cross-provider and multi-user scenarios, remain largely underexplored. To address these challenges, we propose SafeSeal , a novel key-conditioned watermarking framework that achieves strong detectability with minimal impact on model utility, effectively balancing detectability, utility, and robustness. SafeSeal preserves named entities while substituting linguistic terms with context-aware synonyms through a key-conditioned Tournament sampling mechanism, maintaining semantic fidelity and factual consistency. For detection, we introduce a key-conditioned contrastive detector that jointly encodes the text and key, enabling provider-specific and robust watermark verification. We derive theoretical bounds on the utility-detectability trade-off and significantly reduce latency through lightweight models, batching, and parallelism. Extensive experiments show that SafeSeal outperforms baselines in utility, detectability, and robustness, achieving a BERTScore of 0.983 0.983 , entity similarity of 0.963 0.963 , a 98.2 % 98.2\% detection rate, and the highest human ratings for text quality and content preservation, with latency comparable to the fastest baseline. To promote transparency and community-driven progress, we release the first public watermark leaderboard and an interactive demo. 1 Introduction Large language models (LLMs), such as ChatGPT [ 68 ] , DeepSeek [ 57 ] , and Gemini [ 26 ] , have shown powerful capabilities in text generation, translation, and comprehension. Although LLMs are often deployed as services via APIs that limit access to model weights [ 2 , 7 ] , they remain vulnerable to model stealing attacks [ 106 , 104 , 99 , 47 , 44 ] , where adversaries fine-tune surrogate models on proprietary outputs, threatening providers’ intellectual property (IP) [ 53 ] . LLM watermarks [ 45 , 102 , 56 , 98 , 41 , 76 , 13 , 78 , 111 , 12 , 23 ] address the risk by embedding imperceptible patterns into LLM outputs, enabling service providers to detect unauthorized use of their LLM-generated text. However, existing LLM watermarks [ 103 , 50 , 62 ] often cause substantial content deviation and utility loss to gain strong detectability, particularly under attacks [ 64 , 79 , 74 , 71 , 1 ] . An effective watermark should preserve semantics and factual consistency, offer high detectability, resist attacks, and maintain low latency. However, these goals are difficult to balance: weak signals reduce detectability, while strong signals degrade utility and may increase computational overhead. Watermark removal and model stealing attacks further exacerbate this trade-off. Consequently, a watermark that effectively balances utility, detectability, robustness, and efficiency is crucial for practical LLM deployment. Contributions. This paper proposes SafeSeal , a novel key-conditioned LLM watermark that preserves utility while ensuring strong and robust detectability with provable guarantees. A key insight is that replacing words with context-aware synonyms can preserve meaning. SafeSeal identifies entities (e.g., times and names) and linguistic terms (e.g., nouns and verbs), preserving entities while replacing linguistic terms with context-aware synonyms. It builds a synonym lookup table using a lightweight LM and selects substitution via key-conditioned Tournament sampling, minimizing distortion and making watermark removal difficult without degrading text quality. For detection, we introduce a key-conditioned contrastive detector that verifies whether text is watermarked under a specific key. It fuses text and key embeddings and is trained on matched and mismatched text-key pairs using classification and contrastive losses. This design enables robust, provider-specific detection of subtle substitutions while resisting removal and model stealing attacks. Keys are tied to users and providers, ensuring only authorized verification and reducing risks of unauthorized detection or reverse-engineering. We further establish a theoretical utility-detectability trade-off, showing that lower synonym similarity improves detectability but reduces utility. Experiments on five open-source models [ 88 , 42 , 4 , 86 , 85 ] and three benchmarks [ 20 , 33 , 11 ] show that SafeSeal preserves 98.3\% content similarity and 96.3\% entity similarity, with detection rates up to 98.2\% . It outperforms state-of-the-art watermarks (KGW [ 45 ] , EXP [ 48 ] , SIR [ 55 ] , SynthID [ 18 ] , DTM [ 65 ] , TW [ 101 ] , and LW [ 31 ] ), achieving a 58.47\% higher detection rate than the best baseline under removal attacks. Under model stealing attacks, SafeSeal maintains a 72.8\% detection rate while forcing noticeable utility degradation, limiting watermark removal without quality loss. Human evaluations further favor SafeSeal by 28\times without attacks and 6.5\times under attacks. Latency is comparable to the best baseline. We also anonymously release the first Watermark Leaderboard 1 1 1 https://huggingface.co/spaces/AnonymousResearch/WatermarkLeaderboard and a real-time demo 2 2 2 https://huggingface.co/spaces/AnonymousResearch/SafeSeal for transparency and standardized evaluation. Code is available anonymously at: https://anonymous.4open.science/r/SafeSeal-8E76/ . 2 Background and Related Work LLMs and Watermarking. Given a token vocabulary \mathcal{V} and prompt x\in\mathcal{V}^{T} , an LLM \theta generates y\in\mathcal{V}^{Q} by modeling P(y|x) ( T,Q>0 ). A watermark embeds imperceptible signals in LLM outputs to verify origin via a generator \mathcal{W} producing y^{wm}=\theta(x,\mathcal{W}) , and a detector \mathcal{D} that identifies them. Watermarked text should preserve semantic meaning , i.e., contextual coherence and intent [ 19 ] , and factual consistency with the original facts and entities [ 67 ] , since distortions in either reduce utility. Linguistic Sensitivity. Certain tokens are more sensitive to perturbations. Named Entity Recognition (NER) identifies entities (e.g., names, locations, time expressions) that are critical for factual correctness, while Part-of-Speech (POS) tagging captures grammatical roles (e.g., nouns, verbs, adjectives, adverbs). Modifying such tokens can disproportionately harm meaning and downstream performance. Detection Settings. We consider cross-provider detection , where different providers use distinct keys, and multi-user detection , where a single provider assigns unique keys per user. In both cases, the detector must correctly attribute the source of watermarked text. Table 1 : Comparison of SafeSeal with representative watermarking techniques. Method Generation Detection Provider -specific Detection Susceptible Content Preservation Against Stealing Attacks Utility-Detectability Trade-off Guarantee KGW [ 45 ] , EXP [ 48 ] , SIR [ 55 ] , SynthID [ 18 ] In-processing Statistical test ✓ ✗ ✗ ✗ WLM [ 28 ] , Distilled [ 27 ] In-processing Statistical test ✗ ✗ ✗ ✗ GINSEW [ 110 ] , PLMmark [ 52 ] In-processing Statistical test ✓ ✗ ✓ ✗ MorphMark [ 94 ] , Wouters [ 95 ] In-processing Statistical test ✓ ✗ ✗ ✓ Token-Specific [ 39 ] In-processing Statistical test ✗ ✗ ✗ ✓ Hufu [ 97 ] , EmMark [ 107 ] In-processing Model-based ✓ ✗ ✓ ✓ RLWM [ 100 ] In-processing Model-based ✗ ✗ ✗ ✗ Cross-Attention WM [ 3 ] In-processing Model-based ✓ ✗ ✗ ✗ DTM [ 65 ] Post-processing Model-based ✗ ✓ ✗ ✗ TW [ 101 ] , Post-hoc WM [ 29 ] Post-processing Statistical test ✗ ✓ ✗ ✗ LW [ 31 ] Post-processing Statistical test ✗ ✓ ✓ ✗ CATER [ 32 ] Post-processing Statistical test ✓

Read the complete text