SAMark : A Self-Anchored Text Watermarking with Paragraph-Level Paraphrase Robustness

Jiahao Huo 2 3 , Wenjie Qu 4 , Yibo Yan 2 1 , Kening Zheng 3 , Jiaheng Zhang 4 , Xuming Hu 2 1 , Philip S. Yu 3 , Mingxun Zhou 1 🖂 · 2026

Read SAMark : A Self-Anchored Text Watermarking with Paragraph-Level Paraphrase Robustness by Jiahao Huo 2 3 , Wenjie Qu 4 , Yibo Yan 2 1 , Kening Zheng 3 , Jiaheng Zhang 4 , Xuming Hu 2 1 , Philip S. Yu 3 , Mingxun Zhou 1 🖂 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25796.txt.

Introduction

Huo and colleagues present SAMark, a watermarking system robust to rewrites. Sentence-level marking breaks under paraphrase. SAMark removes order dependency with a green region in semantic space that does not depend on step order. Multi-channel hyperbolic scoring boosts signals while cutting noise from aligned cases, and range-aware filters add soft controls against meaning repeats. Under paraphrase attacks it reaches over 90 percent true hits at 1 percent false alarms. It beats the rival by over 30 percent on average.

Catalog record

CREATORJiahao Huo 2 3 , Wenjie Qu 4 , Yibo Yan 2 1 , Kening Zheng 3 , Jiaheng Zhang 4 , Xuming Hu 2 1 , Philip S. Yu 3 , Mingxun Zhou 1 🖂
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77142
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.25796

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SAMark : A Self-Anchored Text Watermarking with Paragraph-Level Paraphrase Robustness Jiahao Huo 2 3 , Wenjie Qu 4 , Yibo Yan 2 1 , Kening Zheng 3 , Jiaheng Zhang 4 , Xuming Hu 2 1 , Philip S. Yu 3 , Mingxun Zhou 1 🖂 Abstract Semantic-level watermarking (SWM) improves robustness against text modifications by treating sentences as the basic unit. However, robustness to paragraph-level paraphrasing remains difficult because such attacks globally disrupt watermark signals by changing sentence order. In this work, we propose SAMark , a self-anchored watermarking framework that removes the dependency on sentence order by establishing a step-independent green region in semantic space. To improve detectability, we introduce a multi-channel hyperbolic scoring mechanism that amplifies watermark signals while suppressing noise from weakly aligned candidates. We further propose a diversity-aware filtering strategy that combines hard filtering with soft regularization, extending beyond simple n-gram repetition filters to address semantic redundancy. Experimental results show that SAMark achieves up to 90.2% TP@FP1% under typical paragraph-level paraphrasing attacks, outperforming the strongest prior baseline by more than 30% on average, while maintaining generation quality competitive with unwatermarked text and breaking the robustness-quality trade-off that limits prior methods. I Introduction The rapid advancement of generative AI (GenAI) has transformed content creation across many domains, from education to software development. Yet the growing ability of these models to produce realistic and persuasive content has also raised concerns about authenticity, attribution, and misuse. LLM watermarking, which embeds imperceptible yet algorithmically detectable signals into model outputs to identify AI-generated text, has emerged as a promising way to mitigate such risks. During generation, watermarking subtly modifies model outputs while preserving meaning and fluency, embedding a hidden, consistent signal that serves as a verifiable marker of GenAI origin. The watermark can later be detected from the generated output, enabling verification without relying on inherent statistical artifacts of the language model and offering a more resilient way to distinguish machine-generated content from human-authored work. In practical use, AI-generated text is rarely kept unchanged. Users often edit, shorten, or paraphrase generated drafts to match a target style, format, or audience. A watermarking scheme for text traceability therefore needs to preserve its signal under these routine modifications. Currently, most existing watermark methods fall into two categories, namely token-level watermarking and semantic-level watermarking. Token-level Watermarking. Token-level watermarking (TWM) schemes for LLMs have been widely studied. Green-Red schemes [ 20 , 42 ] assign tokens to keyed green and red subsets and bias sampling toward green tokens; the detector then tests whether the generated text contains an unusually high fraction of green tokens. This mechanism provides a simple statistical signal, but it changes the original sampling distribution of the LLM and can degrade text quality [ 17 ] . Distortion-free methods, including Gumbel Watermarking [ 1 ] and PRC-based pseudorandom error-correcting schemes [ 6 ] , reduce this distributional distortion and provide theoretical guarantees on text quality. However, their guarantees mainly address generation quality rather than edit robustness. Local modifications such as word deletion, substitution, and paraphrasing can still remove or dilute token-level evidence, which limits the reliability of TWM in adversarial or post-edited settings [ 15 ] . Fig. 1: Comparison between step-dependent watermarks and SAMark . Semantic-level Watermarking. To improve robustness to such attacks, semantic-level watermarking (SWM) approaches, such as SemStamp [ 15 , 16 , 8 ] , treat a semantically complete sentence as the basic watermarking unit. These methods use rejection sampling to ensure that generated sentences fall within a valid semantic region of the embedding space, analogous to the green list in Green-Red watermarking. Recently, PMark [ 18 ] increased watermark density in SWM by applying multi-channel constraints during sampling, further improving robustness against sentence-level paraphrasing attacks. Despite these efforts, current SWM methods still rely on context hashing or fixed private keys to partition green and red regions during sampling [ 15 , 16 , 18 ] . This reliance makes them vulnerable to paragraph-level paraphrasing attacks (PPA), which can globally disrupt watermark signals by changing sentence order. Achieving robustness to PPA has long been regarded as an intractable problem in the community [ 18 ] . TABLE I: Qualitative comparison of representative watermarking methods across the three desired properties. Quality – AvgRank \Delta vs. unwatermarked: ★★★ ( \Delta\!\leq\!-0.5 ), ★★ ( |\Delta|\!\leq\!0.5 ), ★ ( \Delta\!>\!0.5 ). Robustness – TP@FP1% under PPA: ★★★ ( \geq\!70\% ), ★★ ( 30\!-\!70\% ), ★ ( <\!30\% ). Efficiency – sampled tokens per output token relative to KGW; lower is better. Method Text Quality Robustness Token Cost KGW [ 20 ] ★ ★★ 1x SynthID [ 9 ] ★★★ ★ 1x SemStamp [ 15 ] ★★ ★★ 64x PMark [ 18 ] ★★★ ★★ 100x SAMark (Ours) ★★★ ★★★ 47x The limitations of TWM and SWM discussed above reflect a broader set of practical requirements that the community has gradually converged on. Specifically, several desirable properties have emerged. First, the detector for a watermarking scheme should accurately distinguish LLM-generated and human-written content, meaning that it should be unlikely to flag content produced independently of the watermarking keys as watermarked (usually measured by TP@FP1%). Second, the watermark should not degrade the model’s generation quality. In practice, the quality of watermarked text should remain competitive with that of unwatermarked content. Furthermore, watermark detectability should remain robust under adversarial attacks, so a high TP@FP1% is desirable even for modified or paraphrased outputs. Finally, the watermarking scheme should be efficient and incur minimal latency overhead, enabling practical deployment in LLM services. We summarize a qualitative comparison of representative watermarking methods across the three desired properties in Table I . Is a PPA-robust SWM method possible? Given the status quo, we ask the following question: Can we develop a high-quality semantic-level watermarking scheme that is inherently robust to paragraph-level paraphrasing attacks? An affirmative answer would reshape the practical landscape of SWM. Specifically, our goal is to realize an SWM method that is robust and quality-preserving, thereby enabling practical deployment in LLM services. I-A Our Contribution Our first insight is that the vulnerability to paragraph-level paraphrasing attacks of most existing watermarking schemes and their variants [ 20 , 9 , 15 , 18 ] stems from their reliance on step-dependent random seeds. We show that the intrinsic semantic content of each unit is the most reliable invariant under such attacks, motivating a shift away from step-dependent seed generation. Fig. 2: Illustration of semantic-level watermark and unwatermarked semantic distribution. Our second insight is based on the observation that concentrated watermark scores in semantic-level watermarking can degrade detectability under attacks, as shown in Figure 2 . Such concentration increases the risk of sign flips under paraphrasing attacks, posing a direct threat to PPA robustness. We therefore argue that avoiding this concentration near the region boundary is essential for robustness. In practice, we incorporate a hyperbolic sampling strategy into our pipeline to achieve this goal (see Section III-B ). Self-anchored Paradigm. Building on these insights, our main technical contribution is SAMark , a novel self-anchored watermarking framework. The core of our method is to eliminate step dependence by establishing a step-independent green region within semantic space. By making the random seed depend solely on the unit’s own semantics, we ensure

Read the complete text