Distilling the Thought, Watermarking the Answer: A Principle Semantic Guided Watermark for Large Reasoning Models
Shuliang Liu, Xingyu Li, Hongyi Liu, Yibo Yan, Bingchen Duan, Qi Zheng, Dong Fang, Lingfeng Su, Xuming Hu · 2026
Read Distilling the Thought, Watermarking the Answer: A Principle Semantic Guided Watermark for Large Reasoning Models by Shuliang Liu, Xingyu Li, Hongyi Liu, Yibo Yan, Bingchen Duan, Qi Zheng, Dong Fang, Lingfeng Su, Xuming Hu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-05144.txt.
Introduction
Watermarking the output of reasoning models is tricky, because random token tweaks can wreck the logic mid-chain. Shuliang Liu and 8 co-authors present ReasonMark in a 2026 paper, a watermarking framework built specifically for reasoning-heavy language models. Token-based watermarking applies pseudo-random biases that corrupt reasoning flow, while semantic-aware alternatives add heavy latency or need auxiliary models, both painful in deployed systems.
ReasonMark splits output into two phases: thinking left untouched, and an answer that carries the watermark. It distills the thought first and watermarks only the final answer. The design follows a principle of semantic guidance to keep quality high. Provenance marking for AI text matters for accountability, and reasoning models need a version that does not sabotage their main selling point.
Catalog record
| CREATOR | Shuliang Liu, Xingyu Li, Hongyi Liu, Yibo Yan, Bingchen Duan, Qi Zheng, Dong Fang, Lingfeng Su, Xuming Hu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 75 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-05144
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Distilling the Thought, Watermarking the Answer: A Principle Semantic Guided Watermark for Large Reasoning Models Shuliang Liu, Xingyu Li, Hongyi Liu, Yibo Yan, Bingchen Duan, Qi Zheng, Dong Fang, Lingfeng Su, Xuming Hu Abstract Reasoning Large Language Models (RLLMs) excelling in complex tasks present unique challenges for digital watermarking, as existing methods often disrupt logical coherence or incur high computational costs. Token-based watermarking techniques can corrupt the reasoning flow by applying pseudo-random biases, while semantic-aware approaches improve quality but introduce significant latency or require auxiliary models. This paper introduces ReasonMark , a novel watermarking framework specifically designed for reasoning-intensive LLMs. Our approach decouples generation into an undisturbed Thinking Phase and a watermarked Answering Phase. We propose a Criticality Score to identify semantically pivotal tokens from the reasoning trace, which are distilled into a Principal Semantic Vector (PSV). The PSV then guides a semantically-adaptive mechanism that modulates watermark strength based on token-PSV alignment, ensuring robustness without compromising logical integrity. Extensive experiments show ReasonMark surpasses state-of-the-art methods by reducing text Perplexity by 0.35, increasing translation BLEU score by 0.164, and raising mathematical accuracy by 0.67 points. These advancements are achieved alongside a 0.34% higher watermark detection AUC and stronger robustness to attacks, all with a negligible increase in latency. This work enables the traceable and trustworthy deployment of reasoning LLMs in real-world applications. * * footnotetext: Corresponding authors. 1 introdution Large Language Models (LLMs) have demonstrated remarkable advancements in recent years, achieving state-of-the-art performance across a multitude of domains including information retrieval ( 27 ; 75 ; 22 ; 16 ; 69 ) , medical diagnosis ( 74 ) , financial analysis ( 31 ; 43 ) , legal assistance ( 26 ; 10 ) , academic research ( 33 ; 48 ) , and speech processing ( 13 ) . More recently, a new wave of models, exemplified by systems like ChatGPT-4o ( 20 ) and DeepSeek-V2 ( 12 ) , have showcased superior capabilities in complex reasoning tasks such as mathematical problem-solving, strategic planning, code generation, and scientific discovery ( 12 ; 47 ; 63 ; 64 ; 35 ) . These reasoning-intensive LLMs often employ distinct training paradigms and inference mechanisms, such as internal monologues or chain-of-thought (CoT) prompting ( 62 ) , which differentiate them significantly from their predecessors. The burgeoning capabilities and widespread adoption of LLMs, particularly those adept at reasoning, necessitate robust mechanisms for ensuring content authenticity, traceability, and intellectual property protection. Digital watermarking ( 24 ) has emerged as a promising technique to invisibly embed identifiable signals within model-generated text, thereby enabling source tracking and mitigating misuse ( 1 ; 4 ; 14 ) . However, existing watermarking algorithms, largely developed for general-purpose LLMs, face significant challenges when applied to reasoning-based models. For instance, methods like KGW ( 24 ) , which rely on pseudo-random vocabulary partitioning, can inadvertently disrupt the logical consistency of the model’s internal reasoning—the thinking phase —thereby compromising the coherence and accuracy of the final answer. Other approaches that focus on preserving text quality, such as unbiased sampling techniques ( 17 ) , often do so at the cost of detection efficiency. Conversely, methods like EWD ( 44 ) and SWEET ( 29 ) , while achieving higher detection rates, may introduce perceptible artifacts that degrade text quality. More sophisticated strategies like WaterMax ( 11 ) , which perform multiple generation runs to find optimally watermarked outputs, achieve a better balance but incur substantial computational overhead and increased inference latency. This persistent trade-off among text quality, watermark detectability, and computational efficiency has hindered the practical deployment of watermarking in many real-world applications ( 38 ; 18 ) . To address these challenges, we introduce ReasonMark , a novel watermarking framework specifically designed for large reasoning models, centered on the principle of Distilling the Thought, Watermarking the Answer , as illustrated in Fig. 1 . Our approach decouples the generation process into two distinct stages: an undisturbed internal Thinking Phase, where the model performs its reasoning, and a subsequent Answering Phase, where the final response is generated. The core innovation lies in preserving the integrity of the thinking phase entirely. We analyze it to identify a set of Criticality Tokens (CTs) that encapsulate the most salient semantic anchors of the reasoning process. These tokens are then distilled into a continuous vector representation, the Principal Semantic Vector (PSV) , which serves as a dynamic semantic compass for the answering phase. The PSV guides a semantically-adaptive watermarking mechanism, where the watermark strength applied to candidate tokens is modulated by their alignment with the model’s established reasoning trajectory. By aligning the watermark with the model’s own logical flow, ReasonMark can embed a robust and detectable signal without disrupting coherence or accuracy. This effectively resolves the debilitating trade-off between watermark strength and semantic integrity, all while avoiding the additional inference latency common in other semantic-aware techniques. Our main contributions are threefold: • We propose a novel two-phase watermarking framework that decouples a model’s internal reasoning from its final answer generation. This is the first approach specifically designed to protect the outputs of RLLMs without corrupting their logical integrity. • We design a principled method to distill the semantic essence of the model’s reasoning process, involving a Criticality Score to identify key tokens and their subsequent transformation into a PSV that provides a continuous, directional guide for watermarking. • Extensive experiments show ReasonMark surpasses baselines by reducing text PPL by 0.35, increasing translation BLEU score by 0.164, and raising mathematical accuracy by 0.67 points, while also improving detection AUC by 0.34% with negligible latency. 2 Preliminary In this section, we introduce token-based and semantic-based watermarking methods, outlining their respective strengths and limitations. We then formalize the framework of our proposed algorithm and define its key concepts. Related Work. Existing LLM watermarking research is primarily divided into token-based and semantic-based approaches. Token-based methods, such as the seminal work by 24 , partition the vocabulary and apply a statistical bias during generation ( 17 ) . While effective for detection, their pseudo-random nature can disrupt the logical flow and semantic consistency crucial for reasoning tasks ( 68 ; 4 ) . Adaptive watermark strength methods like ( 61 ) balance the effectiveness-quality trade-off at the list level but ignore the intra-list importance of individual tokens. Conversely, semantic-based methods operate in the embedding space to improve text quality and robustness against paraphrasing ( 55 ; 14 ; 19 ) . However, they often introduce significant computational overhead by requiring auxiliary models or architectural modifications ( 2 ) , and are not specifically tailored to preserve the step-by-step integrity of complex reasoning ( 8 ) . Our PSV-guided watermarking framework bridges this gap by distilling the reasoning phase into a continuous Principal Semantic Vector, which dynamically modulates watermark strength based on token-PSV alignment. This approach ensures the watermark is semantically coherent, thus preserving logical integrity—a key weakness of token-based methods—while maintaining high detection efficiency and avoiding the extra inference costs typical of many semantic-aware techniques ( 2 ) . A more comprehensive review of related work is available in Appendix B . Phase Segmentation. Let T=\{t_{1},t_{2},...,t_{S}\} denote the full sequence of S tokens generated by a language model. We partition T