BiMarker: Enhancing Text Watermark Detection for Large Language Models with Bipolar Watermarks

Zhuang Li, Qiuping Yi, Zongcheng Ji, Yijian LU, Yanqi Li, Keyang Xiao, Hongliang Liang · 2025

Read BiMarker: Enhancing Text Watermark Detection for Large Language Models with Bipolar Watermarks by Zhuang Li, Qiuping Yi, Zongcheng Ji, Yijian LU, Yanqi Li, Keyang Xiao, Hongliang Liang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-12174.txt.

Introduction

Zhuang Li and co-authors present BiMarker, a sharper way to spot text written by large language models. Watermarks hide a faint signal in machine text so it can be flagged later. Weak signals and strict false-alarm limits blunt older schemes. Their 2025 paper splits the marked text into a positive pole and a negative pole. The split sharpens the test without extra computing.

The method needs no knowledge of the prompt that made the text. Math checks and trials back the gain in detection strength. It also pairs well with known tuning tricks for older watermarks. The team frames the two-pole split as a fresh dial for watermark design. Stronger marks could help schools and platforms sort machine text from human work.

Catalog record

CREATORZhuang Li, Qiuping Yi, Zongcheng Ji, Yijian LU, Yanqi Li, Keyang Xiao, Hongliang Liang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-12174

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

BiMarker: Enhancing Text Watermark Detection for Large Language Models with Bipolar Watermarks Zhuang Li, Qiuping Yi, Zongcheng Ji, Yijian LU, Yanqi Li, Keyang Xiao, Hongliang Liang Abstract The rapid growth of Large Language Models (LLMs) raises concerns about distinguishing AI-generated text from human content. Existing watermarking techniques, like KGW , struggle with low watermark strength and stringent false-positive requirements. Our analysis reveals that current methods rely on coarse estimates of non-watermarked text, limiting watermark detectability. To address this, we propose Bipolar Watermark ( BiMarker ), which splits generated text into positive and negative poles, enhancing detection without requiring additional computational resources or knowledge of the prompt. Theoretical analysis and experimental results demonstrate BiMarker ’s effectiveness and compatibility with existing optimization techniques, providing a new optimization dimension for watermarking in LLM-generated content. 1 Introduction In recent years, Large Language Models (LLMs) have revolutionized natural language processing ( OpenAI, 2022 ; Touvron et al., 2023 ; Bubeck et al., 2023 ) , but their widespread adoption has also raised significant concerns. These models can be exploited for malicious purposes, such as generating fake news, fabricating academic papers, and manipulating public opinion through social engineering and disinformation campaigns ( Bergman et al., 2022 ; Jawahar et al., 2020 ) . Additionally, the proliferation of synthetic data on the web complicates dataset curation, as it often lacks the quality of human-generated content and must be carefully filtered during training ( Radford et al., 2023 ) . As a result, developing effective methods to reliably distinguish AI-generated text from human-written content has become a critical and urgent priority ( Bender et al., 2021 ; Crothers et al., 2022 ; Grinbaum & Adomaitis, 2022 ; Wyllie et al., 2024 ) . Figure 1: Illustration of the key idea of BiMarker : Adjust token bias by polarity during generation and detect by the green token difference between polarities. Watermarking techniques offer a solution by enabling LLMs to embed unique, imperceptible identifiers (watermarks) within generated content, distinguishing it from human-written text ( Liu et al., 2024b ; Pan et al., 2024b ) . A prominent method, KGW 1 1 1 Details can be found in Appendix A.2 , achieves high detection performance with low false positive and false negative rates ( Kirchenbauer et al., 2023a ) . KGW works by partitioning the model’s vocabulary into two categories: green and red tokens, with proportions \gamma and 1-\gamma , respectively. The model is then biased towards green tokens by adjusting their logits with a positive constant (watermark strength), ensuring that the generated text predominantly contains green tokens. During detection, KGW assumes that the number of green tokens in non-watermarked text follows a Gaussian distribution \mathcal{N}(\mu,\sigma^{2}) , where \mu=T\cdot\gamma and \sigma^{2}=T\cdot\gamma\cdot(1-\gamma) , with T representing the number of tokens analyzed. The likelihood that the text is watermarked increases as the observed number of green tokens deviates from the expected T\cdot\gamma . In other words, the greater the number of green tokens in the analyzed text exceeds the expected value of T\cdot\gamma for non-watermarked text, the higher the probability that the text is watermarked. Although KGW demonstrated high detection performance, it exhibited weaknesses under more rigorous detection conditions, particularly in low-entropy scenarios ( Lee et al., 2024 ) . Furthermore, it is crucial for detection methods to effectively distinguish between human-written and watermarked text to achieve higher accuracy while minimizing false positives, as false positives are intolerable in many contexts ( Fernandez et al., 2023 ; Lee et al., 2024 ; Kirchenbauer et al., 2023b ) , such as falsely accusing a user of producing fake news or a student of cheating in an exam. A straightforward strategy is to increase watermark strength, which can help address this issue by enhancing the distinguishability between watermarked and non-watermarked texts. However, this improvement often comes at the cost of text quality ( Tu et al., 2023 ) . Recent studies have proposed algorithms aimed at enhancing the statistical significance of detected watermarked text by leveraging its relationship with entropy ( Lee et al., 2024 ; Lu et al., 2024 ) . For example, Lee et al. (2024) introduced a selective watermark detector called SWEET , specifically designed for code generation tasks, to improve watermark detectability in code. This method detects only those tokens that exceed a certain entropy threshold, thereby excluding tokens less likely to be influenced by the watermark generator. However, these algorithms depend on an auxiliary language model for vocabulary partitioning, which proves impractical when the tokenizers of the primary and auxiliary models are inconsistent ( Yoo et al., 2024 ) . Moreover, retrieving entropy values during detection necessitates access to the prompt’s content. While the effectiveness of custom prompts has been demonstrated in code-related tasks ( Lee et al., 2024 ; Lu et al., 2024 ) , applying this approach to general tasks poses significant challenges. Orthogonal to prior work, this paper proposes a novel perspective for enhancing the distinction between watermarked and non-watermarked texts. Our approach is based on the analysis that existing methods often overlook the impact of non-watermarked text distributions across different scenarios on detection outcomes (see Section 3.1 ). Specifically, taking KGW as an example, the held assumption that the number of green tokens in non-watermarked text has an expected value of T\cdot\gamma does not consistently hold across various contexts. In some cases, this assumption undermines detection effectiveness 2 2 2 Appendix A.3 provides an example illustrating the detection challenges arising from inaccurate estimations of non-watermarked text. . For example, in low-entropy scenarios, both watermarked and non-watermarked texts tend to have a similarly small expected number of green tokens. Continuing to assume this fixed value as the expected value for non-watermarked text results in a lack of statistical significance, thereby increasing the risk of failing to effectively distinguish between watermarked and non-watermarked text. To address the challenges posed by inaccurate green token count estimations in non-watermarked text that affect detection results, we propose Bi polar Water Marker (abbreviated as BiMarker ). As illustrated in Figure 1 , the generated text is divided into two components: the positive pole and the negative pole . In the positive pole, the logits of tokens in the green list are increased by adding a positive constant, while in the negative pole, the logits of tokens in the red list are adjusted similarly. For detection, instead of comparing the number of green tokens to the ideal expected count, we calculate the green token counts in both poles and determine their difference. This approach significantly enhances the distinction between watermarked and human-written text. Moreover, through various analyses, we demonstrate that our method is orthogonal to existing techniques that leverage entropy or enhance watermark detection. It can be effectively combined with these optimization techniques in scenarios where entropy can be computed and prompts are available. In summary, the key contributions of our work are summarized as follows: • New Dimension: We reveal the impact of inaccurate estimations of human-written text distributions on detection results, offering a new perspective for enhancing the detectability of watermarks. • New Method: We introduce BiMarker , a novel bipolar watermarking method with differential detection. This approach effectively addresses the challenges posed by the estimation inaccuracies of human-written text distributions,

Read the complete text