Who Gets Flagged? The Pluralistic Evaluation Gap in AI Content Watermarking

Alexander Nemecek, Osama Zafar, Yuqiao Xu, Wenbiao Li, Erman AydayCase Western Reserve University, {ajn98, oxz23, yxx914, wxl387, exa208}@case.edu · 2026

Read Who Gets Flagged? The Pluralistic Evaluation Gap in AI Content Watermarking by Alexander Nemecek, Osama Zafar, Yuqiao Xu, Wenbiao Li, Erman AydayCase Western Reserve University, {ajn98, oxz23, yxx914, wxl387, exa208}@case.edu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-13776.txt.

Introduction

Nemecek and four colleagues expose a fairness gap in AI content watermarking. How strong a watermark is, how easy it is to spot, and how well it holds up depend on the content itself. Content differs by language, by cultural visual tradition, and by demographic group. Yet reviewing major benchmarks for text, image, and audio, they find almost none report results across those groups. They propose three checks: parity of detection across languages, broad cultural coverage, and metrics split by group. Evaluation, they argue, must precede deployment.

Catalog record

CREATORAlexander Nemecek, Osama Zafar, Yuqiao Xu, Wenbiao Li, Erman AydayCase Western Reserve University, {ajn98, oxz23, yxx914, wxl387, exa208}@case.edu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22369
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.13776

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Who Gets Flagged? The Pluralistic Evaluation Gap in AI Content Watermarking Alexander Nemecek, Osama Zafar, Yuqiao Xu, Wenbiao Li, Erman AydayCase Western Reserve University, {ajn98, oxz23, yxx914, wxl387, exa208}@case.edu Abstract Watermarking is becoming the default mechanism for AI content authentication, with governance policies and frameworks referencing it as infrastructure for content provenance. Yet across text, image, and audio modalities, watermark signal strength, detectability, and robustness depend on statistical properties of the content itself, properties that vary systematically across languages, cultural visual traditions, and demographic groups. We examine how this content dependence creates modality-specific pathways to bias. Reviewing the major watermarking benchmarks across modalities, we find that, with one exception, none report performance across languages, cultural content types, or population groups. To address this, we propose three concrete evaluation dimensions for pluralistic watermark benchmarking: cross-lingual detection parity, culturally diverse content coverage, and demographic disaggregation of detection metrics. We connect these to the governance frameworks currently mandating watermarking deployment and show that watermarking is held to a lower fairness standard than the generative systems it is meant to govern. Our position is that evaluation must precede deployment, and that the same bias auditing requirements applied to AI models should extend to the verification layer. 1 Introduction Watermarking is becoming the default mechanism for AI content authentication with governance acting accordingly. The European Union AI Act European Parliament and Council of the European Union 2024 , United States Executive Order 14110 Executive Office of the President 2023 , and China’s Measures for Labeling AI-Generated Synthetic Content Cybersecurity Administration, Ministry of Industry and Information Technology, Ministry of Public Security, State Administration of Radio and Television 2025 all reference watermarking as infrastructure for content provenance. Major platforms including Google Google DeepMind 2026 , Meta Meta FAIR 2026 , and OpenAI OpenAI 2023 have deployed watermarking across their generative products. Yet as adoption accelerates on both regulatory and industry fronts, a question has gone largely unasked: who do these systems disproportionately affect? The question matters because watermarking is not a neutral stamp applied uniformly to all content. Across modalities, watermark signal strength, detectability, and robustness depend on statistical properties of the content itself Piet et al. 2025 ; An et al. 2024 ; Liu et al. 2024 . These properties vary systematically across languages, cultural visual traditions, and linguistic communities Liu et al. 2024 ; Michel et al. 2025 . If watermarking becomes the primary mechanism by which AI-generated content is authenticated, then biased watermarking produces biased authentication. Current evaluation practice is not equipped to surface this problem. Watermark benchmarks focus almost exclusively on detectability, robustness to adversarial attack, output quality preservation, and computational overhead Liu et al. 2024 ; Piet et al. 2025 ; Tu et al. 2024 ; Liang et al. 2024 ; An et al. 2024 ; Jiang et al. 2025 ; Lu et al. 2024 . None of which are evaluated under implicitly monocultural assumptions Agnew et al. 2024 ; Mohamed and Gubri 2025 . Yet early evidence already demonstrates cause for concern: under identical conditions, watermark detection rates vary significantly across linguistic communities, with disparities arising structurally from the embedding mechanism rather than the detector Xie et al. 2025 ; Xie 2025 . The multimodal AI community has devoted large efforts to ensuring that model outputs respect cultural diversity, from addressing geographic bias in text-to-image generation Hall et al. 2024 to evaluating vision-language models across non-Western contexts Nayak et al. 2024 . This paper argues that the same scrutiny must extend to the verification layer. We analyze how watermarking creates content-dependent pathways to bias across text, image, and audio modalities, documenting existing disparities where empirical evidence exists and identifying structural risk factors where evaluation is absent. We then propose concrete evaluation dimensions for pluralistic watermark benchmarking and connect these to the governance frameworks that are mandating watermarking deployment without requiring fairness evaluation. 2 Background: How Watermarking Works Across Modalities Across modalities, watermarking follows the shared design pattern, where a statistical signal is embedded into AI-generated content during or after generation, and a detector later recovers that signal to verify provenance Zhao et al. 2025 . In all cases, the strength and detectability of the watermark depend on properties of the content itself. This content dependence is what makes watermarking effective, but it is also what makes it vulnerable to systematic bias when content properties vary across languages, cultures, and communities. Text. The dominant approach to text watermarking modifies the token sampling process during generation Kirchenbauer et al. 2023 ; Dathathri et al. 2024 ; Nemecek et al. 2024 , with alternative methods operating post-hoc through synonym substitution Chang et al. 2024 or syntactic restructuring Rizzo et al. 2016 . Despite these differences in embedding strategy, detection in all cases depends on the statistical properties of the generated text, particularly on the entropy of the token distribution at each step Piet et al. 2025 ; Wu et al. 2025 . The more plausible next tokens available at a given position, the more room the watermark has to bias selection without degrading quality; in low-entropy contexts, the signal weakens. Images. Image watermarking operates through two main paradigms: latent-space methods that embed signals during the diffusion sampling process Wen et al. 2023 ; Yang et al. 2024 , and post-hoc methods to embed a payload into pixel data after generation Gowal et al. 2025 ; Tancik et al. 2020 ; Bui et al. 2025 ; Al-Haj 2007 ; Gunjal and Mali 2011 . In both cases, the watermark signal is encoded in frequency-domain representations where imperceptibility is maximized and robustness to compression and geometric transformations is optimized. The density of high-frequency detail, color distributions, texture complexity, and spatial structure all influence embedding and detection Qiu et al. 2024 . Audio. Audio watermarking systems such as AudioSeal Roman et al. 2024 embed imperceptible signals in the waveform, with detection relying on accurate recovery of the embedded payload under transformations like noise injection, speed modification, and re-encoding Chen et al. 2023 . As with image watermarking, the signal operates in the frequency domain, meaning that the acoustic properties of the speech (i.e., pitch, spectral energy distribution, prosodic contour) shape how the watermark is embedded and recovered Özer et al. 2025 . 3 Pluralistic Failures Across Modalities The evaluation landscape for watermarking reveals a consistent pattern in which fairness is treated as out of scope. Table 1 summarizes the pluralistic evaluation dimensions of major watermarking benchmarks across text, image, audio, and video. With a single exception, none report performance across languages, cultural content types, or demographic groups. The evidence that follows is accordingly tiered, moving from documented disparate impact in text, to structurally likely but untested bias in images, to a near-complete evaluation vacuum in audio. This pattern is not coincidental. It reflects a field that has optimized for robustness and quality while assuming uniformity across the populations its systems will affect. Table 1 : Pluralistic evaluation of watermarking benchmarks. Multilingual/Cross-cultural indicates whether evaluation includes non-English languages or non-Western content. Demographic Reporting indicates whether detection metrics are disaggregated by population group. Benchmark Modality Multilingual/Cross-cultural Demographic Reporting Bias Discussed MarkMyWords Piet et al. 2025 Text ✗ ✗ ✗ WaterBench Tu et al. 2024 Text ✗ ✗ ✗ WaterPark

Read the complete text