SoK: How Robust is Audio Watermarking in Generative AI models?
Yizhu Wen 1 1 , Ashwin Innuganti 2 1 , Aaron Bien Ramos 1 , Hanqing Guo 1 , Qiben Yan 2 · 2025
Read SoK: How Robust is Audio Watermarking in Generative AI models? by Yizhu Wen 1 1 , Ashwin Innuganti 2 1 , Aaron Bien Ramos 1 , Hanqing Guo 1 , Qiben Yan 2 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-19176.txt.
Introduction
Yizhu Wen and co-authors test how well hidden marks in AI-made audio hold up against attack in a 2025 survey. Such marks, called watermarks, can prove where a sound clip came from, expose fake speech, and guard music rights. Makers claim their marks resist removal, but each claim is usually tested against only a few attacks.
The team sorted twenty-two marking schemes, rebuilt nine of them from open code, and hit them with twenty-two kinds of attack in more than a hundred setups. They found eight new attacks that work very well. No scheme survived every distortion across three public data sets. The study gives builders a clear map of where current marks break and what real-world use demands.
Catalog record
| CREATOR | Yizhu Wen 1 1 , Ashwin Innuganti 2 1 , Aaron Bien Ramos 1 , Hanqing Guo 1 , Qiben Yan 2 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 81 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-19176
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SoK: How Robust is Audio Watermarking in Generative AI models? Yizhu Wen 1 1 , Ashwin Innuganti 2 1 , Aaron Bien Ramos 1 , Hanqing Guo 1 , Qiben Yan 2 Abstract Audio watermarking has been used to verify the provenance of AI-generated content from generative models. It spawns a wealth of applications for detecting AI-generated speech, protecting the music IP, and defending against voice cloning attacks. Generally, audio watermarking should be robust against removal attacks that distort the signal to evade detection. Many audio watermarking schemes claim robustness; however, these claims are often validated in isolation against a limited set of attacks. There is no systematic, empirical evaluation of robustness against a comprehensive set of removal attacks in the audio domain. This uncertainty complicates the practical deployment of watermarking schemes. In this paper, we survey and evaluate whether recent audio watermarking schemes claiming robustness can withstand a broad range of removal attacks. First, we propose a taxonomy for 22 audio watermarking schemes. Second, we summarize the audio watermark technologies and their potential vulnerabilities. Third, we conduct a large-scale, comprehensive measurement study to evaluate the robustness of existing watermarking schemes. To facilitate this analysis, we develop an evaluation framework encompassing a total of 22 types of watermark removal attacks (109 different configurations). Our framework covers signal-level distortions, physical-level distortions, and AI-induced distortions. We reproduced 9 watermarking schemes with open-source code and identified 8 new attacks that are highly effective against all watermarks, and discovered 11 key findings that illustrate their fundamental weaknesses across 3 public datasets. Our study reveals critical insights: none of the surveyed watermarking schemes is robust enough to withstand all tested distortions in practice . This extensive evaluation provides a comprehensive view of how well current watermarking schemes perform in the face of real-world threats. Our demo and code are available at https://sokaudiowm.github.io/ . 1 1 footnotetext: Yizhu Wen and Ashwin Innuganti contributed equally to this work. I Introduction Watermarking is a crucial technique for embedding secret information into media to ensure copyright protection, verify content ownership, and detect tampering [ 1 , 2 ] . Audio watermarking embeds imperceptible data within audio signals, such as music, voice recordings, or any digital sound content. This hidden information remains undetectable by human listeners but can be identified by software, providing a method for tracking, verifying, and protecting audio content. With the rise of generative AI models, concerns around copyright protection and deepfake audio detection have grown significantly. AI-generated music and deepfake voices pose new challenges for content security. For instance, in 2023, fake AI-generated songs mimicking popular artists such as Drake and The Weeknd circulated on social media, stirring debates over copyright infringement and the protection of intellectual property (IP) in the music industry [ 3 ] . Furthermore, voice deepfakes have been used for impersonation and financial fraud. In one high-profile case, scammers used AI to generate a deepfake of a CEO’s voice to instruct an employee to transfer $243,000 to a fraudulent account [ 4 ] . Fig. 1: Audio watermarking scenario (detector \rightarrow extractor) To address these concerns, researchers are turning to audio watermarking as a practical solution. When applied to AI-generated content, watermarking can help detect and defend against synthetic attacks, providing a means to verify the authenticity of the audio and distinguish it from human-created content. For human-created audio, watermarking serves to protect IP, ensuring that ownership is preserved and that unauthorized use or tampering can be detected. Fig. 1 demonstrates the process of audio watermarking. First, a watermark generator encodes human-provided bits (e.g., “0101110”) into the audio signal, producing a watermarked audio. A watermark detector then extracts and decodes these bits from the audio, verifying the content’s authenticity. Although audio watermarking shows promise, its robustness in real-world applications hinges on overcoming core challenges. Robustness represents the watermark’s resilience to various modifications, such as compression, noise, format conversion, and other common manipulations, which allows it to be accurately extracted even under these conditions. If the watermark can be easily removed or degraded, its utility as a tool for IP protection and authentication diminishes. Besides robustness, prior work [ 5 , 6 ] emphasized that any watermarking system also needs to keep a high fidelity . In the case of AI-generated content, generative models may produce variations of audio that could inadvertently weaken or obscure the embedded watermark, making detection more difficult. Therefore, designing watermarks that are not only imperceptible but also durable under adversarial conditions is crucial for ensuring long-term effectiveness. Although there are related works, [ 7 ] surveyed audio watermarking schemes only up to 2016, analyzing 15 digital‐level attacks but providing no experimental evaluations. A more recent study [ 8 ] surveyed and reproduced 3 watermarking schemes under 15 attack scenarios, each with 5 different settings, using 2 datasets limited to the speech domain. In this work, we conduct a systematic evaluation and propose a taxonomy for audio watermarking schemes and attacks. To comprehensively assess current methods, we reproduce 9 recently proposed audio watermarking schemes (all with publicly available source code) and test them against 22 distinct black‐box watermark‐removal attacks, each configured with over five parameter settings. We evaluate these schemes based on robustness and fidelity and categorize attacks into three groups: Signal‐Level Distortions , Physical‐Level Distortions , and AI‐Induced Distortions . Our 3 test sets cover both speech and music. • In Signal-Level Distortions , the attacker directly modifies the audio signal (e.g., through noise addition, compression, or format shifting) to erase or degrade the watermark. • In Physical-Level Distortions , the attacker manipulates the environmental sound during audio playback or re-recording to disrupt the watermark’s integrity under real-world device and environmental conditions. • In AI-Induced Distortions , the attacker employs generative models for style transfer or other transformations to extract the unwatermarked version of the audio. As shown in Table I , while all of the investigated watermarks claimed robustness, they mainly focus on Signal-Level Distortion (e.g., applying noise, quantization, format shifting, or compression). One scheme [ 9 ] evaluates the robustness in terms of AI-induced Distortion but is restricted by limited distortion types. None of the evaluated watermarks demonstrate robustness against Physical-Level Distortion ; this raises the question of whether the existing watermark could guarantee applicability in real-life adversarial scenarios. For example, an attacker could play and re-record music with a watermark, facilitating music piracy. Robustness Claims Watermark Signal-Level Physical-Level AI-Induced AudioSeal [ 10 ] Timbre [ 9 ] Wavmark [ 11 ] SilentCipher [ 12 ] audiowmark [ 13 ] RobustDNN [ 14 ] Patchwork [ 15 ] Norm-space [ 16 ] FSVC [ 17 ] TABLE I: Robustness of Existing Audio Watermarking Techniques as Claimed in Literature, means the watermark claims partial robustness against such distortions; indicates that the watermark claims full robustness, and represents that the watermark does not claim robustness. Our Contributions. In this paper, we systematize the state-of-the-art research on audio watermarking and categorize them based on different technical principles. We focus on the potential limitations of the current audio watermark deployed in practical applications. Considering influential factors in real-world usage, we benchmark existing techniques and provide a summary of key observations, unresolved challenges, and future research directions. Specifically, we make the