VocBulwark: Towards Practical Generative Speech Watermarking via Additional-Parameter Injection
Weizhi Liu, Yue Li, Zhaoxia Yin · 2026
Read VocBulwark: Towards Practical Generative Speech Watermarking via Additional-Parameter Injection by Weizhi Liu, Yue Li, Zhaoxia Yin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22556.txt.
Introduction
Weizhi Liu, Yue Li, and Zhaoxia Yin hide a proof of origin inside generated speech without spoiling its sound. Synthetic speech now sounds fully human, which raises the risk of misuse. Their 2026 preprint, VocBulwark, notes that past marks trade sound quality against strength, by noise overlay or deep model edits.
Their method injects a small set of added parameters instead. The mark aims to survive edits while the voice stays clean. Sound, lasting marks help platforms trace fake audio. The work seeks both goals at once. It is a guard for the voice era.
Catalog record
| CREATOR | Weizhi Liu, Yue Li, Zhaoxia Yin |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 105 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-22556
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
VocBulwark: Towards Practical Generative Speech Watermarking via Additional-Parameter Injection Weizhi Liu, Yue Li, Zhaoxia Yin Abstract Generated speech achieves human-level naturalness but escalates security risks of misuse. However, existing watermarking methods fail to reconcile fidelity with robustness, as they rely either on simple superposition in the noise space or on intrusive alterations to model weights. To bridge this gap, we propose VocBulwark, an additional-parameter injection framework that freezes generative model parameters to preserve perceptual quality. Specifically, we design a Temporal Adapter to deeply entangle watermarks with acoustic attributes, synergizing with a Coarse-to-Fine Gated Extractor to resist advanced attacks. Furthermore, we develop an Accuracy-Guided Optimization Curriculum that dynamically orchestrates gradient flow to resolve the optimization conflict between fidelity and robustness. Comprehensive experiments demonstrate that VocBulwark achieves high-capacity and high-fidelity watermarking, offering robust defense against complex practical scenarios, with resilience to Codec regenerations and variable-length manipulations. 1 Introduction Speech synthesis has been propelled by Generative Adversarial Networks (GANs) ( 15 ) and Diffusion Models ( 18 ; 42 ) , achieving fidelity near indistinguishable from human speech. However, this realism empowers adversaries to exploit deepfakes for fraud and disinformation, prompting regulators worldwide to enact stringent mandates on traceability ( 9 ; 37 ; 44 ) . As vocoders serve as the unified waveform generator across heterogeneous pipelines (e.g., Text-to-Speech (TTS) ( 48 ; 30 ) and Large Audio Language Models ( 8 ; 14 ) ), watermarking this pivotal stage offers a universally effective solution for regulating speech synthesis ( 54 ) . Figure 1 : Schematic comparison of generative watermarking paradigms and robustness evaluation. The left panel contrasts our VocBulwark (an Additional-Parameter Injection strategy) against prevalent baselines, including Weight Embedding, Model Fine-tuning, and Input Modification. The right panel visualizes the comparative robustness of these strategies across diverse attack scenarios. Speech watermarking methods have evolved from traditional frequency-domain embedding ( 38 ; 53 ; 31 ) to deep learning-based Encoder-Noise-Decoder (END) frameworks targeting content protection ( 2 ; 40 ; 28 ; 16 ) . However, these post-hoc approaches remain limited to content tracking, failing to authenticate the generative source and safeguard model intellectual property (IP). To bridge this gap, generative watermarking has emerged to safeguard model IP by coupling watermarks with the generation process. As illustrated in Fig. 1 , existing watermarking strategies fall into three categories: \mathrm{(i)} Weight Embedding , modifying internal weights of model ( 13 ) , \mathrm{(ii)} Model Fine-tuning , leveraging pre-trained END frameworks to guide fine-tuning ( 5 ; 55 ; 39 ) , and \mathrm{(iii)} Input Modification , superimposing watermarks onto model inputs ( 29 ) . The aggressive tokenization mechanisms of neural Codecs discretize speech signals while temporal edits invalidate synchronization patterns. These practical threats precipitate a critical dilemma in current generative watermarking, in which existing paradigms fail to reconcile fidelity and robustness. Strategies relying on Input Modification execute a simple and one-time combination within the noise space, resulting in a superficial addition that is effectively detached from semantic content and thus easily purged by reconstruction processes. Conversely, Weight Embedding and Model Fine-tuning fundamentally constitute intrusive alterations to the native parameter space that inevitably disrupt the model’s original capability, thereby compromising generation quality to improve watermarking performance. In contrast, while auxiliary modules thrive in image generation ( 12 ; 26 ; 36 ; 7 ; 50 ) , adapting them to speech is non-trivial due to speech’s inherent sensitivity to phase and temporal perturbations. To overcome these limitations, we propose VocBulwark , an innovative additional-parameter injection watermarking method that establishes a reliable regulatory mechanism for heterogeneous generative model architectures, as illustrated in Fig. 1 . We design the Temporal Adapter , a lightweight module that leverages Acoustic Feature Alignment and Frame-level Temporal Broadcasting to intimately integrate the watermark with intrinsic acoustic attributes while keeping native parameters frozen, thereby ensuring high fidelity while mitigating synchronization dependencies against variable-length attacks. In coordination with this, our Coarse-to-Fine Gated Extractor utilizes Multi-scale Feature Aggregation and Dual-path Pooling to capture subtle watermarking artifacts for robust recovery under severe regeneration and distortion. In addition, addressing the training instability common in multi-objective tasks, we devise an Accuracy-Guided Optimization Curriculum that adaptively adjusts the learning trajectory to harmonize extraction with generation fidelity. Our contributions can be summarized as follows: • We propose VocBulwark, an innovative additional-parameter injection watermarking framework that establishes a reliable, low-overhead mechanism for model provenance and content regulation across heterogeneous generative architectures. • We propose a Temporal Adapter that uses Acoustic Feature Alignment and Frame-level Broadcasting to achieve temporally invariant embedding in the acoustic space, alongside a Coarse-to-Fine Gated Extractor that leverages Multi-scale Aggregation and Dual-path Pooling to ensure accurate extraction. • We devise an Accuracy-Guided Optimization Curriculum that resolves the multi-objective conflict via a simple-to-complex trajectory, progressively shifting the focus from watermark establishment to fidelity refinement to balance the trade-off between recovery accuracy and perceptual quality. • Comprehensive experiments demonstrate that our method yields high-quality watermarked speech while exhibiting superior robustness against variable-length attacks and neural Codec regeneration attacks. 2 Related Work Post-hoc Watermarking. Existing approaches can be categorized into handcrafted-based and deep learning-based methods. The former relied on handcrafted algorithms embedding signals into frequency domains for copyright protection ( 38 ; 53 ; 31 ) . Conversely, deep learning-based methods have significantly bolstered defense capabilities. Specifically, 2 achieved watermark localization via invertible neural networks, while 40 leveraged Codecs for proactive defense against voice cloning. Furthermore, 28 introduced timbre watermarking for cloning detection, and 27 proposed an END framework resilient to re-recording. While effective against signal-level attacks, these approaches remain confined to content attribution , whereas our work extends protection to model provenance , establishing a reliable mechanism for safeguarding IP. Generative Watermarking. Regarding Weight Embedding, 13 utilized mask training to identify convolutional kernels prior to the actual watermark embedding. In the realm of Model Fine-tuning, 55 pre-trained the watermarked tokenizer of the model to guide the subsequent entire model fine-tuning. In parallel, 39 and 5 leveraged pre-trained END frameworks to watermark training data or guide the fine-tuning process, respectively. For Input Modification, 29 superimposed the encoded watermark latent variable directly onto the model input for synthesis. In contrast, our VocBulwark fuses the watermark into the acoustic space via TA, guaranteeing intrinsic robustness against distortions. Crucially, by implementing this via additional-parameter injection under frozen native parameters, our method preserves the perceptual quality. 3 Threat Model We consider a threat model involving three primary entities: the User, the Model Provider, and the Adversary. Users’ Ability and Goal. Users interact with the platform to create speech content. Specifically, a user queries the TTS service with a text prompt \mathbf{m} . The acoustic model \mathcal{M} first converts \mathbf{m} into acoustic features \mathbf{c}=\mathcal{M}(\mathbf{m}) (e.g., mel-spectrograms). Subsequently, the vocoder \mathcal{G}_{\psi} synthesizes the raw waveform \overline{\mathbf{s}}=\mathcal{G}_{\psi}(\mathbf{m})\in\mathbb{R}^{L} , where L denotes the number of samples. This process can be formulated as: \overline{\mathbf{s}}=\text{TTS}(\mathbf{m})=\mathcal{G}_{\psi}(\mathcal{M}(\mathbf{m}))\in\mathbb{R}^{L}, (1) The user’s primary objective is to obtain high-fidelity speech \overline{\mathbf{s}} for personal or commercial applications. Model Provider’s Ability and Goal. To establish model provenance and enforce content regulation, the Model Provider seeks to reliably bind disseminated content to its source model. The provider assigns a unique watermark identifier \mathbf{w} (e.g., model information or license ID) to each specific model instance utilizing the