MerkleSpeech : Public-Key Verifiable, Chunk-Localised Speech Provenance via Perceptual Fingerprints and Merkle Commitments Tatsunori Ono Abstract Speech provenance in practice goes beyond detecting whether a watermark is present. Real workflows involve splicing, quoting, trimming, and platform-level transforms that may preserve some regions while altering others. Neural watermarking systems have made strides in robustness and localised detection [ 1 ] , but most deployments still produce detector outputs with no third-party verifiable cryptographic proof tying a specific time segment to an issuer-signed original. Provenance standards like C2PA do adopt signed manifests and Merkle-based fragment validation [ 2 ] , yet their bindings target encoded assets and tend to break under re-encoding or routine distribution processing. We propose MerkleSpeech , a system specification for public-key verifiable , chunk-localised speech provenance offering two tiers of assurance. The first, a robust watermark attribution layer (WM-only), survives common distribution transforms—resampling, bandpass filtering, moderate noise—and answers “was this chunk issued by a known party?”. The second, a strict cryptographic integrity layer ( MSv1 ), additionally verifies Merkle inclusion of the chunk’s fingerprint under an issuer signature, answering “does this chunk’s fingerprint match the enrolled commitment?”. The system computes perceptual fingerprints over short speech chunks, commits them in a Merkle tree whose root is signed with an issuer key, and embeds a compact in-band watermark payload carrying a random content identifier and chunk metadata sufficient to retrieve Merkle inclusion proofs from a repository. Once the payload is extracted (via a public decoder or an issuer-provided service), all subsequent verification steps—signature check, fingerprint recomputation, Merkle inclusion—use only public information. The result is a splice-aware timeline indicating which regions pass each tier and why any given region fails. We describe the protocol, provide pseudocode, and present experiments targeting very low false positive rates under resampling, bandpass filtering, and additive noise, informed by recent audits that identify neural codecs as a major stressor for post-hoc audio watermarks [ 3 , 4 , 5 ] . 1 Introduction Advances in speech generation and editing have expanded both beneficial applications and the risk of voice-based fraud and misinformation. Proactive audio watermarking has become a useful complement to post-hoc forensic detection; modern learned systems offer improved robustness and, in some cases, localised detection maps [ 1 , 6 , 7 , 8 , 9 ] . But provenance needs often go beyond a binary watermark decision. Audio in the wild gets cropped, concatenated, partially quoted, and spliced, and many platforms apply resampling or re-encoding along the way. Recent benchmarks show that robustness can degrade sharply under certain transformation pipelines, with neural codecs flagged as an especially difficult regime [ 5 , 4 , 3 ] . Meanwhile, provenance initiatives have converged on signed manifests and cryptographic hashing—C2PA Content Credentials being the most prominent example [ 2 , 10 ] . These provide strong integrity for a particular encoded asset and include Merkle-based fragment validation in some configurations [ 2 ] . The trouble is that file- or container-level hashes generally break under benign transforms like transcoding or resampling, unless provenance is re-issued [ 2 , 11 ] . This gap motivates in-band approaches that remain meaningful after typical processing. The question driving this paper is: can we build a practical system that produces cryptographically defensible, chunk-local provenance claims for speech, survives distribution transforms, and supports splice-aware verification? Approach. MerkleSpeech combines four components: (i) deterministic chunk fingerprints; (ii) a Merkle commitment over chunk digests; (iii) an issuer signature over the root; and (iv) an in-band watermark payload carrying a compact pointer that lets any verifier retrieve proofs and check any chunk using only public information. Two verification tiers fall out of this design: WM-only (watermark payload recovery) provides robust attribution that survives common distribution transforms, while MSv1 (full Merkle inclusion plus signature) gives strict integrity assurance that flags any post-enrollment modification. The gap between the two tiers is itself informative: a chunk that passes WM-only but fails MSv1 has been altered since enrollment. Contributions. • Public-key verifiable, chunk-local speech provenance. A protocol authenticating individual time chunks via Merkle inclusion proofs anchored by an issuer signature. The output is a splice-aware verification map over the audio timeline. • Pluggable perceptual commitment layer. We describe two fingerprint options for speech chunks—SSL-embedding quantisation and a deterministic spectral baseline—together with a commitment construction that binds chunking parameters to prevent substitution attacks. The choice of fingerprint function governs the robustness–integrity trade-off; here we evaluate a strict MFCC baseline and discuss transform-tolerant alternatives. • Streaming-capable watermark channel and repository workflow. A versioned payload format with ECC, paired with a repository design that avoids embedding large proofs in-band while still supporting third-party verification. • Rigorous evaluation. Metrics and stress tests targeting extremely low false positive rates, localisation under splices, and robustness categories drawn from recent benchmarks and audits [ 5 , 3 ] . Figure 1: MerkleSpeech overview. Enrollment: chunk audio, compute chunk fingerprints, build Merkle tree, sign root, publish manifest and inclusion proofs. Distribution: embed compact in-band payload per chunk. Verification: decode payload, fetch manifest and proofs, verify signature and Merkle inclusion per chunk, then aggregate to a splice-aware timeline. 2 Related Work Neural post-hoc speech/audio watermarking. A growing body of work learns an embedder–detector pair, often trained end-to-end with differentiable augmentations. AudioSeal [ 1 ] introduced localised watermarking for proactive voice-cloning detection. WavMark [ 6 ] , SilentCipher [ 8 ] , IDEAW [ 7 ] , and MaskMark [ 9 ] explore various robustness–capacity trade-offs, while other lines of work target timbre-specific watermarking for cloning detection [ 12 ] , discrete intermediate representations [ 13 ] , cross-attention retrieval [ 14 ] , and key-enrichment strategies [ 15 ] . What these systems share is a focus on imperceptibility, robustness, and localisation. What they generally lack is a public-key verifiable cryptographic proof of segment membership tied to an issuer-signed commitment. Robustness audits and benchmarks. Standardised benchmarking reveals wide variation in robustness across methods and attack types [ 5 ] . In particular, audits have shown that learned enhancement pipelines and neural codecs can severely degrade post-hoc audio watermark performance [ 4 , 3 ] . These findings argue for treating neural codecs as first-class stress conditions rather than assuming robustness holds out of the box. Fingerprint-based integrity verification. Closely related work on speech integrity via embedded fingerprints includes SpeeCheck [ 16 ] and SpeechVerifier [ 17 ] . Classic audio fingerprinting à la Shazam [ 18 ] offers time-localisable descriptors robust to common distortions, and engineering baselines like Chromaprint [ 19 ] produce deterministic audio fingerprints. MerkleSpeech shares their spirit but places greater emphasis on public-key verifiability and repository-backed Merkle inclusion proofs , aiming to support third-party provenance workflows that go beyond self-contained consistency checks. Provenance standards and manifest approaches. C2PA defines signed manifests with hashing-based bindings and, in certain settings, Merkle-based fragment validation [ 2 , 10 ] . Work on broadcast provenance [ 11 ] combines open standards, metadata, watermarking, and cryptography, with discussion of piecewise validation. MerkleSpeech complements these efforts by binding provenance to robust chunk fingerprints and carrying an in-band pointer, so that provenance can survive re-encoding or metadata stripping. Publicly verifiable watermarking protocols. Puppy [ 20 ] explores how to transform symmetric watermark verification into publicly verifiable verification using secure hardware or secure computation. MerkleSpeech targets a lighter-weight flow—signature verification plus Merkle inclusion proofs—paired with a robust watermark channel for discovery and indexing. 3 Method: MSv1 3.1 Threat model Threat model (v1). • Verifier capabilities: access to suspect audio; access to issuer public keys or certificates; online or cached access to a repository serving signed manifests and Merkle inclusion proofs; and access to a watermark decoder (a publicly released detector binary or a decoding service provided by the issuer). Note that watermark decoding in our prototype relies on a secret permutation key. The “public-key verifiable” property applies to the Merkle signature layer: once the payload has been decoded by whatever means, every subsequent verification step—signature check, fingerprint recomputation, Merkle inclusion—requires only public information. • Adversary capabilities (black-box): the adversary may apply common distribution transforms (transcoding, resampling, additive noise, enhancement) and perform edits such as cropping, concatenation, and splicing. Robustness audits motivate treating learned transforms and neural codecs as important stressors [ 3 , 4 ] . • Key assumptions: the adversary does not possess embedding key or model weights in a white-box manner and cannot forge issuer signatures. White-box and adaptive attacks are discussed as limitations. • Security goal: produce a splice-aware timeline labelling which chunks can be publicly verified as belonging to an issuer-signed commitment, while maintaining extremely low false positive rates. 3.2 Notation Table 1: Core notation for MSv1 . Symbol Meaning CID Random per-asset content identifier i Chunk index L,S Chunk length, stride (seconds) x_{i} Original chunk waveform y_{i} Observed/suspect chunk waveform b_{i} Robust fingerprint bitstring for chunk i d_{i} Leaf digest (hash of metadata and b_{i} ) R Merkle root over leaves \{d_{i}\} \sigma Issuer signature over (R,\textsf{CID},\textsf{params\_hash},\dots) \pi_{i} Merkle inclusion proof for leaf i 3.3 Chunking and alignment Audio is segmented into chunks of length L seconds with stride S . Non-overlapping chunking ( S=L ) gives a clean partitioning; overlapping chunking ( S