Quantum-Inspired Audio Unlearning: Towards Privacy-Preserving Voice Biometrics

Shreyansh Pathak, Sonu Shreshtha, Richa Singh, Mayank Vatsa · 2025

Read Quantum-Inspired Audio Unlearning: Towards Privacy-Preserving Voice Biometrics by Shreyansh Pathak, Sonu Shreshtha, Richa Singh, Mayank Vatsa (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-22208.txt.

Introduction

Shreyansh Pathak and co-authors present a quantum inspired method to erase a voice from a trained biometric model in a 2025 paper. Voice authentication spreads fast, and privacy laws grant a right to be forgotten for personal speech data. Erasing one speaker signature from a trained model is hard. Audio is sequential and high dimensional, and visual unlearning methods fit it poorly.

Their four phase approach nullifies target features with interference style initialization, obscures class identity with superposition style label changes, maximizes uncertainty with a quantum loss. A final phase mixes linked weights to retain other knowledge. Tests across four speech data sets and three model types reached complete target erasure.

Catalog record

CREATORShreyansh Pathak, Sonu Shreshtha, Richa Singh, Mayank Vatsa
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-22208

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Quantum-Inspired Audio Unlearning: Towards Privacy-Preserving Voice Biometrics Shreyansh Pathak, Sonu Shreshtha, Richa Singh, Mayank Vatsa Abstract The widespread adoption of voice-enabled authentication and audio biometric systems have significantly increased privacy vulnerabilities associated with sensitive speech data. Compliance with privacy regulations such as GDPR’s right to be forgotten and India’s DPDP Act necessitates targeted and efficient erasure of individual-specific voice signatures from already-trained biometric models. Existing unlearning methods designed for visual data inadequately handle the sequential, temporal, and high-dimensional nature of audio signals, leading to ineffective or incomplete speaker and accent erasure. To address this, we introduce QPAudioEraser , a quantum-inspired audio unlearning framework. Our four-phase approach involves: (1) weight initialization using destructive interference to nullify target features, (2) superposition-based label transformations that obscure class identity, (3) an uncertainty-maximizing quantum loss function, and (4) entanglement-inspired mixing of correlated weights to retain model knowledge. Comprehensive evaluations with ResNet18, ViT, and CNN architectures across AudioMNIST, Speech Commands, LibriSpeech, and Speech Accent Archive datasets validate QPAudioEraser’s superior performance. The framework achieves complete erasure of target data (0% Forget Accuracy) while incurring minimal impact on model utility, with a performance degradation on retained data as low as 0.05%. QPAudioEraser consistently surpasses conventional baselines across single-class, multi-class, sequential, and accent-level erasure scenarios, establishing the proposed approach as a robust privacy-preserving solution. 1 Introduction The rapid growth of speech-driven technologies, including voice assistants and audio biometric systems, highlights the urgency to safeguard user privacy from potential misuse of sensitive voice data. Deep learning models inherently embed training data within their parameters, making the efficient removal of individual-specific data challenging mittal2024NMI . While regulations such as GDPR Hjerppe_2019 and the DPDP Act mandate effective mechanisms to enforce the right to be forgotten , traditional solutions such as retraining models from scratch remain computationally infeasible. This has driven interest in machine unlearning liu2024unlearning , which selectively removes data influence without model retraining. Figure 1 : Demonstrating the impact of QPAudioEraser on speaker identification. When an audio sample from Speaker 1 is input into a pre-trained speaker identification model, it correctly identifies Speaker 1 with high confidence (probability above threshold). However, after the same sample is processed by an unlearned model, the model’s prediction probabilities become nearly uniform across all speakers, causing uncertainty and preventing the correct identification of Speaker 1. Most machine unlearning research currently emphasizes visual data thakral2025continualunlearningfoundationaltexttoimage ; thakral2025finegrained ; xu2023machineunlearningsurvey . In contrast, audio data presents fundamentally different challenges owing to its sequential and temporal complexity. Consequently, techniques primarily developed for images, including methods such as fine-tuning ding2025understanding , as well as deep-learning-based approaches leveraging Fisher Information-based scrubbing shi2024deepcleanmachineunlearningcheap , dual-teacher knowledge distillation wu2022federatedunlearningknowledgedistillation , and gradient ascent trippa2024nablataugradientbasedtaskagnostic , fail to adequately address the dynamic nature and inherent variability of audio signals. Early approaches to unlearning targeted simpler models such as Support Vector Machines (SVMs), but these were limited to individual data points and lacked scalability incdecsvm . Subsequent methods expanded capabilities to handle statistical approaches (Naive Bayes) cao2015towards , and more complex architectures (Decision Trees, Random Forests, K-means clustering) brophy2020machine ; ginart2019making . Unlearning methods are typically classified into Exact Unlearning , fully eliminating data influence gupta2021machine , and Approximate Unlearning , which aligns parameter distributions with fully retrained models marchant2024langevin . More advanced exact techniques, including cached gradient subtraction sekhari2023adaptive and influence functions brophy2020machine , are typically constrained to convex and small-scale models. To bridge this critical research gap, we propose QPAudioEraser , a quantum-inspired unlearning framework specifically tailored for audio biometric systems. QPAudioEraser leverages quantum phenomena—superposition, destructive interference, and entanglement—to selectively erase specific speaker or accent signatures while preserving overall biometric accuracy. Our comprehensive evaluation employs ResNet18, Vision Transformer (ViT), and CNN architectures across diverse audio benchmarks: AudioMNIST, Speech Commands, LibriSpeech, and Speech Accent Archive. Results confirm that QPAudioEraser achieves near-perfect erasure (0% Forget Accuracy) with negligible impact on retained data accuracy. To the best of our knowledge, this work represents the first exploration of quantum-inspired, class-specific unlearning in audio biometrics, significantly advancing privacy-preserving technologies. 2 Proposed QPAudioEraser Algorithm Given a model with parameters \theta^{*} trained on classes C={c_{1},\dots,c_{K}} , our goal is to obtain new parameters \tilde{\theta} such that the model “forgets” a designated class c_{F}\in C while preserving performance on all other classes. Formally, we seek \tilde{\theta} satisfying A_{c_{F}}(\tilde{\theta})\approx 0 and A_{c_{j}}(\tilde{\theta})\approx A_{c_{j}}(\theta^{*}) for all c_{j}\neq c_{F} , where A_{c}(\theta) denotes the accuracy on class c under model \theta . The proposed approach, QPAudioEraser is inspired by quantum physics principles: superposition , interference , and entanglement to unlearn class c_{F} through four phases: (1) Destructive interference weight initialization, (2) Superposition-based label transformation, (3) Uncertainty-maximizing quantum-inspired retraining, and (4) Entanglement-inspired weight mixing interference. We present each phase below, followed by the complete algorithm and complexity analysis. 2.1 Weight Transformation with Destructive Interference In a trained model, let W\in\mathbb{R}^{d\times K} and b\in\mathbb{R}^{K} denote the weights and biases of the final classification layer (with d the feature dimension and K classes). We first modify the parameters for the forget class c_{F} (index F ) by applying \cos\phi phase shift to simulate destructive interference and scale by 1/\sqrt{2} : \displaystyle\tilde{W}_{ij} \displaystyle=\begin{cases}\frac{W_{ij}\cdot\cos\phi}{\sqrt{2}}&j=F\\ W_{ij}&j\neq F\end{cases} (1) \displaystyle\tilde{b}_{j} \displaystyle=\begin{cases}b_{j}\cos\phi&j=F\\ b_{j}&j\neq F\end{cases} (2) where \phi=\pi is chosen for maximal interference (since \cos\pi=-1 ) in our implementation. Substituting \phi=\pi yields W_{F}^{\prime}=-\frac{1}{\sqrt{2}}W_{F} and b_{F}^{\prime}=-b_{F} , i.e., the weight vector and bias for class c_{F} are negated (phase inversion) and the weight is nearly halved in magnitude. For an input with hidden representation h\in\mathbb{R}^{d} , the original logit for class c_{F} is z_{F}=W_{F}^{T}h+b_{F} , which after transformation becomes \displaystyle\tilde{z}_{F}=-\frac{1}{\sqrt{2}}W_{F}^{T}h-b_{F} . This causes an immediate drop in the model’s confidence for c_{F} (the logits for c_{F} shrink and become negative). For example, the softmax probability for c_{F} becomes: \sigma(\tilde{z})_{F}=\frac{\exp(\tilde{z}_{F})}{\sum{j\neq F}\exp(z_{j})+\exp(\tilde{z}_{F})}\ll\sigma(z)_{F}~, (3) which is much smaller than the original c_{F} probability \sigma(z)_{F} (especially if z_{F} was large and positive). The 1/\sqrt{2} factor in Eq. ( 1 ) moderates the logit reduction to avoid over-suppression; simply negating W_{F} without scaling could drive z_{F} to an excessively large negative value, unnecessarily harming the optimization that follows. This interference-based weight initialization immediately weakens the model’s ability to recognize c_{F} without significantly affecting other classes’ logits. Even before optimization phase 2.3 , the model’s accuracy on c_{F} drops, while accuracy on retained classes remains nearly unchanged, providing a good starting point for unlearning. 2.2 Superposition-Based Label Transformation Next, we induce a quantum superposition-like state for the forget class labels. For every training sample originally labeled y=c_{F} , we replace its one-hot label with a uniform distribution over all K classes: \tilde{y}_{j}=\begin{cases}\frac{1}{K},&\text{if original }y=c_{F}\\ y_{j},&\text{otherwise}\end{cases} (4) where y_{j} is the original one-hot label vector corresponding to the retained class. This label superposition effectively removes specific class identity from c_{F} samples, treating them as if they equally belong to every class. In information-theoretic terms, a uniform label has maximum entropy, which forces the model to produce non-discriminative, high-uncertainty outputs for those samples. By converting c_{F} labels to [1/K,\dots,1/K] , we maximize the entropy of predictions for that class, i.e. we make all outcomes equally likely for c_{F} instances. This is analogous to a quantum system in an equal superposition of K states yielding uniformly random measurement outcomes. The label transformation primes the model to unlearn c_{F} by removing any

Read the complete text