Voice Privacy from an Attribute-based Perspective
Mehtab Ur, Martha, Cristian · 2026
Read Voice Privacy from an Attribute-based Perspective by Mehtab Ur, Martha, Cristian (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-20301.txt.
Introduction
Rahman and co-authors propose judging voice privacy by speaker attributes, not signal matching. Voice anonymization aims to hide who spoke, but benchmarks compare waveforms directly. They measure speaker uniqueness from true, inferred, and protected attribute sets. They also test an attack setting with a single utterance per speaker. Inferred attributes still carried risk, despite errors in guessing them. Future voice privacy work, they argue, must weigh attribute-based threats and defenses.
Catalog record
| CREATOR | Mehtab Ur, Martha, Cristian |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25038 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.20301
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Voice Privacy from an Attribute-based Perspective Mehtab Ur, Martha, Cristian Abstract Voice privacy approaches that preserve the anonymity of speakers modify speech in an attempt to break the link with the true identity of the speaker. Current benchmarks measure speaker protection based on signal-to-signal comparisons. In this paper, we introduce an attribute-based perspective, where we measure privacy protection in terms of comparisons between sets of speaker attributes. First, we analyze privacy impact by calculating speaker uniqueness for ground truth attributes, attributes inferred on the original speech, and attributes inferred on speech protected with standard anonymization. Next, we examine a threat scenario involving only a single utterance per speaker and calculate attack error rates. Overall, we observe that inferred attributes still present a risk despite attribute inference errors. Our research points to the importance of considering both attribute-related threats and protection mechanisms in future voice privacy research. Rahman Larson Tejedor-Garcia keywords Voice privacy, Speaker attributes, Attribute inference, Speech data † † address: 1 Centre for Language Studies 2 Institute for Computing and Information Sciences Radboud University, Nijmegen, Netherlands † † email: (mehtab.rahman, martha.larson, cristian.tejedorgarcia)@ru.nl 1 Introduction Speech is a rich signal that conveys far more than linguistic content. It carries a wide range of information about the speaker including identity, physical state, health, emotional state and demographic attributes. Such information is useful for many applications [ 6 , 19 , 12 ] , but also constitutes sensitive personal information, leading to growing interest in voice privacy [ 2 , 16 ] . Until now, voice privacy research has focused on a signal-based perspective. In other words, privacy risk is typically assessed by matching the speech signals of speakers. A key example is the Voice Privacy Challenge (VPC) [ 25 , 24 ] , the leading benchmark in voice privacy, other examples include [ 15 , 29 ] . Such research overlooks the attribute-based perspective. Specifically, it does not consider matching between speakers represented by profiles of categorical attributes. Such profiles can be created by classifiers trained to infer the values of attributes from the speech signal. Attribute inference is possible on anonymized speech; for example, the anonymization approaches in the VPC 2024 [ 24 ] , are designed to preserve speaker emotion. In general, any attribute not protected by anonymization, either intentionally or unintentionally, can be used to build a speaker attribute profile. In this paper, we investigate the privacy of speaker attribute profiles and we point out that the attribute-based perspective on voice privacy should be considered alongside the conventional signal-oriented perspective. The importance of the attribute-perspective on speech privacy is motivated by prior work from the wider area of data protection that has shown that categorical data can still uniquely describe individuals, even in large datasets [ 5 , 23 , 9 , 22 ] . In [ 13 ] , the importance of speaker attributes is recognized for speaker verification as a complement to the speech signal. However, to our knowledge, we are the first to carry out a study of privacy protection on speaker attribute profiles and to provide a demonstration that such profiles still present a privacy risk despite attribute inference errors. Our paper makes three main contributions: (1) We analyze the privacy risk of speaker attribute profiles at the speaker and at the utterance level. Our analysis studies speaker uniqueness for profiles inferred from original (unprotected) speech as well as from anonymized speech. (2) We carry out a re-identification attack in which the attacker matches the speaker attribute profile of the target speaker that has been inferred from a single utterance (original and anonymized) to speaker attribute profiles inferred from multiple utterances of a known speaker. (3) We release a set of annotations for four speaker attributes (gender, age, accent, and profession), aggregating and extending annotations previously released for the VoxCeleb2 data set and enabling experimentation with attribute-based speaker profiles. 1 1 1 Annotations and code will be made publicly available. 2 Related Work and Background 2.1 Uniqueness Analysis for Attribute-based Profiles An attribute-based perspective of privacy has a long history in statistical disclosure control (SDC), which studies person-level data (microdata), with a specific focus on categorical data in table form [ 27 , 11 ] . A central idea is that shared attribute values partition the dataset into equivalence classes, and privacy decreases when these classes are small. This intuition is formalized by k -anonymity, where the anonymity set size k is the number of records that share an attribute profile and uniqueness corresponds to k=1 [ 23 ] . The importance of uniqueness analysis is supported by regulatory and evaluation perspectives. Guidance related to the GDPR identifies singling out as a practical privacy risk alongside linkability and inference [ 8 , 1 ] . Although the GDPR does not formally operationalize singling out, uniqueness of attribute profiles provides a measurable interpretation of this concept. Recent work has proposed legally grounded metrics for singling out and linkability in voice anonymization evaluation and has shown that predicate singling out risk may not correlate with speaker verification metrics such as Equal Error Rate (EER) [ 26 ] . These considerations motivate us to use uniqueness and anonymity set sizes to assess privacy. 2.2 Attacker Specification for the Re-identification Attack The Scenario of Use Scheme [ 20 ] provides a set of dimensions for the explicit specification of privacy threat situations. Based on this scheme, the attacker scenario that forms the basis of our study of re-identification attack is specified in Table 1 . Table 1: Attacker scenario for the re-identification attack Objective The attacker aims to recover the real-world identity for a set of target (i.e., test) speakers. Opportunity The attacker has one spoken audio utterance for each target speaker. We study two cases: the audio is original (unprotected) and the audio is protected by an anonymization algorithm. The attacker has multiple spoken utterances for a group of reference speakers that are labeled with the speaker ID. Additional Resources The attacker uses the same attribute classifiers as in the uniqueness analysis, i.e., the attacker has access to original (unprotected) speech data drawn from the same distribution as the target data that has been labeled with the four attribute classes. The specification of the attacker scenario is based on the most recent (i.e., 2024) Voice Privacy Challenge (VPC) [ 24 ] , which studies privacy at the utterance level. However, we choose to study an attack scenario more challenging than what is studied in the VPC 2024. Specifically, for the cases involving anonymized test data, we assume that the attacker does not have access to the anonymization system and cannot anonymize the training data. Like the VPC, our attack involves matching test speakers with reference speakers for whom the identity is known. A key difference is that the VPC studies signal-to-signal comparisons, which allow degrees of match, and our work studies comparisons between speaker attribute profiles in terms of exact matches or mismatches. Because we do not have degrees of match, we cannot adjust matching thresholds as needed for the Equal Error Rate used by the VPC. Instead, we calculate an Error Rate (cf. Section 3.3 ). 3 Experimental Setup 3.1 Dataset Our research requires speech data