PASS: Private Attributes Protection with Stochastic Data Substitution
Yizhuo Chen, Chun-Fu (Richard) Chen, Hsiang Hsu, Shaohan Hu, Tarek Abdelzaher · 2025
Read PASS: Private Attributes Protection with Stochastic Data Substitution by Yizhuo Chen, Chun-Fu (Richard) Chen, Hsiang Hsu, Shaohan Hu, Tarek Abdelzaher (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-07308.txt.
Introduction
Yizhuo Chen and four co-authors present a method to strip private traits from user data before it feeds machine learning services, in a research paper from 2025. Services collect large amounts of data that may hold private details irrelevant to the task. Earlier protection methods often train against an attacker model, which the authors show leaves a shared weakness.
Their method, PASS, swaps each sample for a stand-in sample with set odds, rather than editing it. A new loss, derived from information theory, keeps the data useful for the main task while hiding the private trait. Tests on face images, body sensor data, and voice recordings support its strength.
Catalog record
| CREATOR | Yizhuo Chen, Chun-Fu (Richard) Chen, Hsiang Hsu, Shaohan Hu, Tarek Abdelzaher |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 93 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-07308
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
PASS: Private Attributes Protection with Stochastic Data Substitution Yizhuo Chen, Chun-Fu (Richard) Chen, Hsiang Hsu, Shaohan Hu, Tarek Abdelzaher Abstract The growing Machine Learning (ML) services require extensive collections of user data, which may inadvertently include people’s private information irrelevant to the services. Various studies have been proposed to protect private attributes by removing them from the data while maintaining the utilities of the data for downstream tasks. Nevertheless, as we theoretically and empirically show in the paper, these methods reveal severe vulnerability because of a common weakness rooted in their adversarial training based strategies. To overcome this limitation, we propose a novel approach, PASS, designed to stochastically substitute the original sample with another one according to certain probabilities, which is trained with a novel loss function soundly derived from information-theoretic objective defined for utility-preserving private attributes protection. The comprehensive evaluation of PASS on various datasets of different modalities, including facial images, human activity sensory signals, and voice recording datasets, substantiates PASS’s effectiveness and generalizability. 1 Introduction The expansion of modern Machine Learning (ML) services has seamlessly improved the convenience of daily lives, where the service providers oftentimes gather data from users and then utilize advanced models to cater to users’ needs ( Secinaro et al. 2021 ; Ahmed et al. 2022 ) . However, the data collected frequently includes private information that users may be reluctant to disclose ( Boulemtafes et al. 2020 ; Kumar et al. 2023 ) . For instance, a human voice recognition service needs to collect speaker’s voice to extract the content ( Kheddar et al. 2024 ) , which would inadvertently contain private attributes such as the speaker’s gender or accent, imposing the risk of privacy leakage when an adversary tries to eavesdrop on the voice. Therefore, there has been a lasting interest in developing a data obfuscation module that can be inserted into the data sharing or ML service pipelines to protect the private attributes by suppressing or removing them from the data, while maintaining the utility of the data for downstream tasks. Various methods are proposed towards this goal. Roy & Boddeti 2019 ; Bertran et al. 2019 ; Wu et al. 2020 focused on suppressing private attributes while preserving explicitly annotated useful attributes. On the other hand, Huang et al. 2018 ; Malekzadeh et al. 2019 ; Dave et al. 2022 extended their researches to managing unannotated general features for broader applicability. Furthermore, Chen et al. 2024 summarized and satisified SUIFT , 5 desirable properties of utility-preserving private attributes protection methods. Notably, these state-of-the-art methods are adversarial training based, where their obfuscation module is trained to prevent an adversarial private attributes classifier from making correct inferences. However, as widely discussed in the neighboring fields of adversarial robustness ( Carlini & Wagner 2017 ; Athalye et al. 2018 ; Ilyas et al. 2019 ; Carlini et al. 2019 ) , generated image/vedio detection ( Yu et al. 2019 ; Wang et al. 2020 ; Masood et al. 2023 ) , membership inference attacks ( Carlini et al. 2022 ) and gradient inversion in federated learning ( Geiping et al. 2020 ; Huang et al. 2021 ) , a common weakness with adversarial training based methods is that, although the defender can tolerate the jointly-trained adversary, it may be vulnerable to slightly stronger or unseen adversaries. In the private attributes protection context, as we theoretically and empirically demonstrate in Section 3.2 , this weakness can indeed cause significant negative impact on the state-of-the-art methods, reducing their practicality in real-world deployment. To overcome the above weakness, we present a novel method for private attributes protection, called P rivate A ttributes protection with S tochatsic data S ubstitution (or PASS ), which avoids the adversarial training strategy altogether. Specifically, we propose to substitute each input sample of the data sharing system or ML service pipeline with another sample according to a stochastic data substitution algorithm. This algorithm is parameterized by a neural network and is trained with our novel loss function derived step-by-step from an information-theoretic objective defined for utility-preserving private attributes protection. Benefiting from the theoretical basis, PASS has clear operational boundaries for entangled attributes and can trade-off between privacy and utility controllably. An illustrative use case of PASS is provided in Figure 1 . Figure 1 : An illustration use case of PASS applied on facial images. We suppress ”sex” as a private attribute, and preserve ”Eyeglasses” and ”Smiling” as useful attributes. Apart from these attributes, we also preserve general features in facial images, such as ”Black hair” and ”Young”, which are not explicitly annotated in the dataset, but are useful for potential downstream applications. PASS stochastically substitutes the original sample with another sample such that the private attribute cannot be accurately inferred from the substituted sample. On the contrary, the useful attributes and general features are still inferable from the substituted sample. In summary, our paper’s contributions are threefold: 1) We propose PASS, a stochastic data substitution based method that overcomes the common weakness of state-of-the-art private attributes protection methods; 2) We demonstrate theoretically that PASS is rigorously rooted in information theory with desirable properties; and 3) We extensively evaluate PASS on facial images, human activity sensory signals, and human voice recordings to show its broad applicability. 2 Related Works Utility-preserving Private Attributes Protection. Various studies have been proposed on this topic recently. AttriGuard ( Jia & Gong 2018 ) proposed to defend against attribute inference attacks using evasion attack on the adversarial classifier. PPDAR ( Wu et al. 2020 ) , GAP ( Huang et al. 2018 ) and MaSS ( Chen et al. 2024 ) proposed to minimize private information leakage by making the adversarial classifier unable to make correct predictions. In comparison, ALR ( Bertran et al. 2019 ) and BDQ ( Kumawat & Nagahara 2022 ) proposed to minimize private information leakage by making the adversarial classifier uncertain about its predictions. Maxent-ARL ( Roy & Boddeti 2019 ) and MSDA ( Malekzadeh et al. 2019 ) adopted a combination of both above strategies. Different from above, SPAct ( Dave et al. 2022 ) proposed to train the obfuscation model to maximize a contrastive learning loss adversarially with its feature extractor. All of the above methods, except for GAP, proposed to preserve annotated useful attributes by ensuring their predictability. Generalizing the problem, GAP, MSDA, MaSS, and SPAct ( Dave et al. 2022 ) proposed to manage unannotated general features. These works are adversarial training based, resulting in a common weakness elaborated in Section 3.2 , motivating the design of PASS. The field of fairness shares similar problem formulation and designing techniques with private attributes protection ( Edwards & Storkey 2016 ; Madras et al. 2018 ; Sarhan et al. 2020 ; Caton & Haas 2024 ) . Nevertheless, their training losses are typically derived from fairness metrics, as opposed to the privacy objectives, making them uncomparable with private attributes protection methods. Local Differential Privacy (LDP) And Randomized Response. Differential Privacy requires the randomized mechanism to produce similar distributions when applied to any two neighboring datasets ( Dwork et al. 2006 ) , which is typically achieved with addictive noises ( Dwork et al. 2014 ; Abadi et al. 2016