Privacy-Utility Trade-off in Data Publication: A Bilevel Optimization Framework with Curvature-Guided Perturbation DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2025/06
Yi Yin, Guangquan Zhang, Hua Zuo, Jie Lu · 2025
Read Privacy-Utility Trade-off in Data Publication: A Bilevel Optimization Framework with Curvature-Guided Perturbation DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2025/06 by Yi Yin, Guangquan Zhang, Hua Zuo, Jie Lu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-02048.txt.
Introduction
Yi Yin, Guangquan Zhang, Hua Zuo, and Jie Lu balance privacy against utility when publishing data for model training. Sharing raw data risks membership inference attacks, which test whether a person record was in the training set. Common defenses blur or synthesize data but often damage accuracy and diversity. Their framework splits the problem into two linked optimization levels.
The upper level guards sample quality with a discriminator that steers generation toward faithful outputs. The lower level measures each sample exposure through local curvature of the data manifold, a geometric risk score. Perturbing samples toward low curvature zones hides distinctive feature mixes. Alternating optimization lifts both goals together. Tests beat prior methods on attack resistance, quality, and diversity.
Catalog record
| CREATOR | Yi Yin, Guangquan Zhang, Hua Zuo, Jie Lu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-02048
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Privacy-Utility Trade-off in Data Publication: A Bilevel Optimization Framework with Curvature-Guided Perturbation DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2025/06 Yi Yin, Guangquan Zhang, Hua Zuo, Jie Lu Abstract . Machine learning models require datasets for effective training, but directly sharing raw data poses significant privacy risk such as membership inference attacks (MIA). To mitigate the risk, privacy-preserving techniques such as data perturbation, generalization, and synthetic data generation are commonly utilized. However, these methods often degrade data accuracy, specificity, and diversity, limiting the performance of downstream tasks and thus reducing data utility. Therefore, striking an optimal balance between privacy preservation and data utility remains a critical challenge. To address this issue, we introduce a novel bilevel optimization framework for the publication of private datasets, where the upper-level task focuses on data utility and the lower-level task focuses on data privacy. In the upper-level task, a discriminator guides the generation process to ensure that perturbed latent variables are mapped to high-quality samples, maintaining fidelity for downstream tasks. In the lower-level task, our framework employs local extrinsic curvature on the data manifold as a quantitative measure of individual vulnerability to MIA, providing a geometric foundation for targeted privacy protection. By perturbing samples toward low-curvature regions, our method effectively suppresses distinctive feature combinations that are vulnerable to MIA. Through alternating optimization of both objectives, we achieve a synergistic balance between privacy and utility. Extensive experimental evaluations demonstrate that our method not only enhances resistance to MIA in downstream tasks but also surpasses existing methods in terms of sample quality and diversity. 1. Introduction The training of machine learning models is fundamentally dependent on the availability of high-quality datasets. However, direct sharing of sensitive private data - particularly in critical domains such as healthcare, financial services, and personalized recommendation systems - introduces substantial privacy risks, as it may lead to unauthorized exposure of personal information, potentially resulting in privacy violations or misuse of sensitive data. To mitigate these risks, many private datasets have been released after undergoing various preprocessing and de-identification techniques. For instance, the Netflix Prize dataset ( Bennett and Lanning 2007 ) obfuscates the timestamps of user ratings and removes all identifiers to safeguards the privacy of their customer base. Similarly, the ADNI dataset ( Kumar 2021 ) de-identifies participants’ demographic and genetic information to ensure data anonymity and compliance. Although de-identification techniques prevent direct privacy leakage by removing explicit identifiers, they fail to address the implicit privacy risks arising from the model’s memorization of data features. Even when identifiable attributes are removed, attackers can still exploit learned patterns and distinctive feature combinations, which may serve as unique identifiers. As a result, simple attribute obfuscation is insufficient to defend against advanced privacy threats, such as membership inference attacks (MIA) ( Shokri et al. 2017 ) , where attackers infer whether a specific sample was part of the training data based solely on the model’s outputs. Furthermore, for data publishers, the challenge extends beyond defending against attacks, as the uncertainty of downstream tasks complicates data release. For example, in a case where a dataset owner publishes image data, the downstream tasks could involve generation, classification, or other analyses, and this unknown purpose may render region masking technique ineffective, especially for generation tasks. Therefore, it is crucial to develop responsible data release methods that protect privacy while ensuring utility for downstream use. Current research efforts in privacy-preserving data publishing have primarily focused on three key strategies: data perturbation, generalization, and synthetic data generation. For example, differential privacy (DP) ( Abadi et al. 2016 ) offers strong theoretical privacy guarantees by adding noise to the data, but this noise can reduce data quality, limiting its practicality for complex tasks. Similarly, k-anonymity ( Sweeney 2002 ) groups data to prevent individual identification, but this can result in a loss of information diversity. So, to address this limitation, l-diversity ( Machanavajjhala et al. 2007 ) requires that sensitive attribute values within each equivalence class be diverse. However, while this method can prevent homogeneity attacks, implementing it with high-dimensional datasets, such as image datasets, remains challenging. PATE-GAN ( Jordon et al. 2018 ) relies on a system voting involving multiple teacher discriminators which guide a student discriminator. The method creates a privacy-preserving GAN, but the generated samples seldom comprehensively cover the original data distribution, leading to limited diversity. Plus, the injected noise usually degrades the fidelity of the image details. PrivBayes ( Zhang et al. 2017 ) models attribute dependencies using Bayesian networks and adds noise at each learning step to achieve DP, but this method is restricted to tabular data. Other methods that integrate DP into synthetic models to generate privacy-preserving data, such as WS-GAN ( Chen et al. 2020 ) , PrivBayes ( Zhang et al. 2017 ) and DPDM ( Dockhorn et al. 2022 ) , also suffer from reduced data quality due to noise injection. Generally, although these methods offer certain trade-offs between privacy and utility, they often introduce excessive noise or apply overly generalized transformations, which reduce data resolution, diversity, and adaptability for various downstream tasks, and ultimately undermine data utility. Thus, the core challenge is to strike an improved balance between utility and privacy. Our method addresses this issue through a bilevel optimization framework. The upper-level task focuses on maximizing the utility of the generated data, while the lower-level task targets privacy preservation by perturbing vulnerable data points. To achieve the upper-level objective, a discriminator is integrated to enhance latent space exploration and ensure high-quality generated samples. To achieve the lower-level objective, we identify that certain samples in a dataset are inherently more vulnerable to MIA because they are more likely to be memorized by the model rather than generalized, such as those with unusual feature combinations, outliers, or points near decision boundaries. Leveraging the extrinsic curvature information embedded in the data manifolds, we pinpoint these vulnerable data points and apply targeted perturbations to mitigate the risk of MIA. Specifically, we employ a Riemannian Variational Autoencoder (RVAE) as the backbone model, which simultaneously functions as a generative model and a manifold learning tool. The RVAE captures the intrinsic structure of the data manifolds and provides a Riemannian metric for curvature computation, enabling efficient identification of vulnerable regions. Guided by this curvature information, geodesic interpolation is used to perturb samples toward low-curvature regions, effectively reducing the risk of MIA. Since discriminator-guided updates to the decoder influence the Riemannian metric and create interdependencies among network components, we use alternating optimization to manage the coupling process, ensuring a balanced and optimized model that simultaneously achieves high generation quality and precise perturbation. The main contributions of this work can be summarized as follows: • We propose a novel bilevel framework that significantly improves the trade-off between privacy and utility in data publication. To the best of our knowledge, this is the first approach that explicitly balances generation quality and MIA defenses through bilevel optimization. • We propose a curvature-guided geodesic perturbation method that leverages the intrinsic features of the data manifold to guide perturbations, selectively avoiding vulnerable regions and effectively reducing the success of MIA, thus protecting individual privacy. • We