Large-Sample Bayesian Approximations for Privatized Data
Jordan Awan Department of Statistics, University of PittsburghXi ChenDepartment of Politics and International Affairs, Northern Arizona University, Roberto MolinariDepartment of Mathematics and Statistics, Auburn University · 2026
Read Large-Sample Bayesian Approximations for Privatized Data by Jordan Awan Department of Statistics, University of PittsburghXi ChenDepartment of Politics and International Affairs, Northern Arizona University, Roberto MolinariDepartment of Mathematics and Statistics, Auburn University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-24817.txt.
Introduction
Awan, Chen and Molinari propose a Bayesian method for privatized data. Privacy noise makes inference harder. Old methods need strong parametric assumptions or fail at large scale. Their two-step approach imputes confidential data, then samples the non-private posterior. They prove the sampler is asymptotically valid under mild assumptions. Simulations show conservative frequentist traits too. They test it on simulated data and on homeownership via the 2022 American Community Survey.
Catalog record
| CREATOR | Jordan Awan Department of Statistics, University of PittsburghXi ChenDepartment of Politics and International Affairs, Northern Arizona University, Roberto MolinariDepartment of Mathematics and Statistics, Auburn University |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 99006 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.24817
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Large-Sample Bayesian Approximations for Privatized Data Jordan Awan Department of Statistics, University of PittsburghXi ChenDepartment of Politics and International Affairs, Northern Arizona University, Roberto MolinariDepartment of Mathematics and Statistics, Auburn University Abstract The increased use of differential privacy (DP) has allowed the sharing of large amounts of data while reducing the risk of disclosure of sensitive information at the individual level. However, the noise introduced by DP methods makes performing statistical inference more challenging. While various methods have been proposed to address different inferential tasks, they often require strong parametric assumptions and/or do not scale well with sample sizes (e.g. U.S. Census products). In response to these limitations, we propose an approximate Bayesian method to analyze privatized data products, which uses a two-step approach of imputing the confidential data and then sampling from the non-private posterior, and which is inspired by the method of 32 . We prove that this approximate sampler is asymptotically valid under mild assumptions. While this approach is motivated by Bayesian theory, we show through simulations that it provides conservative frequentist properties as well. We demonstrate the utility of our method by applying it in simulated settings as well as for an analysis on the drivers of homeownership via the 2022 American Community Survey. Keywords: differential privacy, Bernstein von-Mises, asymptotics, U.S. Census Bureau 1 Introduction Differential privacy (DP), introduced in 20 , is currently the state-of-the-art framework for formal privacy protection. To protect privacy, DP methods require the introduction of external randomness into the data product to obscure the effect of any one individual’s data on the result. DP is now employed by technological companies such as Google ( 22 ) , Apple ( 53 ) , and Facebook ( 23 ) , as well as by the U.S. Census Bureau ( 2 ) . In particular, products from the U.S. Census are now subject to DP methods to reduce the risk of individuals being identified when researchers run their analysis on this data. This approach however negatively affects the work of political and socio-economic researchers who have to employ adequate statistical tools to make reliable conclusions in the presence of DP noise. For example, in this work we will consider the 2022 American Community Survey (ACS) Census product covering the U.S. population and studying how several variables are related to homeownership. However, for the latter task there are no general and/or computationally feasible methodologies that can deliver reliable statistical inference on data of this scale unless, among others, strong parametric assumptions are made on the joint distribution of the data. More in detail, while there are many DP methods to tackle a wide variety of statistical and machine learning problems, such as hypothesis testing ( 6 ; 39 ) , empirical risk minimization ( 14 ; 9 ) and the fitting of large machine learning models ( 1 ) , there is still a need for general methods that can provide valid statistical analysis of privatized data for a broad amount of settings. Specifically, the challenge for statistical inference is that after the noise is introduced for privacy protection, the original data is now unobservable to the analyst, and the sampling distribution of the privatized data can be intractable ( 59 ) . Among the existing inference methods for privatized data, Bayesian approaches are the most flexible and widely applicable. However, these methods often have significant limitations, such as at least one of the following: (i) requiring a fully generative model, (ii) relying on conjugate priors or (iii) suffering from a curse of dimensionality due to rejection sampling, thus limiting their applicability ( 29 ; 36 ; 15 ) . In terms of frequentist inference, the main approaches are based on either asymptotic approximations ( 56 ) or simulation-based inference such as the parametric bootstrap ( 24 ; 57 ; 8 ) . Unfortunately, the most rigorous asymptotic approximations are only applicable to the simplest of problems ( 56 ) ; as for simulation-based methods, these also often rely on parametric models which can be too restrictive and also have substantial computational cost. Overall, these approaches are not able to allow for flexible models and do not scale favorably with the sample size and/or the dimension of the data. Our Contributions: We propose a large-sample Bayesian framework for statistical inference on privatized data that we refer to as Private Uncertainty Measurement via Bayesian Asymptotics (PUMBA). This method is designed for the case where a (multivariate) additive noise mechanism is applied to a set of statistics, which can be written as a sum over individuals; despite this limitation of scope we show that PUMBA produces state-of-the-art inferential results in many settings of interest. PUMBA builds on the approach of 32 which, before our contributions, relied on strong assumptions about prior specification (potentially misaligned with analyst beliefs) and on asymptotic approximations that lack general theoretical justification. In a nutshell, this approach works by (i) imputing the confidential summary statistic and (ii) sampling from the non-private posterior given this summary; asymptotic approximations can be introduced in both steps so that these samplers no longer depend on the prior distribution or even on certain parts of the model. We show that this approach is more widely applicable than suggested in 32 and give a rigorous analysis of its asymptotic properties. The proofs of our results leverage theoretical tools from a variety of statistical disciplines such as local limit theorems, sequences of prior distributions, Bayesian asymptotics and information theory. While initially motivated by a Bayesian framework, we show through simulations that our methods achieve conservative frequentist properties (e.g., coverage/type I error) in the settings we consider. We apply our methodology to analyze drivers of homeownership using data from the 2022 American Community Survey, a U.S. Census Bureau data product. While this product was not protected with DP in 2022, we proposed a similar privatization scheme as was used in the 2020 DP Decennial Census products and show that we are able to achieve powerful and well-calibrated inference, whereas a naive approach leads to erroneous conclusions. Organization: Section 2 reviews the necessary background on differential privacy. In Section 3 we develop our main theoretical results: we describe the problem setup and introduce the approximations of interest (Section 3.1 ); we develop the main approximation of the original summary statistic, given the privatized summary (Section 3.3 ) and then support the use of Bernstein von-Mises approximations (Section 3.4 ); finally we propose our approximate posterior sampling algorithm (Section 3.5 ). We showcase our methodology through numerical experiments in Section 4 , applying our approximate Bayesian inference to both simulated and real data settings. We conclude in Section 6 with some discussion. Proofs, technical details and ancillary results are included in the Supplementary Materials. Related Work: The method discussed in this paper was initially proposed by 32 as a method for causal inference via the sub-sample and aggregate framework ( 43 ) . Building on this, our work aims to place itself within the body of research that develops general statistical inference tools for privatized data. We will therefore provide a brief overview of the related literature below. The Bayesian framework has been shown to be very flexible for analyzing privatized data. 59