Nonparametric Variational Differential Privacy via Embedding Parameter Clipping

Dina El Zein, Shashi Kumar, James Henderson · 2026

Read Nonparametric Variational Differential Privacy via Embedding Parameter Clipping by Dina El Zein, Shashi Kumar, James Henderson (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-09583.txt.

Introduction

Dina El Zein and colleagues improve the privacy-utility trade-off of variational differential privacy models by clipping embedding parameters. In the nonparametric variational framework behind these models, learned latent representations can drift into high-information regions, weakening privacy and destabilizing training. Their clipping rules come from minimizing a Rényi divergence upper bound, yielding grounded limits on posterior mean, variance, and mixture weight. The clipped model reaches tighter privacy bounds and better downstream performance than an unconstrained baseline.

Catalog record

CREATORDina El Zein, Shashi Kumar, James Henderson
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50234
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.09583

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Nonparametric Variational Differential Privacy via Embedding Parameter Clipping Dina El Zein, Shashi Kumar, James Henderson Abstract The nonparametric variational information bottleneck (NVIB) provides the foundation for nonparametric variational differential privacy (NVDP), a framework for building privacy-preserving language models. However, the learned latent representations can drift into regions with high information content, leading to poor privacy guarantees, but also low utility due to numerical instability during training. In this work, we introduce a principled parameter clipping strategy to directly address this issue. Our method is mathematically derived from the objective of minimizing the Rényi Divergence (RD) upper bound, yielding specific, theoretically grounded constraints on the posterior mean, variance, and mixture weight parameters. We apply our technique to an NVIB based model and empirically compare it against an unconstrained baseline. Our findings demonstrate that the clipped model consistently achieves tighter RD bounds, implying stronger privacy, while simultaneously attaining higher performance on several downstream tasks. This work presents a simple yet effective method for improving the privacy-utility trade-off in variational models, making them more robust and practical. 1 1 1 Our code is publicly available at: https://github.com/idiap/NVDP-Clipping 1 Introduction Large Language Models have achieved remarkable success across a wide array of complex tasks, from natural language understanding (NLU) to generation ( 21 ; 7 ) . This success is largely fueled by training on vast datasets, which often include sensitive user information. Consequently, these models are susceptible to privacy leakage, where they might inadvertently memorize and reveal private data ( 4 ) in the embeddings shared to an adversarial third party, raising significant security and ethical concerns. Differential Privacy (DP) has emerged as the gold standard for providing formal mathematically rigorous guarantees against such leakage ( 9 ) . While traditional DP methods often rely on direct noise injection, such as in DP-SGD ( 1 ) , this can severely degrade model utility. As an alternative, variational methods offer a promising path for privatizing shared text embeddings. In this framework, noise is not added directly; instead, the model learns a latent posterior distribution from which a stochastic representation is sampled to produce a sanitized embedding. Building on this idea and extending it to the attention-based representations used for text, prior work ( 10 ) established a framework for privacy-preserving representation learning using nonparametric variational information bottleneck (NVIB) ( 11 ) , called nonparametric variational differential privacy (NVDP). They demonstrated that by modeling the posterior with NVIB’s flexible Dirichlet Processes, formal privacy guarantees can be derived by bounding the Rényi Divergence (RD) between this posterior and a data-independent prior, a concept inspired by the variational information bottleneck ( 2 ) . The resulting Bayesian Differential Privacy (BDP) guarantee ( 19 ) is an intrinsic part of the model’s objective, resulting in a more natural integration of privacy and utility. However, the practical application of the NVIB framework reveals a critical vulnerability: the posterior parameters are unbounded. This lack of constraint allows the parameters to drift into regions of the parameter space with high information content, resulting in a loose worst-case privacy guarantee. Furthermore, extreme parameter values can lead to numerical instability in the Rényi Divergence calculation itself. The existing NVIB framework lacks an explicit mechanism to confine the posterior to a well-behaved region that ensures both a tight privacy bound and a stable computation. In this work, we address these limitations by introducing a principled parameter clipping strategy. Instead of relying on ad hoc heuristics, our clipping operations are mathematically derived from the objective of minimizing the RD upper bound. This analysis yields theoretically grounded constraints for the posterior mean, variance, and mixture weight parameters. We apply our method to the NVIB model and demonstrate its effectiveness on several downstream NLP tasks. Our experiments show that the clipped model achieves a superior privacy-utility trade-off, consistently yielding tighter RD bounds while improving task accuracy compared to the unconstrained NVIB baseline. Our primary contributions are: • We perform a detailed analysis of the RD upper bound and derive a set of principled, theoretically grounded constraints for the posterior mean, variance, and mixture weight parameters. • We implement these constraints as a novel clipping mechanism within the NVIB framework and empirically validate its effectiveness across a range of downstream NLP tasks. • We demonstrate that our proposed method achieves a superior privacy-utility trade-off, yielding tighter privacy bounds while maintaining or improving task performance compared to the unconstrained baseline. 2 Background This section provides the necessary background for our work. We first review the formal privacy frameworks of Rényi Differential Privacy (RDP) and BDP, which we use to quantify the privacy guarantees of our models. We then describe the architecture of the nonparametric variational differential privacy model in prior work ( 10 ) , which serves as the baseline for our experiments. The NVDP model is a Transformer-based architecture that incorporates a NVIB layer to learn private representations. 2.1 Rényi Differential Privacy (RDP) RDP is a relaxation of standard (\epsilon,\delta) -DP ( 9 ) that leverages the RD ( 20 ) to quantify the difference between probability distributions. This approach, introduced by 13 , is particularly well-suited for analyzing privacy in machine learning, as it composes gracefully over multiple steps. Definition 2.1 (Rényi Divergence) . The RD of order \lambda>1 between two probability distributions Q and Q^{\prime} over a domain \mathcal{Z} is defined as: \displaystyle\hskip-25.83325ptD_{\lambda}(Q||Q^{\prime})=\frac{1}{\lambda-1}\log\left(\int_{\bm{z}}Q({\bm{z}})\left(\frac{Q({\bm{z}})}{Q^{\prime}({\bm{z}})}\right)^{\lambda-1}\right).\vskip-4.30554pt (1) In the context of privacy, a mechanism is said to provide \epsilon -RDP if for any two adjacent inputs, the divergence between their output distributions is bounded by \epsilon . The order \lambda determines the relative importance placed on the worst-case samples in \mathcal{Z} . In our work, we adapt this concept to measure the divergence between the posterior distributions learned by our model. 2.2 Bayesian Differential Privacy (BDP) While RDP provides a powerful analytical tool, BDP offers a more pragmatic interpretation of privacy, as proposed by 19 . BDP shifts the focus from comparing two adjacent inputs to comparing an individual’s output with the expected output over the entire population. This measures how much an adversary’s belief about an individual changes after observing their output, relative to a prior belief formed from the population. Definition 2.2 (Bayesian Differential Privacy) . A randomized mechanism M:\mathcal{X}\rightarrow\mathcal{Z} satisfies (\epsilon_{\mu},\delta_{\mu}) -BDP if for any individual’s data point {\bm{x}} and a point {\bm{x}}^{\prime} drawn from the population distribution \mathcal{X} , and for all measurable subsets S\subseteq\mathcal{Z} ,: \Pr[M({\bm{x}})\in S]\leq e^{\epsilon_{\mu}}\Pr[M({\bm{x}}^{\prime})\in S]+\delta_{\mu}.\vskip-4.30554pt (2) Here, the privacy budget \epsilon_{\mu} bounds the information gain, while \delta_{\mu} captures the probability of failure. A key advantage of this framework is its ability to convert a bound on the RD into an interpretable (\epsilon_{\mu},\delta_{\mu}) -guarantee. We detail the specific conversion mechanism used in our experiments in Section 4.1 . 2.3 Nonparametric Variational Differential Privacy (NVDP) To address the privacy-utility trade-off in sharing Transformer embeddings, prior work ( 10 ) introduced the NVDP model. The core idea of NVDP is to leverage the principles of a NVIB to learn a stochastic, information-constrained representation of an input that is sufficient for downstream tasks while being provably private. This is achieved by generating a noisy, sanitized embedding from which it is difficult to infer the original input. The NVDP architecture, shown in Figure 1 ,

Read the complete text