Exponential-Family Membership Inference: From LiRA and RMIA to BaVarIA
Rickard Brännvall · 2026
Read Exponential-Family Membership Inference: From LiRA and RMIA to BaVarIA by Rickard Brännvall (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-11799.txt.
Introduction
Brännvall shows that three membership inference attacks, LiRA, RMIA, and BASE, are one method in disguise. All three fit a single exponential-family log-likelihood ratio framework, differing in assumptions and in how many parameters each point gets. The view yields a BASE1-4 ladder from RMIA to LiRA, and a rule: match attack complexity to the shadow-model budget. He then proposes BaVarIA, a Bayesian variance attack that steadies variance estimates at small budgets. Across 12 testbeds and 7 budgets, BaVarIA matches or beats LiRA on average.
Catalog record
| CREATOR | Rickard Brännvall |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 82105 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.11799
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Exponential-Family Membership Inference: From LiRA and RMIA to BaVarIA Rickard Brännvall Abstract Membership inference attacks (MIAs) are becoming standard tools for auditing the privacy of machine learning models. The leading attacks—LiRA [ Carlini et al. 2022 ] and RMIA [ Zarifzadeh et al. 2024 ] —appear to use distinct scoring strategies, while the recently proposed BASE [ Lassila et al. 2025 ] was shown to be equivalent to RMIA, making it difficult for practitioners to choose among them. We show that all three are instances of a single exponential-family log-likelihood ratio framework, differing only in their distributional assumptions and the number of parameters estimated per data point. This unification reveals a hierarchy (BASE1–4) that connects RMIA and LiRA as endpoints of a spectrum of increasing model complexity. Within this framework, we identify variance estimation as the key bottleneck at small shadow-model budgets and propose BaVarIA, a Bayesian variance inference attack that replaces threshold-based parameter switching with conjugate normal-inverse-gamma priors. BaVarIA yields a Student- t t predictive (BaVarIA- t t ) or a Gaussian with stabilized variance (BaVarIA- n n ), providing stable performance without additional hyperparameter tuning. Across 12 datasets and 7 shadow-model budgets, BaVarIA matches or improves upon LiRA and RMIA, with the largest gains in the practically important low-shadow-model and offline regimes. 1 Introduction Membership inference attacks (MIAs) determine whether a specific data point was used to train a machine learning model [ Shokri et al. 2017 ] . Beyond their role as privacy attacks, MIAs serve as empirical auditing tools: they provide lower bounds on the privacy leakage of trained models [ Nasr et al. 2023 , Steinke et al. 2023 ] , complementing theoretical guarantees from differential privacy [ Dwork et al. 2006 ] . As with any auditing technique, the same methods could in principle be misused; we focus on the defensive application throughout. The current landscape of score-based MIAs presents practitioners with several competing approaches. LiRA [ Carlini et al. 2022 ] fits per-point Gaussian models to shadow-model log-odds and computes a likelihood-ratio score. RMIA [ Zarifzadeh et al. 2024 ] uses a population-level reference to avoid per-point parameter estimation. BASE [ Lassila et al. 2025 ] centers the target loss against a pooled shadow summary. Lassila et al. 2025 proved that BASE and RMIA are equivalent, but the connection between these population-level methods and LiRA’s per-point Gaussian approach has not been established. We clarify the relationship by showing that LiRA, RMIA, and BASE are all instances of a single framework. The key insight is that each attack implicitly assumes a parametric distribution for a scalar summary statistic (loss, confidence, or log-odds) under the IN and OUT membership hypotheses, and then computes the corresponding log-likelihood ratio (LLR). Different distributional assumptions and parameter-sharing constraints yield different attacks. This unification yields three contributions: (1) A unifying framework (Section 3 ). We formalize the exponential-family LLR and show that it specializes to known attacks under specific distributional assumptions (Exponential, Gaussian). We define the BASE hierarchy (BASE1–4), a family of Gaussian LLR attacks with progressively relaxed parameter sharing, connecting RMIA/BASE at one end to LiRA at the other. (2) BaVarIA: Bayesian Variance Inference Attack (Section 4 ). LiRA’s performance degrades at small shadow-model budgets K because per-point variance estimates become unreliable. We replace maximum likelihood estimation with conjugate normal-inverse-gamma (NIG) Bayesian inference, yielding two variants: BaVarIA- t (Student- t predictive) and BaVarIA- n (Gaussian with Bayesian variance). Both provide Bayesian shrinkage that smoothly transitions from global to per-point estimates as K grows, with all posterior updates available in closed form. (3) Empirical evaluation (Section 5 ). We evaluate all methods across 12 datasets (image and tabular), 7 shadow-model budgets ( K\in\{4,\ldots,254\} ), and 32 experimental replicates. On average, BaVarIA- n matches or improves over LiRA at K\geq 16 , while BaVarIA- t provides the best AUC across all K . We validate findings on an independent shadow-model collection. 2 Background Setup. Let D=\{(x_{i},y_{i})\}_{i=1}^{N} be a dataset. A target model f(\cdot;\theta_{0}) is trained on a subset S_{0}\subset D , and K shadow models f(\cdot;\theta_{k}) , k=1,\ldots,K , are each trained on subsets S_{k}\subset D . For a fixed point i , the membership indicator m_{i,k}\in\{0,1\} records whether (x_{i},y_{i})\in S_{k} . Membership is known for shadows ( k>0 ) and unknown for the target ( k=0 ). We observe the per-point loss \ell_{i,k}=\ell(f(x_{i};\theta_{k}),y_{i}) , the predicted confidence p_{i,k} for the true label, and form scalar statistics such as the rescaled logit \varphi_{i,k}=\log(p_{i,k}/(1-p_{i,k})) . Under cross-entropy loss, \ell=-\log p , so all three quantities are monotone transforms of the same signal. Optimal membership score. Sablayrolles et al. 2019 showed that the Bayes-optimal membership score is the log-likelihood ratio \mathrm{LLR}(z)=\log\frac{p(z\mid m=1)}{p(z\mid m=0)}, (1) where z is any sufficient scalar statistic of the model output. Their analysis further shows that the optimal attack depends on the model only through the loss, so black-box access to a scalar output statistic is sufficient—justifying the restriction to scalar statistics throughout this paper. All score-based MIAs can be viewed as estimating this quantity under different modeling assumptions. LiRA. For each point i , LiRA [ Carlini et al. 2022 ] models the rescaled logit \varphi_{i,k}\mid m=m^{\prime}\sim\mathcal{N}(\mu_{i,m^{\prime}},\sigma_{i,m^{\prime}}^{2}) with parameters estimated from shadow models. Let \mathcal{K}_{i,m}=\{k>0:m_{i,k}=m\} . The LiRA score is \text{LiRA}_{i}=\frac{(\varphi_{i,0}-\hat{\mu}_{i,0})^{2}}{2\hat{\sigma}_{i,0}^{2}}-\frac{(\varphi_{i,0}-\hat{\mu}_{i,1})^{2}}{2\hat{\sigma}_{i,1}^{2}}+\log\frac{\hat{\sigma}_{i,0}}{\hat{\sigma}_{i,1}}, (2) where \hat{\mu}_{i,m} and \hat{\sigma}_{i,m}^{2} are the MLE from \{\varphi_{i,k}\}_{k\in\mathcal{K}_{i,m}} . RMIA and BASE. RMIA [ Zarifzadeh et al. 2024 ] computes a likelihood ratio against a population reference, avoiding per-point parameter estimation. BASE [ Lassila et al. 2025 ] scores each point by centering the target loss against a pooled shadow summary: \text{BASE}_{i}=-\ell_{i,0}-\log\!\left(\tfrac{1}{K}\textstyle\sum_{k=1}^{K}e^{-\ell_{i,k}}\right). (3) Lassila et al. 2025 proved that BASE and RMIA (at \gamma=1 ) produce equivalent ROC curves. 3 Exponential-Family Framework We now show that the attacks of Section 2 are instances of a single parametric framework. For a fixed point i , assume the scalar statistic z_{i,k}\mid m_{i,k}=m follows an exponential-family distribution p(z\mid m)=h(z)\exp\!\big(\eta_{m}^{\top}T(z)-A(\eta_{m})\big), (4) with sufficient statistics T(z) , natural parameters \eta_{m} , base measure h(z) , and log-partition function A . The LLR ( 1 ) then takes the form \mathrm{LLR}(z)=(\eta_{1}-\eta_{0})^{\top}T(z)-\big(A(\eta_{1})-A(\eta_{0})\big), (5) which is an affine function of T(z) . Under any exponential-family model, the optimal membership score is thus a linear combination of the sufficient statistics, plus a constant offset. 3.1 Distributional Specializations We consider two primary distributional families; others (Beta, Gamma) are developed in Appendix A . Exponential model (loss statistic). Assume \ell_{i,k}\mid m\sim\mathrm{Exp}(\lambda_{m}) . The LLR is \mathrm{LLR}(\ell)=\log\frac{\lambda_{1}}{\lambda_{0}}-(\lambda_{1}-\lambda_{0})\,\ell, (6) which is linear in the target loss without any structural constraint—the one-parameter exponential family yields an affine LLR automatically. Gaussian model (log-odds statistic). Assume \varphi_{i,k}\mid m\sim\mathcal{N}(\mu_{m},\sigma_{m}^{2}) . The LLR is \mathrm{LLR}(\varphi)=\frac{(\varphi-\mu_{0})^{2}}{2\sigma_{0}^{2}}-\frac{(\varphi-\mu_{1})^{2}}{2\sigma_{1}^{2}}+\log\frac{\sigma_{0}}{\sigma_{1}}. (7) Under equal variances \sigma_{0}^{2}=\sigma_{1}^{2}=\sigma^{2} , this reduces to \mathrm{LLR}(\varphi)=\frac{\mu_{1}-\mu_{0}}{\sigma^{2}}\left(\varphi-\frac{\mu_{1}+\mu_{0}}{2}\right), (8) which is linear in \varphi . Table 1 summarizes the distributional families and their LLR forms. Table 1 : Exponential-Family LLR-Based Attacks. Model Statistic z Params LLR form Exponential loss \ell 2 linear in \ell Gaussian log-odds \varphi 4 \varphi,\varphi^{2} (equal var.) log-odds \varphi 3 linear in \varphi Additional families (Appendix A ): Gamma loss \ell 4 \ell,\log\ell Beta confidence p 4 \log p,\log(1{-}p) 3.2 The BASE Hierarchy We define a hierarchy of four attacks by progressively relaxing parameter-sharing constraints. BASE1–4 follow from the Gaussian LLR (