Robust Simulation Based Inference Through Robust Optimal Transport
Peter Matthew Jacobs, Lekha Patel, Anirban Bhattacharya, Debdeep Pati · 2026
Read Robust Simulation Based Inference Through Robust Optimal Transport by Peter Matthew Jacobs, Lekha Patel, Anirban Bhattacharya, Debdeep Pati (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18741.txt.
Introduction
Peter Matthew Jacobs and three colleagues make simulation-based inference sturdier when the model does not match reality. When likelihoods cannot be written down, researchers simulate from a model and fit it to data, yet a wrong model can mislead the fit. The authors use a robust optimal transport distance shaped by empirical likelihood ideas. They add a stochastic ascent method with a convergence promise and a parallel routine that uses resampling to gauge parameter uncertainty.
Catalog record
| CREATOR | Peter Matthew Jacobs, Lekha Patel, Anirban Bhattacharya, Debdeep Pati |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 106719 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.18741
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Robust Simulation Based Inference Through Robust Optimal Transport Peter Matthew Jacobs, Lekha Patel, Anirban Bhattacharya, Debdeep Pati Abstract When a statistical model { P θ : θ ∈ Θ } \{P_{\theta}:\theta\in\Theta\} lacks analytically tractable likelihoods, parametric statistical inference based on data generated from an unknown underlying distribution P P can still be performed as long as simulations from the model are possible. This approach is called Simulation Based Inference (SBI). Statistical models are rarely exactly correct (that is, P ∉ { P θ : θ ∈ Θ } P\notin\{P_{\theta}:\theta\in\Theta\} ), and Robust SBI focuses on inferring a reasonable parameter even under model mis-specification. We focus on the setting where P P possesses potentially both geometric and Total Variation type discrepancies from P θ ∗ P_{\theta^{*}} . For this problem, we use a Kullback-Liebler informed robust Optimal Transport divergence, motivated by Empirical Likelihood considerations. We introduce a stochastic sub-gradient ascent algorithm with a convergence guarantee for estimating the semi-discrete version of this robust Optimal Transport divergence, and design a parallelized SBI algorithm which employs the regular bootstrap on top of minimum semi-discrete robust Optimal Transport for parameter uncertainty quantification. We demonstrate mathematically why the divergence is robust under a joint geometric plus Total Variation type contamination and then illustrate the robustness of inferences on a complex benchmark SBI task. 1 Introduction Consider the scenario where a practitioner selects a statistical model \{P_{\theta}:\theta\in\Theta\} and would like to infer the parameters based on a collection of independent and identically distributed data Y_{1},\dots,Y_{n}\overset{iid}{\sim}P . Standard statistical inference makes the often unrealistic assumption the data generating probability distribution P is a member of the model (i.e P=P_{\theta^{*}} for some \theta^{*}\in\Theta ). Contamination models allow to study the robustness properties of a statistical method. For example the standard Huber Contamination model ( 30 ) assumes P=(1-\epsilon)P_{\theta^{*}}+\epsilon F for an arbitrary distribution F and some small \epsilon>0 . A method is called robust to a contamination if a small amount of it, for example small \epsilon in the Huber model, cannot lead to arbitrarily large changes in the estimate for \theta^{*} . The Huber contamination assumption is rigid in that it does not allow for the introduction of a geometric perturbation to P_{\theta^{*}} . Consider for example the case that with probability 1-\epsilon , a sample is drawn from P_{\theta^{*}} , but then is moved a distance at most \rho . Specifically, a sample Y\sim P if X\sim P_{\theta^{*}},W\sim bernoulli(\epsilon),Z\sim F are independent and Y=(1-W)T(X)+WZ where |T(x)-x|\leq\rho for all x . This type of all point contamination is well captured by the Wasserstein distance. Letting \mathcal{P}_{p}(\mathbb{R}^{m}) be the Borel probability measures on \mathbb{R}^{m} with finite p^{th} moment for p\geq 1 , the Wasserstein- p distance ( 58 ; 16 ) is defined as W_{p}(P,Q)=\left(\inf_{\pi\in\Pi(P,Q)}\mathbb{E}_{(A,B)\sim\pi}\|A-B\|_{2}^{p}\right)^{1/p} where P,Q\in\mathcal{P}_{p}(\mathbb{R}^{m}) and \Pi is the set of couplings between P and Q (joint distributions whose marginals are constrained to be P and Q respectively). A much more general contamination model encompassing this deterministic error plus Huber Contamination scenario supposes only that P\in\{\nu:\exists Q,\mathrm{TV}(Q,\nu)\leq\epsilon,W(Q,P_{\theta^{*}})\leq\rho\} where \mathrm{TV} stands for Total Variation distance ( 26 ) . We consider a tractable and interpretable subclass of this general contamination model which assumes P=(1-\epsilon)Q+\epsilon F for some distributions F and Q such that W_{2}(Q,P_{\theta^{*}})\leq\rho . \rho=0 reduces to the Huber Contamination model, while \epsilon=0 reduces to only geometric contamination. We call this the Geometric+Huber ( G+H ) contamination model, and it captures both mass contamination and geometric perturbations. Figure 1: In iid statistical inference, there is a statistical model, \{P_{\theta}:\theta\in\Theta\} , with the measures defined on a ground space \mathcal{Y} . Data Y_{1},\dots,Y_{n}\overset{iid}{\sim}P , and the parameters need to be inferred from the data. However, robustness to multiple forms of contamination is not the only challenge faced by the practitioner. Another common challenge is that the likelihood functions associated to distributions in the model are analytically intractable (i.e not available in closed form), but it is possible to simulate random vectors from P_{\theta} for any \theta by running a potentially complex and expensive computer code. Specifically, there exists a reference measure \mu supported on \mathbb{R}^{z} for some z\geq 1 and a function G:\Theta\times\mathbb{R}^{z} such that for any \theta\in\Theta , if X\sim\mu , then G(\theta,X)\sim P_{\theta} . Performing inference by generating simulations from members of the statistical model using the potentially expensive computer code G is the Simulation Based Inference (SBI) ( 12 ; 27 ; 60 ) setting (also sometimes known as the Likelihood Free setting), and it arises in many important domains, such as Neuroscience, Epidemiology, Robotics, and Ecology ( 45 ; 59 ; 42 ; 62 ) . In complex SBI applications, immense effort is put into constructing simulators based on domain science to reflect state of the art scientific knowledge. Yet, they are approximations to reality, and therefore it is important to account for departures from the simulator in a flexible manner. This motivates the study of more general contamination models in the SBI context. We introduce a method that can jointly address these challenges. Namely robustness under the G+H contamination model in addition to utilizable in the SBI setting. Our inference method is a minimum divergence approach ( 2 ) integrated with the regular bootstrap ( 23 ) for quantification of uncertainty. Specifically, we define a robust divergence \ell between probability distributions and target the parameter achieving the population minimum loss \argmin_{\theta\in\Theta}\ell(P,P_{\theta}) , which serves as a robust surrogate for \theta^{*} in the G+H Contamination model. Since P is unknown but iid samples Y_{1},\dots,Y_{n}\overset{iid}{\sim}P are available, the minimum divergence estimator is \argmin_{\theta\in\Theta}\ell(P_{n},P_{\theta}) where P_{n}:=\sum_{j=1}^{n}\frac{1}{n}\delta_{Y_{j}} and where \delta_{x} refers to the Dirac measure at position x . Given a number of bootstrap samples M , to produce measures of uncertainty for the underlying parameter, for j\in\{1,2,\dots,M\} , a new dataset Y^{\prime}_{1,j},\dots,Y^{\prime}_{n,j} is constructed by sampling uniformly and with replacement from Y_{1},\dots,Y_{n} . The j^{th} bootstrap sample for the parameter estimate is \argmin_{\theta\in\Theta}\ell(P^{j}_{n},P_{\theta}) where P^{j}_{n} is the empirical measure of the j^{th} bootstrapped dataset. Divergence selection Although it is geometrically descriptive, Wasserstein distance is not robust to Huber contamination. Consider for example attempting to infer the mean of a Normal distribution. If P=(1-\epsilon)Normal(\theta^{*},1)+\epsilon Normal(\theta_{1},1) , then \theta^{*}(1-\epsilon)+\theta_{1}\epsilon=\argmin_{\theta\in\mathbb{R}}W_{2}(P,Normal(\theta,1)) . Taking \theta_{1}\to\infty , the minimizer can be made arbitrarily far from \theta^{*} for any \epsilon>0 . One way to robustify Wasserstein distance to Huber Contamination is to open a small ball B_{\epsilon}(P) around P , and define a modified Wasserstein distance as \inf_{Q\in B_{\epsilon}(P)}W(Q,Normal(\theta,1)) . The sentiment is that if P is a Huber contamination of P_{\theta^{*}} , then Normal(\theta^{*},1) will be in the ball. This is the motivation behind the following version of Robust Optimal Transport, which can be viewed as a soft-dual to the optimization \inf_{Q:\mathrm{KL}(Q,P)\leq\epsilon}W(Q,P_{\theta}) where \mathrm{KL} denotes the Kullback-Leibler divergence ( 26 ) . Definition 1.1 ( \lambda -Robust Semi-Constrained Wasserstein-2 ( \lambda -RSW)) . For probability measures P_{1} and P_{2} in \mathcal{P}_{2}(\mathbb{R}^{m}) and \lambda>0 , \ell_{\lambda}(P_{1},P_{2}):=\inf_{Q\ll P_{1}}\left[\frac{1}{\lambda}\mathrm{KL}(Q,P_{1})+W_{2}^{2}(P_{2},Q)\right] (1) where Q\ll P_{1} means Q is absolutely continuous with respect to P_{1} . We select \ell_{\lambda} as our divergence, motivated by recent developments in distributionally constrained Empirical Likelihood ( 48 ; 14 ) ; see Appendix Section A for more details on that motivation. Although motivating it in an entirely different context (via its