Robust Simulation-Based Inference under Missing Data via Neural Processes
Yogesh Verma, Ayush Bharti, Vikas Garg · 2025
Read Robust Simulation-Based Inference under Missing Data via Neural Processes by Yogesh Verma, Ayush Bharti, Vikas Garg (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-01287.txt.
Introduction
Yogesh Verma, Ayush Bharti, and Vikas Garg present a 2025 paper on inference when data have holes. Simulation-based inference estimates the settings of a model that can be run but not written as a formula. It usually needs complete data, yet real records often miss values from corrupt files or instrument limits. Filling holes with naive guesses can bias the answer, the team shows.
Their fix learns the filler and the inference network together, inside one neural frame. Tests on standard benchmarks show steadier results than rival baselines as missingness grows. Two real bioactivity data sets back the claim. Code is public. The work targets fields such as astrophysics and particle physics, where gaps are routine.
Catalog record
| CREATOR | Yogesh Verma, Ayush Bharti, Vikas Garg |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 70 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-01287
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Robust Simulation-Based Inference under Missing Data via Neural Processes Yogesh Verma, Ayush Bharti, Vikas Garg Abstract Simulation-based inference (SBI) methods typically require fully observed data to infer parameters of models with intractable likelihood functions. However, datasets often contain missing values due to incomplete observations, data corruptions (common in astrophysics), or instrument limitations (e.g., in high-energy physics applications). In such scenarios, missing data must be imputed before applying any SBI method. We formalize the problem of missing data in SBI and demonstrate that naive imputation methods can introduce bias in the estimation of SBI posterior. We also introduce a novel amortized method that addresses this issue by jointly learning the imputation model and the inference network within a neural posterior estimation (NPE) framework. Extensive empirical results on SBI benchmarks show that our approach provides robust inference outcomes compared to standard baselines for varying levels of missing data. Moreover, we demonstrate the merits of our imputation model on two real-world bioactivity datasets (Adrenergic and Kinase assays). Code is available at https://github.com/Aalto-QuML/RISE . 1 Introduction Mechanistic models for studying complex physical or biological phenomena have become indispensable tools in research fields as diverse as genetics ( Riesselman et al., 2018 ) , epidemiology ( Kypraios et al., 2017 ) , gravitational wave astronomy ( Dax et al., 2021 ) , and radio propagation ( Bharti et al., 2022a ) . However, fitting such models to observational data can be challenging due to the intractability of their likelihood functions, which renders standard Bayesian inference methods inapplicable. Simulation-based inference (SBI) methods ( Cranmer et al., 2020 ) tackle this issue by relying on forward simulations from the model instead of evaluating the likelihood. These simulations are then either used to train a conditional density estimator ( Papamakarios and Murray, 2016 ; Lueckmann et al., 2017b ; Greenberg et al., 2019 ; Papamakarios et al., 2019 ; Radev et al., 2020 ) , or to measure distance with the observed data ( Sisson, 2018 ; Briol et al., 2019 ; Pesonen et al., 2023 ) , to approximately estimate the posterior distribution of the model parameters of interest. SBI methods implicitly assume that the observed data distribution belongs to the family of distributions induced by the model; i.e., the model is well-specified . However, this assumption is often violated in practice where models tend to be misspecified since the complex real-world phenomena under study are not accurately represented. Even if the model is well-specified, the data collection mechanism might hinder the applicability of SBI methods since it can induce missing data due to, for instance, incomplete observations ( Luken et al., 2021 ) , instrument limitations ( Kasak et al., 2024 ) , or unfavorable experimental conditions. Although the former problem of model misspecification has been studied in a number of works ( Frazier et al., 2020 ; Dellaporta et al., 2022 ; Fujisawa et al., 2021 ; Bharti et al., 2022b ; Ward et al., 2022 ; Schmitt et al., 2023 ; Gloeckler et al., 2023 ; Huang et al., 2023 ; Gao et al., 2023 ; Kelly et al., 2024 ) , the latter problem of missing data in SBI has received relatively less attention. A notable exception is the work of Wang et al. (2024) , which attempts to handle missing data by augmenting and imputing constant values (e.g., zero or sample mean) and performing inference with a binary mask indicator. However, this approach can lead to biased estimates, reduced variability, and distorted relationships between variables ( Graham et al., 2007 ) . This is exemplified in Figure 1 where we investigate the impact of missing data on neural posterior estimation (NPE, Papamakarios and Murray (2016) )—a popular SBI method—on a population genetics model. We observe that simply incorporating missing values and their corresponding masks in NPE methods as in Wang et al. (2024) leads to biased posterior estimates. Figure 1: Effect of missing data on SBI. NPE posterior for the two-parameter Ricker model ( Wood, 2010 ) where the method of Wang et al. (2024) (with zero augmentation) is used to handle \varepsilon\% of values missing in the data. As \varepsilon increases, the NPE posteriors become biased and drift away from the true parameter value, denoted by the black lines. Other SBI works that address missing data include Lueckmann et al. (2017a) and Gloeckler et al. (2024) , however, they fail to account for the underlying mechanism that leads to missing values in the data. Outside of SBI, the problem of missing data has been extensively studied ( Van Buuren and Groothuis-Oudshoorn, 2011 ) , with Rubin (1976) categorizing it into three types: missing completely at random (MCAR), missing at random (MAR), and missing not at random (MNAR). Recent advances in machine learning have led to the development of novel methods for addressing this problem using generative adversarial networks (GANs, Luo et al. (2018) ; Yoon et al. (2018) ; Li et al. (2019) ; Yoon and Sull (2020) ), variational autoencoders (VAEs, Nazabal et al. (2020) ; Collier et al. (2020) ; Mattei and Frellsen (2019) ; Ipsen et al. (2020) ; Ghalebikesabi et al. (2021b) ), Gaussian processes ( Casale et al., 2018 ; Fortuin et al., 2020 ; Ramchandran et al., 2021 ; Ong et al., 2024 ) , and optimal transport ( Muzellec et al., 2020 ; Zhao et al., 2023 ; Vo et al., 2024 ) . These methods offer new perspectives on the problem of missing data imputation, but their application has been primarily limited to predicting missing values. Notably, they have not been developed for inference over missing values, which remains a significant challenge for SBI. Contributions. In this paper, we introduce a novel SBI method that is robust to shift in the posterior distribution due to missing data. Our method, named RISE (short for “Robust Inference under imputed SimulatEd data”), jointly performs imputation and inference by combining NPE with latent neural processes ( Foong et al., 2020 ) . Doing so allows us to learn an amortized model unlike other robust SBI methods in the literature, and to handle missing data under different assumptions ( Little and Rubin, 2019 ) . We summarize our main contributions below: • we motivate the problem of missing data in SBI, arguing how it can induce bias in posterior estimation; • we propose RISE, an amortized method, that jointly learns an imputation and inference network to deal with missing data; • RISE outperforms competing baselines in inference and imputation tasks across varying levels of missingness, demonstrating robust performance in settings entailing missing data. 2 Preliminaries Consider a simulator-based model p(\cdot\,|\,\theta) that takes in a parameter vector \theta\in\Theta\subseteq\mathbb{R}^{p} and maps it to a point \mathbf{x}=[x_{1},\dots,x_{d}]^{\top} in some data space \mathcal{X}\subseteq\mathbb{R}^{d} . We assume that p(\cdot\,|\,\theta) is intractable, meaning that its associated likelihood function is unavailable and cannot be evaluated point-wise. However, in our setting, generating independent and identically distributed (iid) realisations \mathbf{x}\sim p(\cdot\,|\,\theta) for a fixed \theta is straightforward. Given a dataset \tilde{\mathbf{x}} collected via real-world experiments from some true data-generating process and a prior distribution on the parameters p(\theta) , we are interested in approximating the posterior distribution p(\theta\,|\,\tilde{\mathbf{x}})\propto p(\tilde{\mathbf{x}}\,|\,\theta)p(\theta) . This can be achieved, for instance, using