Inductive Domain Transfer In Misspecified Simulation-Based Inference
Ortal Senouf, Cédric Vincent-Cuaz, Emmanuel Abbé, Pascal Frossard · 2025
Read Inductive Domain Transfer In Misspecified Simulation-Based Inference by Ortal Senouf, Cédric Vincent-Cuaz, Emmanuel Abbé, Pascal Frossard (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-15593.txt.
Introduction
Fitting a model's hidden numbers from its output is hard when the model is a rough sketch of the real thing. Ortal Senouf and co-authors build a fix in 2025 that learns once and then answers fast. A recent method they build on needs a batch of test cases in hand each time, which caps its reach. Their way folds the fix into one trained net. Paired cases, some real and some made, teach the net to line the two worlds up.
A shape-shifting flow then learns the matched odds, so new cases need no fresh simulation. On made-up and real tests, among them a hard medical marker task, the method matched or beat the older fix and plain rivals. It also scales to bigger loads, the team say.
Catalog record
| CREATOR | Ortal Senouf, Cédric Vincent-Cuaz, Emmanuel Abbé, Pascal Frossard |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-15593
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Inductive Domain Transfer In Misspecified Simulation-Based Inference Ortal Senouf, Cédric Vincent-Cuaz, Emmanuel Abbé, Pascal Frossard Abstract Simulation-based inference (SBI) is a statistical inference approach for estimating latent parameters of a physical system when the likelihood is intractable but simulations are available. In practice, SBI is often hindered by model misspecification–the mismatch between simulated and real-world observations caused by inherent modeling simplifications. RoPE, a recent SBI approach, addresses this challenge through a two-stage domain transfer process that combines semi-supervised calibration with optimal transport (OT)-based distribution alignment. However, RoPE operates in a fully transductive setting, requiring access to a batch of test samples at inference time, which limits scalability and generalization. We propose here a fully inductive and amortized SBI framework that integrates calibration and distributional alignment into a single, end-to-end trainable model. Our method leverages mini-batch OT with a closed-form coupling to align real and simulated observations that correspond to the same latent parameters, using both paired calibration data and unpaired samples. A conditional normalizing flow is then trained to approximate the OT-induced posterior, enabling efficient inference without simulation access at test time. Across a range of synthetic and real-world benchmarks–including complex medical biomarker estimation–our approach matches or surpasses the performance of RoPE, as well as other standard SBI and non-SBI estimators, while offering improved scalability and applicability in challenging, misspecified environments. 1 Introduction Inference of latent variables that describe important properties of physical systems is a fundamental problem in many domains, including environmental maksyutov2020high ; sahranavard2023inverse , mechanical dolev2019noncontact ; pei2022improved ; sessa2020inverse , and physiological sun2005estimating ; sanyal2023noninvasive ; hauge2025non systems. Traditionally, this problem has been approached by formulating a mathematical model that relates the observations {\bm{x}} to the latent parameters of interest \bm{\theta} , and solving the corresponding inverse problem to infer \bm{\theta} from {\bm{x}} ljung1995system ; vogel2002computational . Modern machine learning (ML) has achieved remarkable success in complex tasks, sparking interest in its application to inferring latent parameters from observations. However, standard supervised learning is often impractical in this context, as ground-truth parameter data is typically expensive or infeasible to obtain—for instance, in medical applications where direct measurements may require invasive procedures. Physics-informed machine learning has emerged as a powerful paradigm for addressing these challenges by embedding physical priors or actual simulators into learning frameworks, enabling models to be more data-efficient and generalizable raissi2019physics ; karniadakis2021physics ; cuomo2022scientific ; greydanus2019hamiltonian ; cranmer2020lagrangian . Nevertheless, the performance of this framework critically depends on the fidelity of the physics-based priors or simulators relative to the true system physics. To mitigate the simulation-to-reality gap, recent works have proposed hybrid learning approaches yin2021augmenting ; takeishi2021physics ; wehenkel2023robust , wherein the simulator is integrated with ML components to produce more accurate models of the system. While this strategy provides a useful inductive bias, it often requires simulators that are differentiable and computationally efficient, which can limit its applicability to realistic and complex systems. Another prominent line of work that incorporates simulations into the learning framework is simulation-based inference (SBI) cranmer2020frontier . SBI trains ML models on simulated data to directly estimate parameters while capturing uncertainty through posterior estimation, becoming a cornerstone in scientific domains brehmer2021simulation ; hashemi2022simulation ; luckmann2022simulation ; tolley2024methods ; avecilla2022neural . However, several works have identified the sensitivity of SBI to model misspecification, as its performance often depends on the fidelity of the simulator to the true system cannon2022investigating ; schmitt2023detecting . To mitigate this issue, some studies have introduced additional variables or model components to explicitly capture such discrepancies ward2022robust ; kelly2023misspecification ; huang2023learning . A recent work introduces RoPE wehenkel2024addressing , an SBI approach designed to address model misspecifications through a two-stage, semi-supervised domain transfer strategy. The first stage focuses on pointwise calibration using a small set of labeled real observations—that is, observations for which the corresponding latent parameters \bm{\theta} are known. The second stage then uses optimal transport (OT) to match the embeddings of a batch of real test observations with those of simulated observations. The resulting OT plan provides weights that define the estimated posterior as a weighted mixture of the posterior distributions associated with the simulated samples. While effective, this approach is inherently transductive, it requires a batch of test samples for inference, limiting its applicability in scenarios that require inductive inference. In many real-world settings, access to a batch of test-time observation is unrealistic, and the inferred posterior for a given single test input can vary depending on the batch it is embedded in—undermining stability and reproducibility. Additionally, the strict separation between pointwise and distribution-wise alignment may prevent full exploitation of their complementary strengths. In this work, we propose a new framework that provides an inductive domain transfer solution to the misspecified SBI problem (illustrated in Fig. 1 ). Building upon elements of RoPE, we amortize the optimal transport (OT) step with a neural network using a mini-batch OT formulation fatras2021minibatch ; fatras2021unbalanced . We further derive a closed-form solution for a relaxation of the OT problem, which facilitates stochastic gradient descent (SGD) training and enables joint optimization of the OT objective alongside pointwise fitting to the labeled calibration data. Finally, we use a density estimation model in the form of normalizing flows to amortize the posterior mixture solution, defined by the OT-derived weights and the posterior distributions of the corresponding simulated samples. The key advantages of our proposed approach are as follows: • Inductive Joint Training of Alignment Steps: Enables end-to-end training of both pointwise and distribution-wise alignment, better leveraging their complementary strengths. • Amortised Posterior Estimation: Provides a scalable, inductive solution for OT-based posterior estimation, eliminating the need to repeatedly access simulations during inference. We show that our method, while fully inductive and applicable to individual test samples, achieves competitive—and often superior—performance compared to the transductive RoPE baseline across a range of benchmarks. This includes both synthetic and real-world datasets, with strong results in terms of accuracy and calibration, even in challenging settings such as complex biomarker estimation. Figure 1: FRISBI Overview. Similar to RoPE wehenkel2024addressing , we assume a trained neural statistics encoder (NSE), h_{\omega^{\star}} , that maps simulation data {\bm{x}}_{s} to embeddings h_{\omega^{\star}}({\bm{x}}_{s}) , and a neural posterior estimator (NPE), q_{\psi^{\star}} , which estimates simulated posterior distributions. FRISBI performs: (1) Joint optimal transport (OT) and supervised learning. Both paired and unpaired samples contribute to the OT plan (dashed lines), weighted by \alpha_{j} . Supervised samples from \mathcal{D}_{calib} (solid lines) anchor the OT matching. The real-observations encoder g_{\phi} is fine-tuned to optimize representations for both supervised learning and OT-based domain transfer. (2) A conditional density estimator , q_{\xi} , approximates the posterior arising from the OT-based mixture of posteriors. 2 Background 2.1 Simulation-Based Inference and Neural Posterior Estimation When performing statistical inference of latent physical parameters, the goal is typically framed as posterior estimation—that is, estimating the distribution of parameters \bm{\theta} given an observation {\bm{x}} . A standard approach is to compute the likelihood p({\bm{x}}\mid\bm{\theta}) and apply Bayes’ rule to obtain the posterior p(\bm{\theta}\mid{\bm{x}}) . However, this approach becomes impractical when the likelihood is intractable or difficult to amortize. Simulation-Based Inference (SBI) cranmer2020frontier offers a solution in such cases. It refers to a class of methods for performing inference without requiring an explicit likelihood function, assuming access to a simulator.