Many Wrongs Make a Right: Leveraging Biased Simulations Towards Unbiased Parameter Inference Preprint: MIT-CTP/6024
Ezequiel Alvarez, Sean Benevedes, Manuel Szewc, Jesse Thaler · 2026
Read Many Wrongs Make a Right: Leveraging Biased Simulations Towards Unbiased Parameter Inference Preprint: MIT-CTP/6024 by Ezequiel Alvarez, Sean Benevedes, Manuel Szewc, Jesse Thaler (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-02219.txt.
Introduction
Alvarez and colleagues turn biased simulations into unbiased parameter estimates. In particle physics, inference leans on simulations, but gaps between simulation and data bias results. Their Template Adapted Mixture Model uses many biased runs to estimate each process spread in the signal region from data, cutting bias in the signal fraction. Tests on a Gaussian toy example and a semi realistic di Higgs measurement give well calibrated uncertainties.
Catalog record
| CREATOR | Ezequiel Alvarez, Sean Benevedes, Manuel Szewc, Jesse Thaler |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 123644 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.02219
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Many Wrongs Make a Right: Leveraging Biased Simulations Towards Unbiased Parameter Inference Preprint: MIT-CTP/6024 Ezequiel Alvarez, Sean Benevedes, Manuel Szewc, Jesse Thaler Abstract In particle physics, as in many areas of science, parameter inference relies on simulations to bridge the gap between theory and experiment. Recent developments in simulation-based inference have boosted the sensitivity of analyses; however, biases induced by simulation–data mismodeling can be difficult to control within standard inference pipelines. In this work, we propose a Template-Adapted Mixture Model to confront this problem in the context of signal fraction estimation: inferring the population proportion of signal in a mixed sample of signal and background, both of which follow arbitrarily complex distributions. We harness many biased simulations to perform data-driven estimates of each process distribution in the signal region, substantially reducing the bias on the signal fraction due to the domain shift between simulation and reality. We explore different methodological choices, including model selection, feature representation, and statistical method, and apply them to a Gaussian toy example and to a semi-realistic di-Higgs measurement. We find that the presented methods successfully leverage the biased simulations to provide estimates with well-calibrated uncertainties. I Introduction In science, we construct and test models of reality. Often, as in high-energy physics with its Standard Model, these models are parametrized and probabilistic: we perform an experiment to estimate the parameters of the model, generate predictions about the expected distribution of observations, and then test these predictions in other experiments. Statistical inference, through parameter estimation and hypothesis testing, is the toolkit that allows us to rigorously evaluate our models. However, this statement of the scientific method relies on there being a model that we actually expect to describe the data in its entirety. Instead, we often find ourselves in situations where we expect a model to be trustworthy in some regards, but we know it to be deficient in others. That is, we have model misspecification : the model does not actually describe the process by which natural data are generated, so statistical inference using the model will be biased. It is then natural to ask whether (and how) we can use these misspecified models, which do not faithfully describe some aspects of the data, to make inferences about other aspects that we do trust. As a concrete example studied below, we may wish to measure the rate of di-Higgs production and decay to four b -jets relative to other Standard Model processes, so that we may compare this rate to theoretical predictions and test the Standard Model. We trust our models insofar as we do believe that there is a signal process well-described as decays of two Higgs bosons and there are background processes well-described by other Standard Model physics, but we know that our individual models of these processes will have shortcomings due to limited perturbative accuracy, nonperturbative physics, detector mismodeling, and so on. The task is then to perform robust statistical inference in the presence of this kind of model misspecification. In this paper, we confront the problem of individual signal and background model misspecification for a mixed sample of signal and background in the context of signal fraction estimation with simulation-based inference (SBI). We accomplish this by leveraging multiple misspecified models, which we will call misspecified simulated distributions (MSDs), in order to model the target distribution (TD) with higher fidelity than any individual MSD. To do this, we define component models, which are derived from the MSDs, and consider simple parametric combinations of these components as our models of the signal and background processes, and infer the parameters governing these combinations and the mixing fraction itself from the target data. We call the total mixture model of the parametric signal and background models built from the individual component models a Template-Adapted Mixture Model ( TAMM ). We find in a Gaussian toy example and in a collider physics case study that implementing a TAMM addresses misspecification and robustly infers the signal fraction with well-calibrated uncertainties. Furthermore, the statistical power derived from these uncertainties is not much reduced compared to traditional SBI techniques with correctly specified MSDs. Though we are motivated by examples in high-energy physics, we emphasize that these ideas are applicable more broadly in the sciences. Our approach is complementary to the traditional treatment of systematic uncertainties via nuisance parameters. The standard approach parametrizes known sources of uncertainty and profiles or marginalizes over them during inference, which works when the TD lies within the model family indexed by the nuisance parameters. This approach, however, does not address residual misspecification beyond the reach of these variations. Our method targets precisely this residual domain shift, using the MSDs, which may themselves be generated by varying nuisance parameters, as building blocks for a more flexible model that can interpolate or extrapolate beyond the space spanned by standard systematic variations. Several existing methods address the problem of constructing predictions by interpolating between discrete simulations. Template morphing 45 , as implemented in HistFactory 21 , interpolates bin heights between histograms generated at discrete values of nuisance parameters, while moment morphing 8 generalizes this by interpolating in the space of moments rather than directly in probability space. In both cases, the interpolation is parametrized by a set of nuisance parameters which are then profiled or marginalized during inference. Our method can be understood as a generalization of these ideas: our linear TAMM (Sec. II.2.1 ) performs the same kind of interpolation as the vertical template morphing, and our exponential TAMM (Sec. II.2.2 ) parallels the philosophy of horizontal template and moment morphing by interpolating between MSDs horizontally. In both cases, though, our combination weights are fully independent rather than being related to one another through a shared set of nuisance parameters. This is particularly appropriate when the available simulations are not naturally organized along continuous parametric directions, as is the case when the MSDs originate from qualitatively different sources of misspecification. In particular, this allows the data to select a combination of component models which may not correspond to any single value of a conventional nuisance parameter — this is one sense in which the templates are adapted rather than morphed. Moreover, our unbinned pipeline (Sec. III ) extends this idea beyond the binned setting in which morphing techniques are traditionally formulated, using neural ratio estimation to perform the interpolation directly in continuous phase space. The structure of this article is as follows: in Sec. II we expand on the problem statement, discuss the specific parametric combinations of the model components which we consider as our models, and define the other methodological choices necessary to operationalize statistical inference with these models. In Sec. III , we introduce the first of two inference pipelines that we consider, using an unbinned representation of the data to perform frequentist SBI with neural networks (NNs). Then, in Sec. IV , we introduce the second inference pipeline we consider, this time using a binned representation of the data and topic modeling to perform Bayesian inference. We apply these two pipelines to a toy model in Sec. V and to a semi-realistic example based on di-Higgs simulations in Sec. VI . We discuss the results and the complementarity of the two proposed methods in