Mind the Gap: Navigating Inference with Optimal Transport Maps
Malte Algren ( [email protected] ), Tobias Golling ( [email protected] ), Francesco Armando Di Bello ( [email protected] ), Christopher Pollard ( [email protected] ) · 2025
Read Mind the Gap: Navigating Inference with Optimal Transport Maps by Malte Algren ( [email protected] ), Tobias Golling ( [email protected] ), Francesco Armando Di Bello ( [email protected] ), Christopher Pollard ( [email protected] ) (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-08867.txt.
Introduction
Machine learning has sharpened the hunt for new physics, but it leans on simulations, and gaps between simulation and real data can quietly bias results. Malte Algren and co-authors present a calibration method based on optimal transport, applied for the first time to high-dimensional simulations. They test it on jet tagging with data modelled on the CMS experiment at the Large Hadron Collider.
Inside a strong classifier, each jet is summarised by a 128-number representation. After the team calibrates that representation with transport maps, the many quantities built on it for later tasks come out properly calibrated too. That opens the door to using jet flavour information in collider analyses without the old bias worries. The authors frame the method as a step toward foundation models that particle physics can trust, and as a general fix for correcting rich simulations across the sciences.
Catalog record
| CREATOR | Malte Algren ( [email protected] ), Tobias Golling ( [email protected] ), Francesco Armando Di Bello ( [email protected] ), Christopher Pollard ( [email protected] ) |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-08867
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Mind the Gap: Navigating Inference with Optimal Transport Maps Malte Algren ( [email protected] ), Tobias Golling ( [email protected] ), Francesco Armando Di Bello ( [email protected] ), Christopher Pollard ( [email protected] ) Abstract Machine learning (ML) techniques have recently enabled enormous gains in sensitivity across the sciences. In particle physics, much of this progress has relied on excellent simulations of a wide range of physical processes. However, due to the sophistication of modern machine learning (ML) algorithms and their reliance on high-quality training samples, discrepancies between simulation and experimental data can significantly limit the effectiveness of ML techniques. In this work, we present a solution to this “mis-specification” problem: a calibration approach based on optimal transport, which we apply to high-dimensional simulations for the first time. We demonstrate the performance of our approach through jet tagging, using a CMS-inspired dataset. A 128-dimensional internal jet representation from a powerful general-purpose classifier is studied; after calibrating this internal “latent” representation, we find that a wide variety of quantities derived from it for downstream tasks are also properly calibrated: using this calibrated high-dimensional representation, powerful new applications of jet flavor information can be utilized in LHC analyses. This is a key step toward allowing properly-calibrated “foundation models” in particle physics. More broadly, this calibration framework has broad applications for correcting high-dimensional simulations across the sciences. 1 Introduction Model mis-specification occurs when the process of generating observations does not belong to the family of statistical models used for inference. This is a growing issue across disciplines: the physical sciences, economics, social sciences, medicine and health. As the use of inference techniques built on complex and precise statistical models, often enabled by sophisticated simulations, becomes more widespread, it is critical to develop techniques that mitigate mis-specification, enabling inference that is both effective and unbiased. In hierarchical models, the likelihood of observing some datum x , given a parameter of interest \theta , is determined by marginalizing over any stochastic latent variable \omega : p(x|\theta)=\int d\omega\,p(x|\omega,\theta)\,p(\omega|\theta) . An important subset of hierarchical models comprises those which factorize, such that x only depends on \theta through \omega , i.e. p(x|\omega,\theta)=p(x|\omega) . In such situations, it may be possible to calculate p(x|\omega) separately, or to constrain it via auxiliary experiments. Indeed, this is often the motivation for constructing the likelihood p(x|\theta) in terms of a latent \omega : when p(x|\theta)\approx\int d\omega\,p(x|\omega)\,p(\omega|\theta) , then both p(x|\omega) and p(\omega|\theta) can be independently derived or verified. Inference on approximately factorizable likelihoods is especially powerful. Scientific instruments are often designed to measure a quantity x independent of the details of the particular experiment, aside from a latent variable \omega . For example, when measuring the weight of an object, an ideal scale is one that provides an accurate and precise estimate of the object’s weight, p(x=\text{estimated weight}|\omega=\text{true weight}) , independently of whether the object is, say, a penguin or a banana ( \theta=\{\text{penguin},\text{banana}\} ). A scale with this factorization property can be calibrated independently using a set of test objects whose weights are well-known. In doing so, the experimenter constructs a good approximation of the scale’s density over outputs for a known input; this can be used to infer the weight of a variety of objects: penguins, bananas, or otherwise. In practice, likelihoods often do not factorize exclusively through some stochastic latent \omega that can be measured in calibration experiments, but they depend on a variety of additional stochastic latents \omega^{\prime} . In such cases, it is not possible to derive the full dependence p(x|\omega,\omega^{\prime}) , but it may still be possible to correct the explicit dependence on \omega . We are aware of two procedures for deriving these corrections to the simulated density, p_{\text{sim}}(x|\omega) , with calibration measurements, p_{\text{data}}(x|\omega) . The first constructs the density ratio s_{\omega}(x)\equiv\frac{p_{\text{data}}^{\text{CR}}(x|\omega)}{p_{\text{sim}}^{\text{CR}}(x|\omega)} (1) using observations in a “calibration region” ( CR ). Inference on \theta is then performed on observations in the “signal region” (SR) using the corrected likelihood p(x|\theta)=\int d\omega\,d\omega^{\prime}\,s_{\omega}(x)\,p_{\text{sim}}(x|\omega,\omega^{\prime})\,p_{\text{sim}}(\omega,\omega^{\prime}|\theta). (2) Thus, corrections derived in the CR are applied in the SR via the weight s_{\omega}(x) ; this is colloquially known as “vertical calibration”. An alternative strategy is to derive the conditional transport function T_{\omega} (and corresponding transport map (T_{\omega})_{\#} ) such that (T_{\omega})_{\#}\,p_{\text{sim}}^{\text{CR}}(x|\omega)\equiv p_{\text{sim}}^{\text{CR}}(T_{\omega}\,x|\omega)=p_{\text{data}}^{\text{CR}}(x|\omega). (3) This transport is subsequently applied in the SR, resulting in the corrected likelihood p(x|\theta)=\int d\omega\,d\omega^{\prime}\,(T_{\omega})_{\#}\,p_{\text{sim}}(x|\omega,\omega^{\prime})\,p_{\text{sim}}(\omega,\omega^{\prime}|\theta). (4) This “horizontal calibration” moves the simulated observations based on what is observed in the calibration region. The suitable transport map for correcting simulations is the optimal one, i.e. the one which minimally alters p_{\text{sim}}(x|\omega) for each choice of \omega while still closing with p_{\text{data}}(x|\omega) . The optimal transport (OT) map is solution to this closure problem that is least invasive, in the sense that it preserves the full structure of p_{\text{sim}}(x|\omega,\omega^{\prime}) as well as possible. It is worth noting that, in the limit that \omega captures all the mismodeling of the simulation p_{\text{sim}}(x|\omega,\omega^{\prime}) , then the the corrected simulation converges to the “true” likelihood p_{\text{data}} . This is true for both vertical and horizontal strategies. While it is not the focus of this article, the choice of \omega against which one parameterizes the corrections is important; enabling corrections that are so conditioned on a maximally-informative \omega , of potentially very high-dimensions, is an active field of research. In the past several years, ML-based solutions to both the vertical and horizontal calibration problems have been developed. Density ratio estimation (DRE) via neural-network (NN) classifiers is a well-established technique that scales well to high dimensions in both x and \omega [ 1 ] . More recently, neural OT solvers have been introduced [ 2 , 3 , 4 , 5 ] , enabling the derivation of optimal transport maps for horizontal calibrations of multi-dimensional simulations from which samples can be drawn [ 6 , 7 ] . As we scale into higher dimensions, it is important to recognize that the horizontal and vertical strategies are distinct solutions to the calibration problem and exhibit different behaviors. In sample-based simulations, the reweighting function s_{\omega}(x) used in vertical calibration will, in general, dilute the statistical power of the simulated samples by a factor \rho_{\omega}=\frac{1}{N}\frac{(\sum_{i}^{N}s_{\omega}(x_{i}))^{2}}{\sum_{i}^{N}s_{\omega}(x_{i})^{2}}. (5) Horizontal calibration does not introduce a dilution. Indeed, for well-behaved spaces (e.g. Euclidean space), a horizontal solution to a given calibration problem always exists; for vertical calibrations, a solution only exists if \forall\,x\ \omega.\ p_{\text{data}}(x|\omega)>0\Rightarrow p_{\text{sim}}(x|\omega)>0 , i.e. the simulated distribution fully supports the data distribution and s_{\omega} is always finite. These properties originate from the fact that an optimal transport distance between densities p and q over a space Y is well-defined under rather loose conditions on Y [ 8 ] , while vertical calibrations inherently depend on the KL- divergence between p and q to be finite [ 9 ] . In this article we explore a concrete example of an important calibration problem in particle physics. Data analysis in High Energy Physics (HEP) experiments at the Large Hadron Collider (LHC) aims to study the fundamental properties of matter by analyzing the complex final states resulting from high-energy collisions. These analyses rely on a hierarchical stochastic calculations, where simulations of the underlying “hard process,” involving fundamental particles, approximately factorize from the subsequent evolution into stable particles that eventually interact with the detector,