Analysis-ready Generative Unfolding
Anja Butter, Nathan Huetsch, Vinicius Mikuni, Benjamin Nachman, and Sofia Palacios Schweitzer · 2025
Read Analysis-ready Generative Unfolding by Anja Butter, Nathan Huetsch, Vinicius Mikuni, Benjamin Nachman, and Sofia Palacios Schweitzer (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-02708.txt.
Introduction
Anja Butter and four co-authors wrote a 2025 particle physics paper on unfolding. Unfolding removes detector smearing from data. It recovers the true distributions of particles. Machine learning methods now handle high-dimensional, unbinned data. Most ignore real-world flaws, though.
Real data also hold stray events that do not belong. Finite detector reach and efficiency matter too. The authors extend generative unfolding to cover that full suite of effects. Two variants are offered. One is fully generative. The others mix generative and discriminative steps. Tests use a Gaussian case and a simulated collider dataset. Both handled all effects. The authors call theirs an analysis-ready option for the toolkit.
Catalog record
| CREATOR | Anja Butter, Nathan Huetsch, Vinicius Mikuni, Benjamin Nachman, and Sofia Palacios Schweitzer |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-02708
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Analysis-ready Generative Unfolding Anja Butter, Nathan Huetsch, Vinicius Mikuni, Benjamin Nachman, and Sofia Palacios Schweitzer Abstract Machine Learning (ML)-based unfolding methods have enabled high-dimensional and unbinned differential cross section measurements. While a suite of such methods has been proposed, most focus exclusively on the challenge of statistically removing resolution effects. In practice, unfolding methods must also account for impurities and finite acceptance and efficiency effects. In this paper, we extend a class of unfolding methods based on generative ML to include the full suite of effects relevant for cross section measurements. Our new methods include fully generative solutions as well as generative-discriminative hybrid approaches (GenFoldG and GenFoldC). We demonstrate these new techniques in both Gaussian and simulated LHC examples. Overall, we find that both methods are able to accommodate all effects, thus adding a complementary and analysis-ready method to the unfolding toolkit. 1 Introduction Particle physics experiments seek to understand the properties of and the interactions between fundamental particles. To do so, complex detectors measure outgoing particle properties and the underlying phenomena are inferred. The inference step is either performed at the detector-level by forward-folding predictions with simulations of the detector or by first statistically removing the effects of the detector – also known as unfolding – before comparing the data to particle-level predictions. In either case, the classical approach is to compress and discretize the high-dimensional data into binned, differential cross sections represented as histograms. This has enabled nearly all measurements to date, but significantly reduces the statistical power of the data. Machine Learning (ML) has provided a solution to this challenge by enabling high-dimensional and unbinned inference Cranmer:2019eaq . For unfolding Arratia:2021otl ; Huetsch:2024quz ; Canelli:2025ybb , this means that binnings and even observables can be chosen after the measurement, ushering in a new analysis that increases the breadth and longevity of particle physics science results. One class of unbinned unfolding methods based entirely on discriminative (classifier based) ML called OmniFold Andreassen:2019cjw ; Andreassen:2021zzk has already been employed for a diverse set of differential cross section measurements and studies across experiments including ATLAS ATLAS:2024xxl ; ATLAS:2025qtv , CMS Komiske:2022vxg ; CMS:2025sws , LHCb LHCb:2022rky , H1 H1:2021wkz ; H1:2023fzk ; H1:2024mox ; h1_full_phase_space , STAR Song:2023sxb ; Pani:2024mgy , T2K Huang:2025ziq , and ALEPH Badea:2025wzd . Given the ill-posed nature of unfolding, it is essential to have multiple methods. A number of generative ML-based unfolding techniques have also been proposed to enable unbinned, high-dimensional cross section measurements. Such approaches include methods that generate particle-level events based on detector-level events using conditional generative networks Datta:2018mwd ; Bellagente:2019uyp ; Bellagente:2020piv ; Howard:2021pos ; Backes:2022sph ; Ackerschott:2023nax ; Shmakov:2023kjj ; Shmakov:2024gkd ; Pazos:2024nfe ; Favaro:2025psi or distribution mapping Diefenbacher:2023wec ; Butter:2023ira ; Butter:2024vbx , as well as approaches using surrogates of the detector simulation to adjust the particle-level distribution such that the forward-folded prediction best reproduces the observed data Alanazi:2020jod ; Vandegar:2020yvw ; Butter:2025via . The former class of techniques that generate particle-level events with detector-level inputs are inherently dependent on the starting particle-level simulation used to train the generative model. This dependence can be mitigated by iterating the training of the generative model Backes:2022sph , removing one of the largest sources of measurement bias. Generative unfolding proposals have so far focused exclusively on the statistical removal of resolution effects 1 1 1 The full protocol for classifier-based approaches is discussed in Ref. Andreassen:2021zzk ; Falcao:2025jom and in the experimental papers cited above. . While critical, this is not the only effect that is relevant in practice. Additional tasks include the removal of background processes, correcting for events that are registered at detector-level, but not particle-level (fakes 2 2 2 Fakes and background are conceptually similar. Indeed, one solution to addressing backgrounds is to treat them as fakes. We treat them separately here because they are usually estimated and processed differently in practice. ), and correcting for events that are registered at particle-level, but not detector-level (misses). Each of these must also be processed unbinned and in many dimensions for the final result to retain these properties. In this paper, we extend iterative, generative unfolding methods to include sample impurity (backgrounds), acceptance (fakes), and efficiency (misses) effects. In addition to building on the iterative unfolding algorithm introduced in Ref. Backes:2022sph , we also develop a new iterative approach. We start by introducing the methodology of our generative unfolding pipeline in Sec. 2 and formulate correction algorithms which can be implemented either with classifiers or generative neural networks. We present each classifier- and generator-based correction thoroughly with the necessary mathematical and computational formalism as well as illustratively, with a Gaussian example in Sec. 3 . We then proceed to unfold a 6-dimensional simulated dataset, building on a well-studied benchmark that now includes background. This dataset consists of single jet substructure observables and is unfolded in Sec. 4 utilizing the full generative unfolding pipeline for the first time on a physics example. 2 Methodology Emulated events in particle physics are created by chaining together a suite of Monte Carlo simulation tools. The set of tools consists of multiple parts: hard scattering, parton showering, hadronization, and the simulation of the detector response. Depending on the physics analysis we can unfold for instance to parton level, i.e. the final state of the hard scattering, or particle level, i.e. the representation of an event before it enters the detector simulation. The data themselves are given at detector-level or reco-level, which corresponds to the final stage of the simulation, when event reconstruction is applied to the output of the detector simulation. While unfolding of hadronization and/or parton shower effects has been performed in previous studies Bellagente:2020piv ; Bellagente:2021yyh ; Shmakov:2024gkd , we will focus in this paper on unfolding detector effects only. p(x)_{r,\bar{g}} p(x)_{\bar{r},g} p(x)_{r,g} x reco-level selection gen-level selection Figure 1: Graphical description of different reco-level phase spaces. Since we simulate the entire chain, pairs of events at both gen- and reco-level are available for further analysis. Using these pairs, we can learn to simulate both the detector effects (from gen-level to reco-level) as well as to estimate the unfolding response (from reco-level to gen-level). Starting from the signal simulation of gen-level collisions y_{s}\sim p_{\text{MC},s}(y) , we determine reco-level objects x_{s}\sim p_{\text{MC},s}(x) from the detector simulation. In addition to the signal process, background processes can also be present in the data, resulting in samples x_{b}\sim p_{\text{MC},b}(x) . Simulations of the background process at gen-level are not needed since we subtract the background from the data before unfolding 3 3 3 This is standard, in part because it simplifies the next steps. However, it usually requires a strict event selection and this results in large acceptance effects. Unbinned unfolding makes it possible to apply nontrivial event selections after unfolding so this order may be revisited in the future. . Acceptance and efficiency effects arise from events whose pairs are not present either at reco- or gen-level. This is caused by the choice of fiducial region under study and the finite resolution of the detector response. In order to model acceptance and efficiency effects, we keep track of a flag that identifies whether a given event has passed the reco-level, gen-level, or both selections. For example, reco-level events