Defining a Minimum Resolution for Unbinned Analyses
2026
Read Defining a Minimum Resolution for Unbinned Analyses (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-28498.txt.
Introduction
Manuel Szewc, writing alone, protects collider searches from their own machine learning. Modern analyses often let a learned model estimate the background likelihood directly. But systematic effects inside that estimate are hard to quantify and can bias the signal strength a search reports, the very number the experiment exists to measure.
Szewc's Minimum Resolution Likelihood method defines a fiducial signal region chosen so that the troublesome systematic effects are converted into ordinary statistical uncertainties. On toy examples and on a realistic application, a di-Higgs search using the HI-SIGMA technique, the resulting signal strength estimates come out either unbiased or consistent with zero. Rather than trusting a black box harder, the method redraws the analysis boundary so its errors become countable.
Catalog record
| YEAR | 2026 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.28498
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Defining a Minimum Resolution for Unbinned Analyses Abstract Collider analyses combine rigorous statistical techniques with state-of-the-art Machine Learning models. However, when the latter are used directly to estimate the likelihood function of the background, hard to quantify systematic effects may bias the estimation of the relevant signal parameters. To address this problem, we present the Minimum Resolution Likelihood ( MRL \mathrm{MRL} ) method, which defines a Fiducial Signal Region that effectively turns the systematic effects into statistical uncertainties. We show with examples that the resulting signal strength estimation is either unbiased or consistent with zero. We consider both toy examples and a realistic application based on the HI-SIGMA technique applied to di-Higgs searches. Manuel Szewc a 1 1 1 [email protected] a International Center for Advanced Studies (ICAS) and ICIFI-CONICET, UNSAM, 25 de Mayo y Francia, CP1650, San Martín, Buenos Aires, Argentina 1 Introduction High-energy physics experiments, and in particular collider analyses, have long benefitted from rigorous statistical techniques [ 1 ] that take advantage of the quality of the measurements to extract information about the fundamental parameters of our theories. A key part of any analysis is the proper definition of the background processes, from which we want to extract a signal (which in high-energy physics is not done in terms of outlier events but as estimations of parameters of interest that capture over or under-densities of the data with respect to the backgrounds). If available, state-of-the art generators with appropriate uncertainties are preferred, since they define the background unambigously. However, for some cases this is not possible, due to a combination of compute cost and simulator accuracy, and data-driven backgrounds are estimated. This is not a “niche” problem, as data-driven backgrounds are considered for “bread and butter” analyses at the LHC, e.g. to estimate multi-jet backgrounds [ 2 , 3 , 4 ] . Traditional data-driven background estimation techniques are confined to few dimensions in feature space, which, although already powerful, restrict the power of the analysis. With the advent of Machine Learning techniques the situation has changed, however, and data-driven backgrounds have been computed in large dimensions, both for specific searches [ 2 , 3 , 4 ] and in the context of Anomaly Detection [ 5 , 6 , 7 , 8 , 9 , 10 ] . Although this increases significantly the power of the analyses, so does the risk of bias and uncertainty underestimation, which have motivated several proposed solutions [ 11 , 12 , 13 ] . However, this remains an open problem and it is hard to estimate the biases and uncertainties associated with the use of a data-driven model defined over many dimensions in an unbinned analysis. Moreover, the issue is not confined to data-driven models. Even when trained on simulations, the use of unbinned multivariate models (which can originate from either classifiers or density estimation algorithms) to estimate parameters of interest in what is known as Simulation Based Inference (SBI) [ 14 , 15 , 16 , 17 , 18 , 19 , 20 , 21 , 22 , 23 , 24 ] can lead to uncontrollable biases when the analysis is powerful enough that it is sensitive to the bias of the unbinned model with respect to the training distribution (or even to the bias of the original simulations themselves with respect to the true background model). One possible failure mode originating from this model bias is the overestimation of the signal-to-background likelihood ratio in the regions where the signal is present, with a consequent overestimation of the number of signal events in the sample. 2 2 2 The converse case, where we overestimate the background and underestimate the signal, is of course worrisome since we would miss signals that are there, but is “nicer” in the sense that it requires daring, not conservative, solutions. Moreover, we are usually more concerned about overestimating signals, not underestimating them. This may happen for example when the background model underestimates the probability density in the region where signal and background overlap due to the unbinned, high-dimensional background model wrongly “spilling” probability density into the tails due to training artifacts or architectural biases. In this work, we propose a very simple solution to signal overestimation due to background mismodelling, which is not meant as a “be-all, end-all patch” but simply as a conservative band-aid that trades systematic uncertainties for statistical uncertainties. We claim that for some analyses this trade-off is worth it, since it allows the use of more powerful techniques. The method, which we call the Minimum Resolution Likelihood ( \mathrm{MRL} ) method, can be summed up very easily: for a given background model that is meant to be applied in a Signal Region, we consider an additional Calibration Region where there is only the background and which we use to define a minimum resolution in a smartly chosen feature below which we do not trust the model. Thus, any events in Signal Region that fall below that resolution are discarded, defining a Fiducial Signal Region where the statistical analysis is performed. 3 3 3 Similar issues, and the introduction of an analogue resolution concept, can be found in the generative model literature when discussing amplification [ 25 ] . In this way, we effectively turn systematic uncertainties over the background model itself into statistical uncertainties due to the more limited sample size of the data sample. A more succinct list of requirement and assumptions for the \mathrm{MRL} method to be useful can be found in Box 1 . Box 1: Requirements and assumptions Requirements for applicability: • A background model that allows both to evaluate the likelihood and to generate samples. • A Calibration Region with background-only distributions (or at least closer to the true background than the model). Assumptions for usefulness: • The difference between the background model and the true background results in the underestimation of background in the Signal Region for the no-signal case. In other words, for a given signal model we assume the background model induces an overestimation of the signal-to-background likelihood ratio in regions where the signal is present. • The Fiducial Signal Region is such that some fraction of the signal distribution is retained. Thus, there will be a minimum number of signal events for which we are still sensitive and the resulting drop in power due to the discarded events (trading uncontrollable systematic error for statistical error) is offset by the use of the unbinned likelihood-based techniques in the first place. The work is structured as follows. In section 2 we introduce the \mathrm{MRL} method, including how we obtain the minimum likelihood itself and how we use it to define a Fiducial Signal Region. In section 3 we apply the \mathrm{MRL} method to two toy examples to showcase its capabilities and possible drawbacks. In section 4 we show \mathrm{MRL} can improve a realistic di-Higgs study based on the HI-SIGMA technique introduced in Ref. [ 26 ] . We conclude and discuss future directions in section 5 . Additional interpretations of the minimum likelihood can be found in the two appendices, A and B . 2 Prescription In this section, we introduce the problem of model misspecification more explicitly ( section 2.1 ) and detail