Model-Agnostic Signal Discovery with Machine Learning:
Bridging the Gap Between Theory and Practice · 2026
Read Model-Agnostic Signal Discovery with Machine Learning: by Bridging the Gap Between Theory and Practice (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-31103.txt.
Introduction
Amram, Letizia, and Kuusela review model-free signal discovery with machine learning, bridging theory and practice. Searches for new phenomena are model-based, tuned to chosen ideas, limiting coverage. New AI-based model-free strategies, started in high-energy physics, favor broad search over tailored studies, raising search potential where theory guidance is scarce. They review the framework behind classes of them, discuss pitfalls, and strategies for checks and reading. They aim for the document to serve as a reference for users and scholars keen on model-free search.
Catalog record
| CREATOR | Bridging the Gap Between Theory and Practice |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 106196 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.31103
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Model-Agnostic Signal Discovery with Machine Learning: Bridging the Gap Between Theory and Practice Abstract Oz Amram 1 \star , Marco Letizia 2,3 \dagger and Mikael Kuusela 4 {\ddagger} 1 Fermi National Accelerator Laboratory, Batavia, IL 60510, USA 2 MaLGa-DIBRIS, Università di Genova, Via Dodecaneso 35, I-16146 Genoa, Italy 3 INFN, Sezione di Genova, Via Dodecaneso 33, I-16146 Genoa, Italy 4 Department of Statistics and Data Science, Carnegie Mellon University, Pittsburgh, PA 15213, USA \star [email protected] \dagger [email protected] {\ddagger} [email protected] Abstract Searches for new phenomena in complex scientific data are predominantly model-dependent, optimized for specific hypotheses, and therefore limited in their coverage of the space of possible signals. Recently, new AI-based model-agnostic search strategies, many of which have been pioneered in high-energy physics, have been proposed which provide a complementary paradigm, prioritizing broad exploration over tailored analyses. These techniques offer an opportunity to enhance the overall discovery potential of modern experiments, especially in regimes where theoretical guidance is scarce. In this document, we review the conceptual framework behind the main classes of AI-based model-agnostic strategies. We discuss the potential pitfalls of these methods, and strategies for their validation and interpretation. We aim for this document to serve as a useful reference both for practitioners and for researchers interested in learning more about these model-agnostic search strategies. Copyright attribution to authors. This work is a submission to SciPost Phys. Comm. Rep. License information to appear upon publication. Publication information to appear upon publication. Received Date Accepted Date Published Date 1 Introduction One of the primary research activities in the field of high-energy physics (HEP) is the analysis of large datasets to search for evidence for new phenomena. To accommodate the large volume and high complexity of the data, and achieve gains in sensitivity, searches for new phenomena often restrict their scope to specific models or classes of new particles. Other approaches instead attempt to make minimal assumptions and probe a broad range of possibilities, but achieve reduced sensitivity as compared to dedicated searches. This gives rise to two families of methods: model-dependent and model-agnostic (or model-independent ) approaches. Model-dependent searches are designed on the basis of well-specified background and signal hypotheses. They look for deviations from a background model while incorporating properties of hypothetical signals (such as particle masses, decay modes, or kinematic distributions) and optimize the analysis to enhance sensitivity to these signatures, for example by focusing on a few relevant high-level features such as an invariant mass. For any specific hypothesis to be tested, these methods are generally the most powerful. Indeed the likelihood-ratio test, used ubiquitous in HEP data analyses, is guaranteed by the Neyman–Pearson lemma [ 1 ] to be the most powerful test for fully specified background and signal hypotheses. However, their sensitivity is typically limited to a narrow region of the whole space of possible new physics scenarios and observables, and they heavily rely on high-fidelity models for the background processes. In contrast, model-agnostic searches are designed to minimize assumptions about the signal and/or the background. It is in fact useful to distinguish between background- and signal-agnostic methods as illustrated in Figure 1 . These approaches are valuable when there is little guidance from theory or when predictions via Monte Carlo simulations are not particularly accurate or reliable. In this review we will focus on the case where minimal assumptions are being made about the signal hypothesis. Different techniques will be required depending on the degree to which the background hypothesis is well specified. While model-agnostic methods enable exploration of a broader spectrum of potential new physics signatures, they lack the sensitivity of model-dependent strategies for specific signals and often require careful statistical validation to control false discovery rates. They also face crucial challenges in their interpretation, both in the case of a significant discrepancy and in the reporting of exclusion limits. Furthermore, it is worth highlighting that a model-agnostic search is still typically restricted to a subset of final states and observables that are physically motivated or experimentally accessible. In practice, most analyses fall somewhere between these two extremes. For example, bump hunts [ 2 ] , which search for localized excesses, can be considered partially model-independent: they do not depend on specific particle-physics models and often rely on data-driven estimates of the background [ 3 , 4 , 5 , 6 ] , yet they still assume that any signal will appear as a localized excess in a particular variable (for example, an invariant-mass distribution) within a predefined signal region. Another approach is to consider a comprehensive enumeration of final states, typically hundreds to thousands, while defining a small set of observables for each, and compare the observed data in each final state to simulations of the background processes. One then defines a statistical procedure to quantify the largest contiguous deviations across the entire search space. Such a strategy was first deployed in experiments at the Tevatron and HERA [ 7 , 8 , 9 , 10 , 11 , 12 ] and has been continued by current LHC experiments [ 13 , 14 ] . This approach makes minimal assumptions about the signal but assumes backgrounds are well modeled by simulation. While this method has the benefit of covering a large signal parameter space, it has several limitations. Anomalies are again generally assumed to appear as contiguous deviations in the selected observables. Moreover, since no multivariate information is utilized, anomalies appearing in final states with large backgrounds are likely to be missed. Finally, the heavy reliance on simulation, which may have imperfections in exotic final states, limits the sensitivity of the search. Modern techniques seek to improve upon this scenario in one or more respects. In the last several years, there has been a significant body of work on new classes of model-agnostic search strategies enabled by advances in machine learning [ 15 , 16 ] . Excitingly, these new methods have now begun to be adopted by the large experimental collaborations as a complementary component of their search programs [ 17 , 18 , 19 , 20 , 21 , 22 , 23 , 24 , 25 ] . Though new physics has not yet been found, these searches have demonstrated the power of these approaches to discover new phenomena that may have been missed by conventional model-dependent approaches. It is likely that in the coming years the usage of these methods in collider searches will continue to grow, and that their potential will increasingly be recognized in other areas of physics, such as cosmology and astrophysics, where similarly complex datasets and limited theoretical guidance motivate the use of flexible, model-agnostic approaches. While these searches have great promise, the new methods they employ and their underlying philosophies are unfamiliar to many researchers in the physical sciences. Standard practices on the validation of these methods, and how results from these searches should be reported, have yet to be established. In this document we attempt to close this knowledge gap, providing a concise review of the methods and strategies for their validation. In Section 2 , we overview the basic statistical formalism of searches, and then review the major classes of new model-agnostic techniques, focusing on the major conceptual points rather than machine learning