Strong CWoLa : Binary Classification Without Background Simulation

Samuel Klein, Matthew Leigh, Stephen Mulligan, Tobias Golling · 2025

Read Strong CWoLa : Binary Classification Without Background Simulation by Samuel Klein, Matthew Leigh, Stephen Mulligan, Tobias Golling (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-14876.txt.

Introduction

Samuel Klein and co-authors train particle classifiers without simulated background in a 2025 paper. Supervised learning in high energy physics feeds on simulator labels, but as inputs grow rawer and higher dimensional, simulators drift from reality and poison the training. The classification without labels trick learns from mixed real samples instead.

Their strong version of the method removes the need for background simulation while training supervised style classifiers. Because real collisions supply the background, the domain shift that plagues simulation trained models disappears. Tests show the resulting classifiers can beat simulation trained rivals on real data. The authors pitch the method as the field's inputs keep getting lower level and harder to fake.

Catalog record

CREATORSamuel Klein, Matthew Leigh, Stephen Mulligan, Tobias Golling
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE17 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-14876

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Strong CWoLa : Binary Classification Without Background Simulation Samuel Klein, Matthew Leigh, Stephen Mulligan, Tobias Golling Abstract Supervised deep learning methods have been successful in the field of high energy physics, and the trend within the field is to move away from high level reconstructed variables to lower level, higher dimensional features. Supervised methods require labelled data, which is typically provided by a simulator. As the number of features increases, simulation accuracy decreases, leading to greater domain shift between training and testing data when using lower-level features. This work demonstrates that the classification without labels paradigm can be used to remove the need for background simulation when training supervised classifiers. This can result in classifiers with higher performance on real data than those trained on simulated data. 1 Introduction Supervised machine learning (ML) techniques have revolutionized data analyses in the field of high energy physics (HEP) [ 1 ] with huge advancements in flavor [ 2 , 3 ] and jet tagging [ 4 , 5 ] . Part of the success of these methods is due to architectural improvements, such as the use of transformers [ 6 , 7 ] and graph neural networks [ 11 , 8 , 9 , 10 , 12 ] , but it is also due to the increase in the size of datasets and a shift away from fitting models on high level reconstructed variables towards low level variables that are closer to what is directly measured by experiments. These low level features contain more information and therefore allow for the development of more powerful classifiers. High fidelity simulators are used to generate labelled training data for supervised ML models [ 15 , 14 , 13 ] . However, simulation is not perfect due to a variety of factors, such as the complexity of the underlying physics processes and unknowns in the detector response [ 16 ] . Due to these imperfections, there is a distribution shift between simulated and real data. This shift means that models trained purely on simulation underperform on real data [ 17 ] and become harder to use with significant calibration effects [ 18 , 19 , 20 ] . The shift is larger on lower level data as the information content increases. Mitigating these effects is a difficult but important problem for the field. A task of particular interest in HEP is the binary classification task of discriminating signal from background. Models that target a specific signal can be trained using data only by assigning weak labels and exploiting the classification without labels ( CWoLa ) paradigm [ 21 ] . For muon isolation this approach has been shown to improve over training on simulation [ 17 ] due to the absence of simulation mismodelling when using real data. However, applying the standard CWoLa approach to a supervised task requires defining two measured datasets with different signal-to-background mixtures, where each component in both datasets is sampled from the same data generation processes. While this was shown to be possible for muon isolation [ 17 ] , it is not possible to define such datasets for all signal models. For this reason, the CWoLa approach has mostly been applied to searches where no signal model is assumed and assumptions are instead made about the background distribution rather than targeting a specific signal [ 22 , 24 , 29 , 26 , 25 , 27 , 30 , 31 , 28 , 23 ] . These weakly supervised searches are challenging because no strict assumptions about the background distribution can be made, and therefore the background modelling is often low quality. Further, the standard CWoLa approach struggles when there is only a small total number of signal events in the dataset [ 32 ] , and this is the setting that is most interesting for new physics searches. This work demonstrates that CWoLa can be applied to any strongly supervised settings where simulated signal is available. The method will be referred to as strong CWoLa (s CWoLa ), and it allows supervised binary classifiers to be trained without the use of background simulation. This work shows that strong CWoLa matches or improves upon the performance of training on simulated background, and can be applied to any binary classification task where simulated signal can be produced. The strong CWoLa approach is applicable to searches for specific new physics processes. 2 Strong CWoLa Consider two datasets M_{1} and M_{2} with different signal fractions, f_{1} and f_{2} , respectively. If f_{1}>f_{2} and both signal and background are sampled from the same distribution in both datasets, then the optimal classifier for discriminating signal from background can be found by learning to discriminate M_{1} from M_{2} . This defines the CWoLa paradigm and forms the basis of the strong CWoLa method. In the strong CWoLa approach the dataset M_{1} is composed of simulated samples of the targeted signal process; this dataset is pure signal ( f_{1}=1 ). The dataset M_{2} is real data, an unknown mixture of signal and background. All HEP datasets contain some background samples, but they may be devoid of signal, therefore f_{2}\in[0,1) . This construction guarantees that f_{1}>f_{2} and the optimal classifier for discriminating between signal and background can be found by training a classifier to distinguish between pure simulated signal and data. An outline of the strong CWoLa algorithm is presented in Figure 1 . The benefit of strong CWoLa is that a classifier can be trained without any background mismodelling. A classifier trained in this way will enhance signal in data, rather than the traditional approach of enhancing signal in simulated background. Figure 1: Outline of the strong CWoLa method. The data is labelled zero and identified with a question mark to highlight that the nature of these samples is not known, and the dataset contains a possibly unknown mixture of signal and background. The signal samples are generated with a simulator and are all labelled one as the origin of these events is known exactly. 3 Resonant search This section demonstrates the utility of the strong CWoLa method in the context of a search for resonant new physics. The dataset used for this study was produced for the LHC Olympics 2020 community challenge [ 33 ] . The background samples are QCD dijet events with p_{T}=1.3\,\text{TeV} and the signal samples are generated from W^{\prime}\rightarrow XY with m_{W^{\prime}}=3.5\,\text{TeV} and particles X,Y with masses 500 and 100\,\text{GeV} . Simulations of the signal and background were performed using Pythia 8 [ 35 , 34 ] , while Herwig++ [ 36 ] is used to simulate an alternative background sample. Delphes 3.4.1 [ 37 , 39 , 38 ] is employed for the detector simulation with the CMS detector card. Jet clustering was conducted on particle flow objects using the Fastjet software [ 41 , 40 ] with the anti-kt algorithm [ 42 ] and a jet radius parameter of one. In this work, classifiers are trained to discriminate between datasets labelled one and zero. Pure simulated signal samples are always labelled one. The Herwig dataset is treated as pure simulated background and always labelled zero. The Herwig dataset is used to train models that are proxies for the traditional approach

Read the complete text