SURFing to the Fundamental Limit of Jet Tagging
Ian Pang, Darius A. Faroughy, David Shih, Ranit Das, Gregor Kasieczka · 2025
Read SURFing to the Fundamental Limit of Jet Tagging by Ian Pang, Darius A. Faroughy, David Shih, Ranit Das, Gregor Kasieczka (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-15779.txt.
Introduction
Ian Pang and four co-authors ask how close modern jet taggers are to the fundamental statistical limit of jet classification. Better taggers improve collider searches, but unknown ceilings make progress hard to judge. Generative surrogate models with learned likelihoods offer a new route, if the surrogate captures the true distribution. Their SURF method validates such surrogates rigorously.
A tractable surrogate trained on real data becomes a reference for exact optimal tests. One flow based generative model passes as a valid reference for a standard jet data set. Against that reference, modern taggers already operate near the true limit. Autoregressive models, by contrast, exaggerate separation power unphysically. The result reframes tagging research toward the few gains still available.
Catalog record
| CREATOR | Ian Pang, Darius A. Faroughy, David Shih, Ranit Das, Gregor Kasieczka |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-15779
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SURFing to the Fundamental Limit of Jet Tagging Ian Pang, Darius A. Faroughy, David Shih, Ranit Das, Gregor Kasieczka Abstract Beyond the practical goal of improving search and measurement sensitivity through better jet tagging algorithms, there is a deeper question: what are their upper performance limits? Generative surrogate models with learned likelihood functions offer a new approach to this problem, provided the surrogate correctly captures the underlying data distribution. In this work, we introduce the SUrrogate ReFerence (SURF) method, a new approach to validating generative models. This framework enables exact Neyman–Pearson tests by training the target model on samples from another tractable surrogate, which is itself trained on real data. We argue that the EPiC-FM generative model is a valid surrogate reference for JetClass jets and apply SURF to show that modern jet taggers may already be operating close to the true statistical limit. By contrast, we find that autoregressive GPT models unphysically exaggerate top vs. QCD separation power encoded in the surrogate reference, implying that they are giving a misleading picture of the fundamental limit. I Introduction Jet tagging is a central task in collider physics. Over the past decade, machine learning has driven major advances in jet tagging, with increasingly sophisticated architectures achieving very high classification performance on simulated datasets 32 ; 12 ; 40 ; 18 ; 8 ; 34 ; 9 ; 29 ; 28 ; 3 ; 5 . This success naturally raises a key question: have current jet taggers already reached the fundamental limit of jet tagging, or does a gap remain between practical performance and the true statistical optimum? The Neyman-Pearson (NP) limit, defined by the likelihood ratio, is the best possible discriminant between two different underlying physics processes – such as top and QCD jets – that any classifier could achieve if it had access to the exact data likelihoods 30 . In practice, however, this limit cannot be evaluated directly because the true likelihood of the data-generating process is unknown. It therefore remains unclear how close existing classifiers are to this ultimate bound. Recently, Ref. 16 proposed using autoregressive GPT-style generative models to probe this limit for top vs. QCD jets from the JetClass dataset 33 . These models operate on discretized, tokenized representations of jet constituents and yield explicit log-likelihoods, enabling the computation of likelihood ratios between jet classes. When applied to top–QCD discrimination, GPT-based likelihoods were found to produce receiver-operator-characteristic (ROC) curves that appear to substantially exceed those of all existing classifiers trained on GPT samples. This was interpreted as evidence that current jet taggers fall well short of the true NP limit. In this work, we reevaluate this conclusion in several ways. First, we upgrade the GPT model of Refs. 15 ; 16 with a number of enhancements, including voxel tokenization, positional encoding and weight tying. Despite this, we find that the improved GPT model trained on tops and QCD from JetClass still inflates their separation relative to state-of-the-art classifiers by more than an order of magnitude in rejection factor over a wide range of signal of efficiencies. In fact, this is an even larger gap than the original one of Refs. 15 ; 16 . Along the way, we show that GPT-generated jets are perfectly separable from continuous jets, while being close to the discretized jets that the GPT models were trained on. However, we show this cannot explain the inflated separation of the GPT jets – the discretized top and QCD jets are if anything less separable than their continuous counterparts. Secondly, we assess the fundamental limit of jet tagging using an alternative generative modeling framework that also gives tractable likelihoods: conditional flow matching (CFM) 1 ; 27 ; 41 with permutation equivariance, in the form of the EPiC-FM architecture 10 ; 6 . Unlike the GPT framework, EPiC-FM operates directly at the level of the continuous jet constituents and does not require any discretization or tokenization. Using the log-likelihood ratios derived from EPiC-FM trained on JetClass QCD and top jets, we find no evidence for an inflated fundamental limit: the ROC curve obtained from the exact NP test is fairly close (within a factor of two) to the state-of-the-art classifier performance on EPiC-FM samples. These results raise the question – which jet generative model is giving the more accurate picture of the fundamental limit of jet tagging? Is there an enormous gap between the fundamental limit and our best classifiers, as the GPT models would suggest? Or is there essentially no gap between the two, as the EPiC-FM models would suggest? To clarify the origin of this discrepancy and to provide a general framework for evaluating generative models, we introduce the SUrrogate ReFerence (SURF) method. Here the key idea is to use one generative model with tractable likelihoods (EPiC-FM) to evaluate the other generative model with tractable likelihoods (GPT). The first one serves as the surrogate reference model for the second. By various ways we validate EPiC-FM as a surrogate reference model, checking that it does not introduce spurious artifacts into the JetClass data that are hard to detect. 1 1 1 The same tests fail for the GPT model, which is why we do not recommend running the SURF method in the other order, with GPT as a the surrogate reference. We replace JetClass samples with samples drawn from EPiC-FM, train the GPT model on these samples, and repeat all the studies and tests we want to do with the GPT model. But now with tractable likelihoods for both the surrogate reference and the target generative model, ground truth NP-optimal ROC curves can be calculated and compared against one another, giving us more information than when we had trained the GPT samples on JetClass directly. Within this framework, we find that the NP ROC curve derived from the GPT likelihoods far exceeds that of the EPiC-FM surrogate itself. This demonstrates unambiguously that the GPT model artificially inflates the apparent separation between top and QCD jets beyond the physical limit represented by the surrogate reference. Evidently, the GPT model is introducing unphysical artifacts into the EPiC-FM surrogate samples that it is trained on, leading them to be more separable than they should be. We investigate the reasons for this and find evidence that GPT models exhibit signs of overfitting to their training data. We discuss how this form of mismodeling produces likelihood ratios that are inherently difficult for classifiers to reproduce, leading to artificially inflated ROC curves. In the end, we find no evidence of an inflated “fundamental limit” of jet tagging. Instead, the overall picture, especially the concurrence of top vs. QCD ROC curves from OmniLearn trained on JetClass and on EPiC-FM together with the exact likelihoods of EPiC-FM, suggests that the fundamental limit is not far away from state-of-the-art classifiers. The outline of our paper is as follows. In Sections II and III , we present the model descriptions, baseline evaluations, and top vs. QCD separation results obtained using the GPT model and the EPiC-FM model, respectively. Section IV introduces the SURF method and its corresponding results. Possible reasons for the inflated GPT top vs. QCD curve are examined in Section V . We conclude with an outlook in Section VI , while