B-Jet Tagging with Retentive Networks: A Novel Approach and Comparative Study

Ayse Asu Guvenli, Bora Isildak · 2024

Read B-Jet Tagging with Retentive Networks: A Novel Approach and Comparative Study by Ayse Asu Guvenli, Bora Isildak (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-08134.txt.

Introduction

Ayse Asu Guvenli and Bora Isildak try a new kind of neural network for spotting jets from bottom quarks at colliders, in a 2024 paper. Tagging these b-jets is vital for hunting new physics, since many interesting events produce them. Their model uses retentive networks, an architecture built for sequences, fed with both fine details of each jet's particles and summary features of the whole jet. Training data came from simulated top quark pair events released by the CMS experiment.

They compared the model with leading taggers and a simple baseline network. Despite a smaller training set and only a third of a million parameters, the retentive model performed promisingly. The pair suggest it as an efficient alternative where computing budgets are tight. They frame the study as evidence that newer sequence architectures deserve a place in particle physics toolkits.

Catalog record

CREATORAyse Asu Guvenli, Bora Isildak
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE16 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-08134

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

B-Jet Tagging with Retentive Networks: A Novel Approach and Comparative Study Ayse Asu Guvenli, Bora Isildak Abstract Identifying jets originating from bottom quarks is crucial for collider experiments aimed at discovering new physics. This paper presents a novel approach for b-jet tagging using Retentive Networks (RetNet), which leverages both low-level features of jet constituents and high-level jet features. The study utilizes a simulated t ​ t ¯ {t\bar{t}}~ dataset provided by the CERN CMS Open Data Portal, focusing on only the semileptonic decays of t ​ t ¯ {t\bar{t}}~ pairs produced from 13 TeV proton-proton collisions. We compare the performance of the proposed Retentive Network model against state-of-the-art models such as DeepJet and Particle Transformer, as well as a baseline Multi-Layer Perceptron (MLP) classifier. The Retentive Networks exhibit promising performance despite being trained on a relatively smaller dataset. PTEP-subject Machine Learning, High Energy Physics † † preprintnumber: XXXX-XXXX 1 Introduction Jets, collimated sprays of particles, are among the most frequently observed phenomena in hadron collider experiments. Determining the parton origin of a jet is a fundamental and challenging task in this field. Many searches for new physics that aim to probe potential beyond the Standard Model phenomena require precise identification of the quark type that initiates jet formation. B-tagging methods have evolved from simple cut-based models to machine learning-based approaches. Machine learning-based approaches for b-tagging can be broadly divided into two categories. The first category includes traditional machine learning techniques such as Naive Bayes classifiers [ 1 , 2 ] , perceptrons [ 3 , 4 ] , and decision trees [ 3 ] . The second category comprises methods utilizing deep neural networks (DNNs) [ 5 ] , such as Convolutional Neural Networks (CNNs), Recurrent Neural Networks, and Long Short-Term Memory (LSTM) networks LSTM. In recent years, the ATLAS b-tagging algorithm, based on the concept of Deep Sets [ 6 ] , has mapped input trace features to a latent space and then combined them with a simple per-feature aggregation. While this approach shows comparable performance to the RNN-based method [ 7 ] , the training and inference times are lower for the same inputs. For over five years, the CMS Collaboration has employed a fully connected neural network called DeepCSV for b-tagging [ 8 ] , which utilizes both the track and secondary vertex (SV) information. A CNN-based approach called DeepJet [ 9 ] , which uses around 650 input features, has also been introduced by the CMS Collaboration, outperforming existing b-jet taggers. Later, ParticleNet [ 10 ] , a graph neural network (GNN) based approach using particle clouds to represent jets, replaced DeepJet. In recent years, with the rise of the use of attention mechanisms, the particle transformer (ParT) [ 11 ] has replaced state-of-the-art models. As the name suggests, ParT is a transformer-based architecture that takes the kinematics of particles, particle identification (PID) information, and trajectory displacements and then feeds them through an attention mechanism. These state-of-the-art models achieve superior performance on this task but require extensive datasets and high computational power for the training. This paper proposes an alternative approach for b-jet tagging that leverages the retention mechanism [ 12 ] . Which treats particle track, SV, and global jet features separately. 2 Data Simulation and Input Data Pre-processing 2.1 Data Source and Simulation The model is trained on approximately four million jets obtained from a simulated semileptonic {t\bar{t}}~ dataset that is available on the CERN CMS Open Data portal [ 13 ] . It corresponds to proton-proton collisions at a center-of-mass energy of 13 TeV, with 2016 CMS data-taking conditions. The dataset was produced through a multi-step simulation process using the Powheg generator for next-to-leading-order (NLO) hard scattering, followed by parton showering and hadronization with Pythia8 . The simulation workflow includes particle propagation through the CMS detector simulation afterward until the final high-level reconstructed objects are obtained. The jets are clustered using the anti -k_{t} algorithm [ 14 ] with cone size parameter \Delta R=0.4 . p_{T}>30 GeV and |\eta|<2.5 cuts are applied to each jet. The hadron flavor information available in the simulated data is used as true jet flavor labels, which is the jet’s ghost clustered flavor [ 5 ] . Jets are separated into three categories: b-jets (from b-quarks), c-jets (from c-quarks), and light jets (from gluons or u, d, s quarks). 2.2 Jet Feature Extraction Three different levels of information are used for a given jet: global jet features, track features, and SV features. Recent studies suggest that low-level information could improve the performance of jet classification problems [ 15 ] ; hence, only low-level inputs were used. For the global jet features, jet p_{T} , jet mass, jet \eta , jet \phi , the number of tracks, and the number of SVs in the jet were selected. The probability density functions for each jet feature are shown in Fig. 1 . Here, to understand the discriminative power of each feature, the aforementioned sub-classes are shown separately. Training and validation sets are shown separately as well in order to identify any potential biases. Figure 1: Global jet feature histograms for b, c, and light jets. Another cut for the track features was applied by selecting tracks in jets, with p_{T} greater than 1.0 GeV and a normalized \chi^{2} less than 5.0 . The selected track features are: track p_{T} , track energy, track charge, track PID, transverse impact parameter ( d_{0} ), longitudinal impact parameter d_{z} , track d_{0} significance ( \sigma_{d_{0}} ), track d_{z} significance ( \sigma_{d_{z}} ), \Delta\eta and \Delta\phi with respect to jet \eta , jet \phi . The probability density functions of track features are given in Fig. 2 . Figure 2: Track feature histograms for b, c, and light jets. Each SV is matched to the jet by checking if it is within \Delta R<0.4 of the jet, then the following information is obtained: SV p_{T} , SV mass, SV \chi^{2} , number of tracks associated to the SV, SV transverse impact parameter ( d_{xy} ), SV 3-D impact parameter ( d_{len} ), SV d_{xy} significance ( \sigma_{d_{xy}} ), and SV d_{len} significance ( \sigma_{d_{len}} ) as shown in Fig. 3 . An illustrative schematic of track and vertex impact parameters are given in Figure 4 . Figure 3: Secondary Vertex feature histograms for b, c, and light jets. Figure 4: Schematic showing track and vertex impact parameters. The image was generated by using the script provided by [ 16 ] . 2.3 Data Preprocessing After deriving these features, each jet’s track and SV features are sorted in decreasing p_{T} order. This approach serves as a proxy for the time order of jet formation, as the true time-order information is experimentally inaccessible. Each jet uses a fixed number of 16 tracks and 5 SVs. This is done by clipping or padding each feature with zero values. This step is necessary, as most deep-learning models are not structured to work with variable-size inputs. The percentage of jets in our dataset with less than 17 tracks is \%2.63 , and the percentage of jets in our dataset with less than 6 SV is \%0.012 . Also, the percentage of b-jets with less than 17 tracks is \%1.99

Read the complete text