traccc: GPU track reconstruction library for HEP experiments

\firstname Paul \lastname Gessinger, \firstname Heather M. \lastname Gray, \firstname Attila \lastname Krasznahorkay, \firstname Charles \lastname Leggett, \firstname Joana \lastname Niermann, \firstname Andreas \lastname Salzburger, \firstname Stephen Nicholas \lastname Swatman, \firstname Beomki \ · 2025

Read traccc: GPU track reconstruction library for HEP experiments by \firstname Paul \lastname Gessinger, \firstname Heather M. \lastname Gray, \firstname Attila \lastname Krasznahorkay, \firstname Charles \lastname Leggett, \firstname Joana \lastname Niermann, \firstname Andreas \lastname Salzburger, \firstname Stephen Nicholas \lastname Swatman, \firstname Beomki \ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-22822.txt.

Introduction

A team of particle software authors presents a graphics-chip library that rebuilds particle tracks for big physics labs. Detectors log hits as particles cross them, and track code joins those hits into paths. That join is a heavy compute load at modern hit rates. Their library, traccc, runs the join on graphics chips, which chew such work in parallel far faster than plain chips.

The build sits inside a shared tracking project used by many labs. It holds the famed Kalman steps for track find and fit in chip form. Fake data from a standard sim fed the tests. Path quality on the chip matched the plain chip run near mark for mark. For large events, the chip run pulled far ahead in speed. Small events still favour the plain path.

Catalog record

CREATOR\firstname Paul \lastname Gessinger, \firstname Heather M. \lastname Gray, \firstname Attila \lastname Krasznahorkay, \firstname Charles \lastname Leggett, \firstname Joana \lastname Niermann, \firstname Andreas \lastname Salzburger, \firstname Stephen Nicholas \lastname Swatman, \firstname Beomki \
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-22822

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

traccc: GPU track reconstruction library for HEP experiments \firstname Paul \lastname Gessinger, \firstname Heather M. \lastname Gray, \firstname Attila \lastname Krasznahorkay, \firstname Charles \lastname Leggett, \firstname Joana \lastname Niermann, \firstname Andreas \lastname Salzburger, \firstname Stephen Nicholas \lastname Swatman, \firstname Beomki \lastname Yeo \fnsep Abstract We present the current development status and progress of traccc, a GPU track reconstruction library developed in the context of the A Common Tracking Software (ACTS) project. traccc implements tracking algorithms used in high energy physics (HEP) experiments, including the Kalman filter–based track finding and fitting. We benchmark the software with data simulated by Geant4 to measure the physics and computing performance. We show that the physics performance for GPU and CPU are very close. We also show that the GPUs can achieve higher computational performance than the CPU for sufficiently large events. 1 Introduction In collider experiments, charged particles created in particle collisions propagate through a detector with trajectories curved by a magnetic field. Their interactions with sensors allow their positions with respect to the location of the sensors to be measured. Track reconstruction refers to the process of computing the continuous trajectories of these particles from discrete measurements. Indeed, the track reconstruction is crucial in achieving high experimental sensitivity, which usually makes it the most computationally intensive stage of event reconstruction. Among microprocessors, the central processing unit (CPU) has long been the workhorse in the offline data analysis of most HEP experiments. The number of particles created per collision will be unprecedentedly high in future experiments such as those on the High Luminosity LHC (HL-LHC), and models of computation employing only CPUs are unlikely to meet the demands of such experiments ATLAS2022_Roadmap . Following the decline of Dennard scaling DENNARD1974_DennardScaling at the beginning of the twenty-first century, strategies for increasing the performance of microprocessors have shifted drastically from increasing clock frequencies—now impossible due to increased leakage currents—to increasing the number of cores, leading to the advent of parallel and massively parallel microprocessor architectures. General purpose graphics processing units (GPUs) exemplify the shift towards parallel architectures, with many such devices featuring more than 10\,000 cores 1 1 1 GPU cores are not directly comparable to CPU cores in terms of performance, with a single CPU core delivering significantly more performance than a single GPU core. . The massive parallelism of GPUs presents a promising way to meet the computational demands of future HEP experiments, but programming this many cores is challenging and algorithms that perform well on CPU-like architectures do not necessarily perform well on GPUs. We present traccc, a C++-based track reconstruction library for GPUs GITHUB2025_traccc and a part of the A Common Tracking Software (ACTS) project AI2022_ACTS . Even though the current development aims for the application to the ATLAS experiment of HL-LHC, traccc is designed to work on any type of detectors used in high-energy physics experiments. The algorithms and data layouts are modified in a GPU-friendly manner while traccc keeps the same physics performance of the original CPU codes. Previous works GESSINGER2022_traccc ; KRASZNAHORKAY2023_traccc successfully demonstrated the early stages of the track reconstruction chain. However, other algorithms, e.g. track fitting based on Kalman Filter KALMAN1960_Kalman ; FRUHWIRTH1987_Kalman , remained incomplete due to the premature status in tracking geometry where tracks navigate through detector components efficiently. This work extends the scope of traccc to a full track reconstruction chain as the tracking geometry finally can be operated in GPU devices with precise track propagation algorithms. Its physics and computing performance are also investigated using the data simulated by Geant4 AGOSTINELLI2003_Geant4 in the Open Data Detector (ODD) GESSINGER2023_ODDACAT . 2 Implementation The track reconstruction chain begins with the hit clustering where the positions of particles intersecting silicon-based sensors and their errors are calculated by finding the weighted centroids of clusters of activated cells. Clustering in track reconstruction is a connected component analysis (CCA) problem, but differs from most similar problems in the low density of its input, which is commonly less than 1\text{\,}\mathrm{\%} . In order to solve such sparse problems efficiently, we reduce to a CCA problem which we solve using the FastSV ZHANG2020_FASTSV algorithm. The set of a position and its error is called measurement, and its local position on the sensor is converted to a position in the global coordinate to form a spacepoint. The spacepoints are used in the seeding algorithm where triplets, a set of three spacepoints which can approximately form a helix, are found. In the track parameter estimation algorithm, the position and momentum of tracks, called a seed, are estimated at the first spacepoint using the helix model. The seeds are used as the initial track parameters for track propagation by a combinatorial Kalman filter (CKF) BILLOIR1989_CKF ; BILLOIR1990_CKF2 where the full patterns of tracks are found. In the CKF, track parameters and their covariances are propagated based on the fourth order Runge-Kutta-Nyström method NYSTROM1925_RKN ; BUGGE1981_RK ; LUND2009_RKNPropagation ; LUND2009_CovarianceTransport ; YEO2024_JACOBIAN and the Kalman Filter is applied to measurements on intersected sensor modules to calculate a \chi^{2} value based on the track parameter covariances and spatial residual between the track and measurement. If the \chi^{2} is small enough, the measurement is attached to the track to make a new branch for the propagation to the next sensor module. The track parameters and their covariances updated by Kalman Filter during the CKF are most accurate at the last measurement as Kalman Filter accumulates all information of previous measurements. However, the filtered track parameters at the first measurement, which is important for vertex reconstruction, are estimated only with one measurement hence least accurate. Therefore, a Kalman Filter-based fitting FRUHWIRTH1987_Kalman , which runs a smoothing algorithm called the Rauch–Tung–Striebel (RTS) smoother RAUCH1965_RTS , is applied additionally to the tracks to make all track parameters consider all measurements in the pattern. The algorithms are developed for various GPU computing platforms, mainly in CUDA and SYCL REYES2015_SYCL , as well as on CPU for comparison purposes. CUDA, the most widely used GPU computing platform, is exclusive to NVIDIA devices while SYCL codes can also be operated on AMD and Intel devices. Floating point arithmetic is implemented according to the IEEE 754 standard in both single- and double-precision, which we will henceforth refer to as FP32 and FP64, respectively. Although FP64 has been a common choice in HEP computing due to the increased precision it provides, FP32 is investigated as well because GPUs are much more efficient with FP32. The track reconstruction chain is designed to minimize data transfers between host and device. For every event, the data transfers occur when the pixel hit data are transferred to GPU and when fitted track parameters are retrieved from GPU. The transfer of tracking geometry and magnetic field to GPU needs to happen only once at the first event. Multiple CPU threads can be used to operate the multiple GPU pipelines asynchronously, where each of CPU thread handles one invocation of the GPU track reconstruction. This enables reconstructing multiple events concurrently as a single GPU pipeline running on a single event may not be enough to utilize all resources of GPU device. 3 Performance To evaluate physics and computing performance, data are prepared by simulating t\bar{t} collision events in the ODD. The

Read the complete text