Glow : A Unified Particle Flow Transformer

Dmitrii Kobylianskii, Samuel Van Stroud, Kwok Yiu Wong, Max Hart, Etienne Dreyer, Eilam Gross, Gabriel Facini, Tim Scanlon · 2025

Read Glow : A Unified Particle Flow Transformer by Dmitrii Kobylianskii, Samuel Van Stroud, Kwok Yiu Wong, Max Hart, Etienne Dreyer, Eilam Gross, Gabriel Facini, Tim Scanlon (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-20092.txt.

Introduction

Dmitrii Kobylianskii, Samuel Van Stroud, Kwok Yiu Wong, Max Hart, Etienne Dreyer, Eilam Gross, Gabriel Facini, and Tim Scanlon wrote this paper in two thousand twenty-five. It presents GLOW, a transformer model that rebuilds particle flow in detectors as one unified task.

Particle flow turns raw detector hits into a list of particles, a core step in collider physics. GLOW joins incidence matrix supervision from a prior graph method with a MaskFormer shape. On CLIC detector simulations it hits top marks. With past work, it shows one shared transformer design can serve many rebuild tasks in the field. The paper is a short proof of that unified path.

Catalog record

CREATORDmitrii Kobylianskii, Samuel Van Stroud, Kwok Yiu Wong, Max Hart, Etienne Dreyer, Eilam Gross, Gabriel Facini, Tim Scanlon
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE11 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-20092

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Glow : A Unified Particle Flow Transformer Dmitrii Kobylianskii, Samuel Van Stroud, Kwok Yiu Wong, Max Hart, Etienne Dreyer, Eilam Gross, Gabriel Facini, Tim Scanlon Abstract We present Glow , a transformer-based particle flow model that combines incidence matrix supervision from HGPflow with a MaskFormer architecture. Evaluated on CLIC detector simulations, Glow achieves state-of-the-art performance and, together with prior work, demonstrates that a single unified transformer architecture can effectively address diverse reconstruction tasks in particle physics. \workshoptitle Machine Learning and the Physical Sciences 1 Introduction Modern particle physics detectors produce sparse, multi-modal data that must be reconstructed into sets of particles. Particle flow (PFlow) algorithms address this challenge by combining reconstructed charged particle tracks from tracking detectors with calorimeter energy clusters to determine each particle’s type, energy, and direction. Traditional algorithms like Pandora [ 1 , 2 ] rely on expert-designed clustering, matching, and subtraction rules to avoid double counting and maximise resolution; these methods tend to be detector-specific and require extensive manual tuning for new geometries or operating conditions. We frame particle flow reconstruction as an object-detection task and introduce Glow , a transformer-based set-to-set PFlow model that achieves state-of-the-art reconstruction performance. The results demonstrate the effectiveness of unified transformer architectures for particle physics reconstruction. 2 Related Work HGPflow [ 3 , 4 , 5 ] treats PFlow as a hypergraph prediction problem with supervised incidence matrices that associate detector objects (tracks or clusters) to output particles. For clusters, the matrix defines energy-conserving fractional assignments, from which proxy particle kinematics are calculated as weighted sums of associated cluster properties before refinement by a regression network. MLPF [ 6 , 7 , 8 , 9 ] frames the problem as a direct, supervised mapping from inputs to particles. Rather than explicit set-to-set reconstruction, MLPF enforces one-to-one associations between input elements and particles, suppressing duplicates when track and cluster originate from the same charged particle at the cost of resolution performance. MaskFormers [ 10 , 11 ] , originally developed for image segmentation, have recently been adapted to HEP tasks such as vertexing and tracking [ 12 , 13 ] , where local attention provides a novel strategy for scaling to high-occupancy detector data. MaskFormers process unordered input sets to simultaneously identify objects, assign constituents, and estimate object-level properties, making them well-suited for PFlow reconstruction, though this application has not been previously explored. Object condensation has been proposed for combining calorimeter clustering and regression in a single model [ 14 , 15 ] . It lacks distinct input/output representations and enforces a one-to-one assignment between each input and a single condensation point, limiting shared contributions to multiple reconstructed particles. In a PFlow task, it was outperformed by HGPflow [ 3 ] . 3 Model We introduce Glow : a unified model combining incidence-based supervision from HGPflow, which enforces energy-consistent associations between detector objects and particles, with MaskFormer’s query-based architecture, which naturally handles heterogeneous inputs and enables efficient, permutation-invariant decoding of variable-sized particle sets for PFlow reconstruction (Figure 1 ). After a six-layer self-attention encoder, learned queries predict unordered particle sets with flexible output cardinality via a four-layer masked cross-attention decoder [ 11 ] . Attention masks are dynamically adjusted based on learned similarities between particle queries and input detector objects. Following HGPflow, the model predicts an incidence matrix I_{ia} representing the fraction of object i ’s energy attributed to particle a , i.e. I_{ia}=E_{ia}/E_{i} , where E_{i} is the object’s total energy. This ensures energy conservation by construction. Figure 1: Glow architecture overview. Dedicated mask prediction and regression modules are not depicted. The input consists of fully reconstructed tracks and calorimeter topoclusters [ 16 ] , each represented as a feature vector. A fixed number of learnable query embeddings represent particles. At each decoder layer, cross-attention operates between queries and input objects, with attention masks derived from learned similarity scores. Each particle query simultaneously predicts: (i) a soft assignment over inputs (approximating the ground-truth incidence matrix), (ii) particle-type labels (photon, electron, hadron), and (iii) kinematic quantities (energy, p_{T} , \eta , \phi ), computed first as incidence-weighted sums and then refined by a regression head. The training loss combines mask prediction, incidence matrix supervision, classification, and regression objectives. The Hungarian algorithm [ 17 , 18 ] matches model predictions to ground truth targets for permutation-invariant training. This approach enables calibrated particle flow object reconstruction from charged tracks and calorimeter clusters, ensuring differentiability and scalability to future high-granularity detectors. 4 Experimental Setup We use a dataset [ 19 ] of one million simulated e^{+}e^{-}\to dijet events at \sqrt{s}=380~\mathrm{GeV} from the Compact Linear Collider (CLIC) detector [ 20 , 21 ] . This dataset reflects the expected high-multiplicity, high-resolution conditions of future lepton colliders. The model input consists of fully reconstructed tracks and calorimeter clusters, produced by PandoraPFA [ 1 ] , which applies traditional track finding, clustering, and iterative energy subtraction. Following [ 5 ] , only particles that interact with the detector are included as targets—those with at least one associated track or nonzero calorimeter deposit within |\eta|<4 . Converted daughter particles are retained, but targets are defined at the parent level. Each particle is associated with detector objects through the energy-based incidence matrix detailed in [ 5 ] . Glow has 12M parameters and was trained for 200 epochs over 23 hours on Isambard-AI [ 22 ] using two H100 GPUs. The total batch size was 1024. Inference is optimized for numerical precision rather than throughput, and reaches approximately 5k events/s per H100. Code is available on GitHub [ 23 ] . 5 Results For a fair architectural comparison, we retrained a publicly available MLPF model (originally trained on 21.6M events across multiple processes [ 6 ] ) on our dataset, using the original preprocessing from Ref. [ 24 ] . The model architecture and hyperparameters were left unchanged. HGPflow results are taken from Ref. [ 5 ] . We evaluate performance on 20k independent dijet events using event- and jet-level metrics. Predictions for all models are processed using the same evaluation pipeline. 5.1 Event-level performance Figure 2 shows event-level reconstruction performance across four key metrics. The top panels display residual distributions for missing transverse momentum p_{T}^{\text{miss}}=\left|\sum_{i}\vec{p}_{T,i}\right| (left) and scalar transverse momentum sum H_{T}=\sum_{i}\left|\vec{p}_{T,i}\right| (right), while the bottom panels show differences between predicted and true particle counts for charged (left) and neutral (right) particles. Glow produces the most centered and narrow distributions for both momentum quantities, indicating superior reconstruction accuracy. For particle counting, Glow and HGPflow perform similarly due to their shared target definitions. MLPF tends to underestimate the number of constituents. This behavior likely arises from MLPF’s target definition, which assigns each topocluster to a single leading particle and can therefore ignore subleading neutrals. Figure 2: Residual distributions for missing transverse momentum p_{T}^{\text{miss}} (top left), scalar momentum sum H_{T} (top right), and counts for charged (bottom left) and neutral (bottom right) particles. The legend includes median and interquartile ranges for each model. 5.2 Jet-level performance We reconstruct jets using FastJet with the generalized k_{T} algorithm ( R=0.7 ), keeping up to two leading jets with p_{T}>10 GeV. Reconstructed jets are matched to truth jets within \Delta R<0.1 . Fig. 3 shows jet energy and momentum residuals along with angular

Read the complete text