Fast Jet Tagging with MLP-Mixers on FPGAs
Chang Sun, Jennifer Ngadiuba, Maurizio Pierini, Maria Spiropulu · 2025
Read Fast Jet Tagging with MLP-Mixers on FPGAs by Chang Sun, Jennifer Ngadiuba, Maurizio Pierini, Maria Spiropulu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-03103.txt.
Introduction
Chang Sun, Jennifer Ngadiuba, Maurizio Pierini, and Maria Spiropulu speed up particle detection in a 2025 paper on collider data. At machines like the Large Hadron Collider, sprays of particles called jets must be sorted in real time, on chips with tight limits. Their model, a mixer-style network, reads the particles in each jet as a sequence.
The models matched or beat older designs on test data that mimics collider conditions. Clever number trimming and arithmetic tricks cut chip resource use by up to ninety-seven percent. Throughput doubled and delay halved compared with past work. Since the design does not treat all inputs as equal, it can rank features smartly. The authors set a new mark for real-time sorting at colliders.
Catalog record
| CREATOR | Chang Sun, Jennifer Ngadiuba, Maurizio Pierini, Maria Spiropulu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-03103
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Fast Jet Tagging with MLP-Mixers on FPGAs Chang Sun, Jennifer Ngadiuba, Maurizio Pierini, Maria Spiropulu Abstract We explore the innovative use of MLP-Mixer models for real-time jet tagging and establish their feasibility on resource-constrained hardware like FPGAs. MLP-Mixers excel in processing sequences of jet constituents, achieving state-of-the-art performance on datasets mimicking Large Hadron Collider conditions. By using advanced optimization techniques such as High-Granularity Quantization and Distributed Arithmetic, we achieve unprecedented efficiency. These models match or surpass the accuracy of previous architectures, reduce hardware resource usage by up to 97%, double the throughput, and half the latency. Additionally, non-permutation-invariant architectures enable smart feature prioritization and efficient FPGA deployment, setting a new benchmark for machine learning in real-time data processing at particle colliders. 1 Introduction The CERN Large Hadron Collider (LHC) [ 1 ] generates vast quantities of data, producing hundreds of terabytes per second from proton-proton collisions occurring every 25 ns. The first reduction of this enormous data throughput is managed by the hardware-based level-1 trigger system (L1T), which filters events in real-time with stringent latency requirements of a few microseconds [ 2 , 3 ] . This system, utilizing approximately 1,000 Field-Programmable Gate Arrays (FPGAs), ensures critical events are preserved for offline analysis while drastically reducing the data rate by two orders of magnitude, thereby managing the downstream bandwidth effectively. In this context, the algorithms’ accuracy is crucial while the computational complexity of each algorithm must be kept minimal as the resources are scarce. The forthcoming High-Luminosity LHC (HL-LHC) [ 4 ] upgrade will significantly increase the data rate and complexity, posing challenges for real-time data processing. Machine learning techniques are being actively explored to enhance the speed and accuracy of the trigger algorithms [ 2 , 3 ] ; however, addressing strict resource and latency constraints without compromising performance present important challenges. Jet tagging is a crucial task for physics analyses at the LHC, which enables the identification of rare events that probe fundamental questions about the universe, such as the existence of new particles or the verification of theoretical models. This task involves identifying the origin of jets, which are collimated sprays of particles produced in high-energy collisions, and associating them with specific underlying physics processes. While jet tagging is traditionally performed offline using large machine learning models and high-performance computing resources [ 5 , 6 , 7 , 8 , 9 ] , extending this capability to the trigger system ensures that such valuable events are not discarded prematurely. However, this transition is highly challenging due to the stringent constraints of the trigger system. Offline models, designed for accuracy without hardware constraints, often exceed the memory, processing speed, and on-chip resource availability of FPGAs, necessitating significant architectural adaptations and optimizations to make them viable for real-time deployment. MLP-Mixer [ 10 ] is an architecture consisting solely of Multi-layer Perception (MLP) layers, originally designed for vision tasks. For those applications, it splits the input into patches and processes them as a sequence of vectors. As the inputs for jet-tagging tasks at the trigger level are already sequences of particles constituents, MLP-Mixer offers a plausible structure for online jet tagging tasks. In this work, we explore and demonstrate the application of MLP-Mixers for jet-tagging, as well as their deployment on FPGAs for use in low-level trigger systems. We train the models with High-Granularity Quantization (HGQ) [ 11 ] to fit within FPGA constraints, and further optimizes their firmware with Distributed Arithmetic (DA) to minimize the latency and maximizing throughput. The firmware is generated and deployed using the hls4ml [ 12 ] framework with the Vitis HLS [ 13 ] backend, ensuring compatibility and efficiency on FPGA hardware. This work makes the following contributions: • We show that MLP-Mixer models achieve state-of-the-art accuracy on a jet tagging dataset generated to closely resemble realistic LHC data. • We demonstrate the deployment of MLP-Mixer models on FPGAs, achieving low latency and high throughput, meeting the requirements of the low-level trigger system. • We highlight that MLP-Mixer models outperform prior architectures in accuracy while using significantly fewer resources, achieving higher throughput, and lower latency. • We emphasize the advantage of using a non-permutation-invariant model for jet tagging when leveraging HGQ, which allows for selective feature prioritization via heterogeneous activation bitwidths to minimize resource consumption. 2 Background and Related Works 2.1 Fast Jet tagging on FPGAs Jet tagging is one of the most critical and well-studied tasks in high-energy physics experiments, with various machine learning algorithms proposed to address it [ 5 , 6 , 7 , 8 , 9 , 14 ] . State-of-the-art models for jet tagging include those based on Graph Neural Networks (GNN), such as Particle Net [ 5 ] and PELLICAN [ 7 ] , or Transformer architectures like Particle Transformer [ 6 ] and the Lorentz-Equivariant Geometric Algebra Transformers [ 8 ] . While these models demonstrate excellent performance for offline data processing, they are typically too large and computationally intensive for real-time deployment on FPGA-based trigger systems. Research efforts [ 15 , 16 , 17 , 18 , 19 , 12 ] have focused on adapting machine learning models for FPGA deployment in real-time environments, showcasing their potential for ultra-low latency and high throughput inference. Notably, Ref. [ 16 ] demonstrated that quantization-aware training (QAT) could enable jet tagging with quantized neural networks on FPGAs, achieving competitive accuracy to the full precision models with significantly reduced resource usage. However, these efforts often relied on toy datasets with high-level jet features which are unavailable in real-time trigger systems, making them impractical for actual deployment. For real-time jet tagging on FPGAs, models like Particle Net and Particle Transformer are quickly ruled out due to their size and complexity. More resource-efficient alternatives include JEDI-net [ 9 ] , an efficient architecture based on Interaction Networks (IN) [ 20 ] , and models using the Deep Sets (DS) architecture [ 21 ] , are being explored. JEDI-net has been successfully implemented on FPGAs [ 22 ] with realistic latency and resource consumption, while the DS-based model achieved better latency and resource utilization than IN-based models under comparable hardware-aware constraints [ 23 ] . These advancements highlight the feasibility of deploying highly-performant particle-based machine learning models on FPGAs for jet tagging, but further innovations are needed to balance performance, resource efficiency, and latency. 2.2 hls4ml hls4ml [ 12 ] is a framework that translates trained neural networks into C++ based high-level synthesis (HLS) projects, which can be further compiled by HLS backends into description languages such as Verilog or VHDL. It supports a wide range of neural network architectures and HLS backends. When the input neural network is properly quantized and configured, hls4ml may generate firmware that is bit-accurate with the original model. This framework has been widely used for deploying neural networks on the hardware triggers at the LHC [ 16 , 17 , 15 , 24 , 25 , 26 , 27 , 2 , 3 ] . Notably, it has been employed for real-time data processing in the L1 trigger system of the CMS experiment, demonstrating its reliability and effectiveness [ 26 , 27 ] . In this case, hls4ml has facilitated the implementation of autoencoders based anomaly detection