A universal vision transformer for fast calorimeter simulations

Luigi Favaro, Andrea Giammanco, Claudius Krause · 2026

Read A universal vision transformer for fast calorimeter simulations by Luigi Favaro, Andrea Giammanco, Claudius Krause (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-05289.txt.

Introduction

Luigi Favaro, Andrea Giammanco, and Claudius Krause show that one vision model can fake the read-out of more than one particle trap in a 2026 paper. A calorimeter is a trap that reads how much push a grain of stuff dumps in it. The gold code for that read-out, Geant4, is true but slow. Learned models can fake the read-out far more fast. Vision models of the transformer kind do not need the trap to have a neat grid shape.

The team start from a past build, CaloDREAM, and stretch it. Their model holds up on traps with neat grids and with wild ones. It fakes both light-showers and the more dense kind with a hair's breadth of drift from the gold code. One fast faker for all traps could cut the huge machine bills that trap fakes run up at the big ring.

Catalog record

CREATORLuigi Favaro, Andrea Giammanco, Claudius Krause
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-05289

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A universal vision transformer for fast calorimeter simulations Luigi Favaro, Andrea Giammanco, Claudius Krause Abstract The high-dimensional complex nature of detectors makes fast calorimeter simulations a prime application for modern generative machine learning. Vision transformers (ViTs) can emulate the Geant4 response with unmatched accuracy and are not limited to regular geometries. Starting from the CaloDREAM architecture, we demonstrate the robustness and scalability of ViTs on regular and irregular geometries, and multiple detectors. Our results show that ViTs generate electromagnetic and hadronic showers statistically indistinguishable from Geant4 in multiple evaluation metrics, while maintaining the generation time in the 𝒪 ⁡ ( 10 − 100 ) \mathcal{O}(10-100) ms on a single GPU. Furthermore, we show that pretraining on a large dataset and fine-tuning on the target geometry leads to reduced training costs and higher data efficiency, or altogether improves the fidelity of generated showers. IRMP-CP3-26-01, MBI-ML-26-01 Keywords : fast detector simulations, generative networks, conditional flow matching, transformers Submitted to Machine Learning: Science and Technology 1 Introduction Particle Physics is a numerically intensive, data-processing and simulation-heavy science. The large experiments ATLAS and CMS at the Large Hadron Collider (LHC) record data at a staggering rate of several GB/s [ 5 ] , totaling now one Exabyte in recorded data [ 45 ] at CERN. Simulation of collisions, the major backbone of statistical data analyses, needs to keep up with the amount of data as well. The upcoming runs of the LHC and the high-luminosity phase will increase the amount of required computing even further. To fully exploit the data and learn about the underlying laws of nature, it is therefore essential to develop efficient algorithms in every part of the analyses or simulation chains. Modern machine learning (ML) has the potential to contribute substantially to this endeavor [ 13 , 69 ] , for example, by accelerating computationally intensive bottlenecks and opening up new avenues for efficient analyses [ 31 ] . The rise of generative ML in computer science has introduced many new ideas for more efficient simulation in high-energy physics (HEP) in recent years, in particular for amplitude evaluation [ 12 , 15 , 17 ] , phase space generation [ 39 , 24 , 49 , 47 , 48 ] , (end-to-end) event generation [ 33 , 76 , 28 , 27 , 67 , 56 ] , and detector simulation (see [ 46 , 9 ] for recent reviews on the vast literature). First-principled simulations of the latter are computationally expensive and comprise a significant portion of the overall computing budget [ 10 , 30 ] , so any kind of improvement has a direct and strong impact on the global computing efficiency. In addition to being faster than the traditional simulation based on Geant4 [ 3 , 7 , 8 ] , generative networks have the capability to oversample, meaning they can amplify the statistical properties of the training dataset [ 58 , 26 , 19 , 77 , 14 ] . Alternatively, individual steps of the simulation chain [ 13 ] can be combined into a single generative network [ 75 , 54 , 59 ] . Despite all these advantages, generative ML networks for fast simulation are still computationally expensive. First, the training data need to be generated by traditional simulations, and second, the generative networks need to be trained. When switching to a new detector layout or even just changing the voxelization of a given geometry, the generative networks need to be retrained completely. It is therefore highly beneficial to make the overall training of the networks more efficient. For example, the voxelization that is applied to the raw hits can be adopted to better reflect the types of showers under consideration. Areas of larger activity would have a finer read-out and areas with less activity would be coarse [ 66 ] . As a result, the number of voxels to be considered in the subsequent training can be reduced, and the networks can be smaller. However, state of the art ML networks often assume regular geometries and mapping irregular voxelizations to regular space comes at increased computational costs. As another alternative, one can keep the general setup the same, but investigate how the training of generative networks can be made more efficient. For this, we start with an observation regarding calorimeter showers from different incident particles, detector geometries, and detector materials: Even though the specific details are very different, the showers still have many things in common: • Sparsity: A single shower deposits energy only in a fraction of the voxels, and most of the voxels will not receive an energy deposition at all. • Dynamic range: The energy that is deposited in the voxels spans several orders of magnitude and, in general, scales with the incident energy. Since a common approach to calorimeter simulation with generative ML is to split off the scale of the energy that is deposited from the normalized shower shapes [ 55 ] , the latter becomes less sensitive to the incident energies. • Spatial correlations: Showers emerge as spatially connected clusters, in some cases (depending on incident particle and detector materials), even tracks of individual particles become visible, thereby strongly correlating the energy depositions of nearby voxels. • Central activity: Especially for electromagnetic showers, the main activity will be at the center of the considered volume and will form a single cluster. Motivated by these observations and how different these distributions are from the standard normal distributions we usually assume in the latent space of the generative networks, we investigate transfer learning for calorimeter showers: instead of training the generative network from scratch, i.e. randomly initialized network weights, we start the training from weights that were previously optimized for another dataset. While this could still involve different incident particles, detector materials, detector layouts, or voxelizations, the differences in the pre-processed distributions between the datasets are still rather small. Fine-tuning is therefore more efficient because the network has to learn a smaller shift in how the data are mapped to the Gaussian latent space. While similar in spirit to foundation models [ 43 , 22 , 62 , 78 , 21 , 61 , 73 , 44 , 18 ] , which are pretrained once to a big dataset and then fine-tuned to the application at hand, we prefer the term transfer learning in this case, as we only consider generative tasks (on different datasets) and not other tasks like classification or regression as one usually would for a foundation model. Transfer learning was studied before in HEP [ 34 , 29 , 16 , 64 , 23 ] , but mainly in the context of classification tasks. In the context of detector simulation, transfer learning has recently also been studied for detectors with fixed voxelization in [ 68 ] and point-cloud architectures in [ 38 ] . In this work, we propose a general fine-tuning strategy for vision transformers applicable to any detector geometry and across particle types. Additionally, we present complete benchmark results on the LEMURS dataset [ 60 ] used for pretraining and discuss the importance of evaluation metrics for a proper evaluation of the efficiency gains. The paper is organized as follows. In Section 2

Read the complete text