Cross-Domain Transfer with Particle Physics Foundation Models: From Jets to Neutrino Interactions
Gregor Krzmanc, Vinicius Mikuni, Benjamin Nachman, Callum Wilkinson · 2026
Read Cross-Domain Transfer with Particle Physics Foundation Models: From Jets to Neutrino Interactions by Gregor Krzmanc, Vinicius Mikuni, Benjamin Nachman, Callum Wilkinson (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-12364.txt.
Introduction
Krzmanc and three colleagues test whether particle physics foundation models trained on high-energy collider data transfer to a fixed-target neutrino experiment at a few GeV. OmniLearned and ParticleViT models, tested on MINERvA nucleus events for energy regression and charged-current pion classification, beat same-size models trained from scratch at equal compute budgets. Gains are largest for OmniLearned on regression and ParticleViT on classification. BERT start gives almost no such advantage, suggesting particle-level biases generalize across energy, detector, and process.
Catalog record
| CREATOR | Gregor Krzmanc, Vinicius Mikuni, Benjamin Nachman, Callum Wilkinson |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 28498 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.12364
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Cross-Domain Transfer with Particle Physics Foundation Models: From Jets to Neutrino Interactions Gregor Krzmanc, Vinicius Mikuni, Benjamin Nachman, Callum Wilkinson Abstract Future AI-based studies in particle physics will likely start from a foundation model to accelerate training and enhance sensitivity. As a step towards a general-purpose foundation model for particle physics, we investigate whether the OmniLearned foundation model pre-trained on diverse high- Q 2 Q^{2} simulated and real p p pp and e p ep collisions can be effectively transferred to a few-GeV fixed-target neutrino experiment. We process MINERvA neutrino–nucleus scattering events and evaluate pre-trained models on two types of tasks: regression of available energy and binary classification of charged-current pion final states ( CC1 π ± \mathrm{CC1\pi^{\pm}} , CCN π ± \mathrm{CCN\pi^{\pm}} , and CC1 π 0 \mathrm{CC1\pi^{0}} ). Pre-trained OmniLearned models consistently outperform similarly sized models trained from scratch, achieving better overall performance at the same compute budget, as well as achieving better performance at the same number of training steps. These results suggest that particle-level foundation models acquire inductive biases that generalize across large differences in energy scale, detector technology, and underlying physics processes, pointing toward a paradigm of detector-agnostic inference in particle physics. I Introduction Foundation models for language are revolutionizing the way we do particle physics, especially for software development. A growing number of models are being proposed to directly operate on particle physics data and not just natural language associated with these data 22 ; 18 ; 44 ; 26 ; 27 ; 25 ; 37 ; 14 ; 43 ; 17 ; 48 ; 52 ; 53 . Foundation models are large-scale models pre-trained on broad datasets and subsequently fine-tuned for diverse downstream tasks. One foundation model that has been demonstrated to solve challenges across experiments is OmniLearned 44 ; 43 ; 17 , which is pre-trained on particle-level jet representations from simulated and real pp and ep collider events. In addition to its utility for collider physics tasks, OmniLearned has shown transferability to a variety of tasks, which are referred to as “near”, “medium” and “far” transfers to indicate how different the application is from the initial training task. Near transfers have been studied over data fidelities (fast/full simulation), between experiments, and even across collision systems ( pp and ep ). Far transfers have studied the utility of particle clouds — point clouds of particles — for non-particle data, applying the model to cosmological structure formation 42 and even to molecular dynamics 20 . While it seems likely that there is a tradeoff between generality and effectiveness, these results suggest that particle-level transformers learn geometric and kinematic inductive biases that can be useful across a wide array of scientific contexts. One aspect of transferability that is missing so far is a “medium” transfer. In this work we explore the model transfer from the high-energy collider regime (TeV-scale jets, \mathcal{O}(10^{2}) particles per event, hermetic ( 4\pi ) detectors) to a few-GeV fixed-target neutrino experiment (few-GeV neutrino interactions, \mathcal{O}(1\text{--}10) reconstructed objects per event, asymmetric detector geometry). These regimes differ not just in detector technology but in the underlying physics. Collider jets are dominated by quantum chromodynamics fragmentation 29 , while few-GeV neutrino interactions cover a complex transition region in which interactions can occur with an entire nucleus, a constituent nucleon within the nucleus and deep-inelastic scattering, with a variety of relatively low-energy nuclear effects further complicating the picture 23 ; 10 ; 45 ; 31 ; 11 ; 40 ; 30 ; 51 . A major, multi-decade, experimental effort is underway focused on making precision neutrino oscillation measurements using few-GeV accelerator neutrino beams 21 ; 46 . Accelerator neutrino beams are produced by directing intense proton beams onto fixed targets, focusing and sign-selecting secondary hadrons (primarily pions and kaons) of a desired energy, and allowing them to decay 36 . A key challenge for oscillation experiments is to disentangle the neutrino oscillation phenomenon — which varies as a function of neutrino energy and distance traveled — from uncertainties in both the rate at which neutrinos interact and in the energy distribution of neutrinos produced by the accelerator neutrino beam. In particular, because neutrino properties can only be reconstructed from the observable final-state interaction products, and because of the broad energy distribution of accelerator neutrino beams, few-GeV neutrino–nucleus scattering uncertainties are affected by a large number of complex, relatively low-energy, nuclear effects 23 ; 10 ; 45 ; 31 ; 11 ; 40 ; 30 ; 51 . These latter uncertainties are large for current accelerator neutrino experiments 1 ; 4 ; 13 ; 6 ; 3 , and are expected to be large, if not limiting, for next-generation experiments such as DUNE 5 and Hyper-Kamiokande 2 . To tackle this challenge, experiments seek to directly measure neutrino–nucleus scattering cross sections by sampling accelerator neutrino beams close to the source, where oscillation effects can be neglected, both as part of oscillation experiments, and with dedicated experiments. The MINERvA experiment at Fermilab was specifically designed to address this challenge 41 ; 8 , using a finely segmented scintillator tracking calorimeter and a variety of nuclear targets (C 8 H 8 , 12 C, 56 Fe, 208 Pb, water and helium). MINERvA took data in the NuMI accelerator neutrino beam 7 , which ran in both the low-energy (LE, 1–5 GeV) 9 and medium-energy (ME, 2–10 GeV) 54 beam configurations, with periods of muon neutrino and muon antineutrino enhanced beam running for each. Over the last \sim 15 years, MINERvA have released a variety of neutrino–nucleus cross-section measurements which have significantly added to the understanding of few-GeV neutrino interactions by making detailed studies of the outgoing particle content and kinematic distributions 39 ; 12 ; 50 ; 16 ; 49 ; 15 ; 33 ; 47 ; 28 ; 34 ; 38 ; 35 . Recently, MINERvA took a pioneering step in the accelerator neutrino community by making their data, simulated data, and analysis tools publicly available, which made the work described here possible. This paper is organized as follows. Section II describes the regression and classification tasks that we use for studying transferability of OmniLearned to neutrino simulated data from MINERvA. The machine learning models, including our baselines, are introduced in Sec. III . Numerical results are presented in Sec. IV . The paper ends with conclusions and outlook in Sec. V . II Tasks We propose a regression task and three binary classification tasks on which we evaluate the models and their transfer-learning capabilities: • Available hadronic energy regression. In order to constrain different nuclear models at low energies, we aim to regress the available hadronic energy for each event, E_{\mathrm{available}} . The available energy is defined as the sum of the kinetic energies of protons 1 1 1 Including, for completeness, antiprotons, although they are vanishingly rare at the relevant few-GeV energies. plus the full energy of photons, pions, electrons, and charged kaons. All other mesons and baryons are neglected in our definition (although are rare). This definition explicitly excludes poorly modeled neutrons and nuclear binding effects, making it a quantity that can be reliably inferred from detector observables. • Binary event classification. We use three different positive class