OmniCosmos : Transferring Particle Physics Knowledge Across the Cosmos

Vinicius Mikuni, Ibrahim Elsharkawy, Benjamin Nachman · 2025

Read OmniCosmos : Transferring Particle Physics Knowledge Across the Cosmos by Vinicius Mikuni, Ibrahim Elsharkawy, Benjamin Nachman (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-24422.txt.

Introduction

Vinicius Mikuni, Ibrahim Elsharkawy, and Benjamin Nachman carry a physics model across fields. Models of this kind learn features that transfer to many tasks. Their earlier model, OmniLearned, was trained on collider data. It sharpened discovery reach across collider experiments. This paper asks whether collider knowledge helps cosmology.

The answer is yes, within the tested settings. The collider-trained model improved predictions of cosmic parameters. It also predicted halo and galaxy speeds in CosmoBench datasets. Those datasets differ sharply from particle collision data. The authors stress the milestone. A model from collider physics had never been shown to work across fields of science before. Such transfer hints at shared structure in physical data.

Catalog record

CREATORVinicius Mikuni, Ibrahim Elsharkawy, Benjamin Nachman
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-24422

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

OmniCosmos : Transferring Particle Physics Knowledge Across the Cosmos Vinicius Mikuni, Ibrahim Elsharkawy, Benjamin Nachman Abstract Foundation models build an effective representations of data that can be deployed on diverse downstream tasks. Previous research developed the OmniLearned foundation model for collider physics and showed that it could significantly advance discovery potential across collider experiments. In this paper we go beyond collider physics and show that Foundation Models trained on collider data can help improve the prediction of cosmological parameters and to predict halo and galaxy velocities in different datasets from CosmoBench . This is the first time a collider physics model is shown to generalize across scientific fields. I Introduction Current and near-term cosmological surveys are revolutionizing our understanding of dark matter and dark energy. So far, cosmological insight from survey data has been obtained by first compressing the data and then comparing the low-dimensional summaries to theoretical predictions. Modern machine learning has catalyzed a movement to go beyond these summaries to perform field-level analysis in order to use all of the available information Leclercq 2025 . While these approaches have the potential to significantly improve the precision of survey data, progress in this direction requires two currently incomplete components: (1) accurate simulations describing all relevant length and time scales and (2) machine learning methods that can accommodate the structure of cosmological data and simulations. While it may be that machine learning will help address (1), especially beyond the N-body evolution of dark matter, we focus on the second challenge. In particular, cosmological data are composed of variable-length sets of objects (e.g., galaxies) in space (called a point cloud in machine learning) and simulating entire universes is so computationally demanding that inference must proceed with only a relatively small number of synthetic universes. Industry-driven neural network architectures have focused on regular grids (for images) and sequences (for text). One can always voxelize the universe onto a regular grid or sequence to make direct use of such approaches. Instead, we will employ an architecture that is designed for point clouds - it can process variable-length inputs and is invariant under permutations of the inputs (set versus sequence). State-of-the-art methods of this kind are based on transformers Vaswani et al. 2017 . While highly effective, transformers also require a lot of data to leverage the capacity of large models. This is a significant challenge for cosmological inference, where large sets of synthetic universes are unavailable. We propose to address these challenges by building on a point-cloud foundation model designed for particle collider data. Like cosmology data, collider data are also variable-length sets. Due to quantum mechanics, each collision produces a stochastic number of outgoing particles, each defined by a three-momentum along with other attributes. Fully simulating a particle collision is computationally expensive, but much less so than simulating an entire universe. There are also multiple levels of simulation fidelity. Our hypothesis is that a sufficiently expressive foundation model for collider physics that is fine tuned on a relatively small number of cosmological simulations will outperform classical approaches as well as machine learning models trained from scratch on the cosmological simulations. While the physical laws most relevant for cosmology and those most relevant for particle collisions are not exactly the same, the datasets share enough commonalities to justify this transfer learning objective. To test this hypothesis, we use the OmniLearned Mikuni and Nachman 2025a ; Mikuni and Nachman 2025b ; Bhimji et al. 2025 foundation model and the CosmoBench Huang et al. 2025 datasets. OmniLearned is a transformer-based model trained using supervised and unsupervised (but not self-supervised learning) on one billion labeled and unlabeled hadronic jets from various real and synthetic particle collisions. This model has been shown to effectively transfer between low and high-fidelity simulations, between simulations and real data, and between different collision systems. In this paper, we demonstrate that the same model can be useful for fundamental physics data that are unrelated to particle jets. The CosmoBench dataset is a set of simulated point clouds for benchmarking tools for inferring parameters in the standard model of cosmology ( \Lambda CDM). In particular, three different simulators are used to build coarse-grained 1 1 1 It will be interesting to study how the results change with finer granularity / higher multiplicity cosmological simulations. universe simulations. Points represent (effective) dark matter halos or galaxies. Merger histories are present in one of the datasets, but we focus on the present-time tasks 2 2 2 It may be interesting to explore connections between pretrained collider models trained using parton shower histories for such tasks in the future. . Even though gravity is deterministic, the cosmology simulations are stochastic like the collider simulations because of the initial conditions of the universe. In addition to data, CosmoBench also includes classical and machine learning benchmark algorithms that we use as references. A number of related works have touched upon some aspects relates to our research. For example, a number of studies have explored point cloud / graph-based machine learning models applied to cosmology Ravanbakhsh et al. 2016 ; Makinen et al. 2022 ; Villanueva-Domingo and Villaescusa-Navarro 2022 ; de Santi et al. 2023 ; Roncoli et al. 2023 ; Massara et al. 2023 ; Shao et al. 2022 ; Cuesta-Lazaro and Mishra-Sharma 2024 ; Jespersen et al. 2022 ; Wu and Jespersen 2023 ; Chuang et al. 2024 ; Wu et al. 2024 ; Nguyen et al. 2024 ; Villanueva-Domingo et al. 2022 ; Cranmer et al. 2021 ; Wang and Melchior 2022 ; Park et al. 2023 ; Chatterjee and Villaescusa-Navarro 2025 ; Balla et al. 2024 . CosmoBench includes one such model and we also compare our foundation model to a setup with the same architecture, but trained from scratch. This allows us to disentangle benefits from an optimized architecture and from pre-training. The philosophy of OmniLearned is to encode most of the physics in the model implicitly through pre-training. Explicitly equivariant models have been proposed for cosmological inference Perraudin et al. 2019 ; Defferrard et al. 2019 ; Cohen et al. 2018 ; Ocampo et al. 2023 ; Esteves et al. 2020 ; Krachmalnicoff and Tomasi 2019 ; Petroff et al. 2025 ; Dai and Seljak 2022 ; Jagvaral et al. 2025 ; Cuesta-Lazaro et al. 2025 ; Thiele et al. 2022 ; Minartz et al. 2024 ; Villar et al. 2021 ; Casas et al. 2025 ; Weiler et al. 2018 ; Gerken et al. 2023 and it would be interesting to explore in the future if pre-training outperforms them as it seems to for colliders Bhimji et al. 2025 . There are many active efforts to create foundation models specific to cosmology Xia et al. 2025 ; Parker et al. 2024 ; Parker et al. 2025 ; Leung and Bovy 2024 ; Nguyen et al. 2023 ; Walmsley et al. 2022 ; Walmsley et al. 2024 , but we are not aware of any trained to ingest entire universes-as-point-clouds. The approach to uncertainty quantification in CosmoBench is relatively simple and it would be interesting to explore the interplay between advanced UQ (see eg Ref. Chakkappai et al. 2025 ; FAIR Universe Collaboration 2025 and references within) and foundation models in the future. The

Read the complete text