CosmoBench : A Multiscale, Multiview, Multitask Cosmology Benchmark for Geometric Deep Learning
Ningyuan (Teresa) Huang, Richard Stiskalek, Jun-Young Lee, Adrian E. Bayer, Charles C. Margossian, Christian Kragh Jespersen, Lucia A. Perez, Lawrence K. Saul, Francisco Villaescusa-Navarro · 2025
Read CosmoBench : A Multiscale, Multiview, Multitask Cosmology Benchmark for Geometric Deep Learning by Ningyuan (Teresa) Huang, Richard Stiskalek, Jun-Young Lee, Adrian E. Bayer, Charles C. Margossian, Christian Kragh Jespersen, Lucia A. Perez, Lawrence K. Saul, Francisco Villaescusa-Navarro (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-03707.txt.
Introduction
Huang and co-authors introduce a 2025 benchmark data set for machine learning in cosmology. Simulations of the universe yield point clouds of galaxies and tree records of how dark matter halos formed. CosmoBench curates such data from top simulations that took over 41 million core-hours to run. It holds 34 thousand point clouds and 25 thousand merger trees at several scales.
The tasks include guessing cosmic values from the clouds and trees. Others ask models to predict halo speeds or rebuild fine time histories from coarse ones. The team supplies baseline results from both classic modeling and learning methods. The set gives geometric deep learning a shared, hard test bed.
Catalog record
| CREATOR | Ningyuan (Teresa) Huang, Richard Stiskalek, Jun-Young Lee, Adrian E. Bayer, Charles C. Margossian, Christian Kragh Jespersen, Lucia A. Perez, Lawrence K. Saul, Francisco Villaescusa-Navarro |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 81 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-03707
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CosmoBench : A Multiscale, Multiview, Multitask Cosmology Benchmark for Geometric Deep Learning Ningyuan (Teresa) Huang, Richard Stiskalek, Jun-Young Lee, Adrian E. Bayer, Charles C. Margossian, Christian Kragh Jespersen, Lucia A. Perez, Lawrence K. Saul, Francisco Villaescusa-Navarro Abstract Cosmological simulations provide a wealth of data in the form of point clouds and directed trees. A crucial goal is to extract insights from this data that shed light on the nature and composition of the Universe. In this paper we introduce CosmoBench , a benchmark dataset curated from state-of-the-art cosmological simulations whose runs required more than 41 million core-hours and generated over two petabytes of data. CosmoBench is the largest dataset of its kind: it contains 34 thousand point clouds from simulations of dark matter halos and galaxies at three different length scales, as well as 25 thousand directed trees that record the formation history of halos on two different time scales. The data in CosmoBench can be used for multiple tasks—to predict cosmological parameters from point clouds and merger trees, to predict the velocities of individual halos and galaxies from their collective positions, and to reconstruct merger trees on finer time scales from those on coarser time scales. We provide multiple baselines on these tasks, some based on established approaches from cosmological modeling and others rooted in machine learning. For the latter, we study different approaches—from simple linear models that are minimally constrained by symmetries to much larger and more computationally-demanding models in deep learning, such as graph neural networks. We find that least-squares fits with a handful of invariant features sometimes outperform deep architectures with many more parameters and far longer training times. Still there remains tremendous potential to improve these baselines by combining machine learning and cosmological modeling in a more principled way, one that fully exploits the structure in the data. CosmoBench sets the stage for bridging cosmology and geometric deep learning at scale. We invite the community to push the frontier of scientific discovery by engaging with this challenging, high-impact dataset. The data and code are available at this URL . 1 Introduction Cosmological simulations are powerful tools to model the distribution of dark matter and galaxies in the Universe. Astrophysicists use them as virtual laboratories to test hypotheses about the laws and constituents of our Universe. These simulations provide a wealth of data in the forms of point clouds and merger trees. Such data is ripe to be analyzed by methods in geometric deep learning [ 1 ] , but cosmologists have yet to observe the same breakthroughs that these methods have produced in areas such as computer vision [ 2 ] , structural biology [ 3 , 4 ] , and climate science [ 5 ] . In these areas, rapid progress has been driven by large-scale benchmarks that provide a unified interface to study multiple related tasks using machine learning (ML). Cosmology stands to benefit similarly, as unified benchmarks can facilitate the exchange of ideas between cosmology and ML, driving the development of novel methods and deeper insights into the Universe. For these reasons, we introduce CosmoBench , a benchmark for geometric deep learning curated from state-of-the-art cosmological simulations. In total, these simulations required more than 41 million core-hours and generated over two petabytes of data. CosmoBench is currently the largest multiscale and multiview benchmark in cosmology: it contains 34 thousand point clouds across three different spatial scales, as well as 25 thousand directed trees on two different temporal scales. Table 1 provides an overview of all the datasets in CosmoBench , and Figure 1 provides an illustration of the data generation process. We briefly describe each of these sources of data (see Section A.1 for a glossary of cosmology terms). The point clouds in CosmoBench encode the spatial distribution of either dark matter halos or galaxies, and they are arranged into three datasets based on the simulation suites ( Quijote [ 6 ] , CAMELS-SAM [ 7 ] , and CAMELS [ 8 ] ) that were used to create them. Each point cloud is characterized (or labeled) by the particular values of cosmological and astrophysical parameters that were used to govern the evolution of matter in its simulation. These simulations are not deterministic, so that a variety of point clouds may be generated by simulations with the same underlying parameters but different randomly sampled initial conditions. The directed trees in CosmoBench are available only within CAMELS-SAM , and they are collected in another dataset, which we call CS-Trees . Each tree in this dataset represents the formation history of a present-time dark matter halo. The merger trees are constructed from 100 simulation snapshots and typically contain on the order of tens of thousands of nodes. The goal of CosmoBench is to unlock the potential of ML in cosmology. With this goal in mind, CosmoBench consolidates multiple tasks of cosmological interest for ML at scale. These tasks include the prediction of cosmological parameters from point clouds and merger trees (graph-level regression), the prediction of the velocities of individual halos or galaxies from their collective positions (node regression), and the reconstruction of fine-scale merger trees from those on coarser time scales (graph super-resolution). If ML can solve these tasks, then cosmologists will be able to extract more information from observational data, which will improve our knowledge on the fundamental laws and constituents of our Universe. A few examples underscore the value of these tasks. First, if cosmological parameters can be inferred from simulated point clouds and merger trees, then one could apply the same models to infer the parameters from observed galaxy distributions [ 9 , 10 , 11 ] or even the present-time properties of a single galaxy [ 12 ] . Second, if galaxy velocities can be predicted from galaxy positions, then this extra information can be used to vastly improve understanding of the structure and rate of expansion of the Universe [ 13 , 14 , 15 , 16 , 17 , 18 ] . Finally, if merger trees on finer time scales can be predicted from those on coarser scales, then one could compensate for the hardware constraints when producing simulations for upcoming cosmological surveys—for observatories such as Euclid [ 19 ] or LSST [ 20 ] . All of these are important problems in cosmological research. We provide multiple baselines for all the tasks in CosmoBench . These baselines include well-established approaches in cosmology, simple linear models constrained by physical symmetries, and deep learning models such as graph neural networks. Notably, we find that least-squares fits with a handful of invariant features sometimes outperform graph neural networks with hundreds of thousands of parameters and significantly higher computational costs. Nonetheless, there remains huge potential to improve these baselines via more principled methods that combine ideas from ML and cosmology. We invite the community to push the frontier of cosmology by engaging with CosmoBench . Our key contributions are summarized as follows: • We present CosmoBench , a multiscale, multiview, multitask benchmark for ML to push the frontiers of cosmology. The datasets are available at this URL . • We provide a unified PyTorch interface to implement our proposed baselines on multiple tasks, including cosmological parameter prediction, halo/galaxy velocity prediction, and