Interpretability of deep-learning methods applied to large-scale structure surveys

G. Aymerich ,, T. Kacprzak, A. Refregier · 2025

Read Interpretability of deep-learning methods applied to large-scale structure surveys by G. Aymerich ,, T. Kacprzak, A. Refregier (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-18333.txt.

Introduction

Gaspard Aymerich, Tomasz Kacprzak, and Alexandre Refregier probe what a convolutional neural network actually uses when analyzing cosmology surveys. Deep networks now match classical methods on large-scale structure data, but their decisions hide inside millions of parameters with no physical meaning. That opacity makes biases and limits hard to judge.

Instead of inspecting a trained network afterward, the team retrains and predicts with deliberately degraded data. Removing parts of the information shows which features drive the constraining power. The network turns out to mix Gaussian and non-Gaussian information. It emphasizes structures at scales between the linear and non-linear regimes, a clue for survey design.

Catalog record

CREATORG. Aymerich ,, T. Kacprzak, A. Refregier
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-18333

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Interpretability of deep-learning methods applied to large-scale structure surveys G. Aymerich ,, T. Kacprzak, A. Refregier Abstract Deep learning and convolutional neural networks in particular are powerful and promising tools for cosmological analysis of large-scale structure surveys. They are already providing similar performance to classical analysis methods using fixed summary statistics, are showing potential to break key degeneracies by better probe combination and will likely improve rapidly in the coming years as progress is made in the physical modelling through both software and hardware improvement. One key issue remains: unlike classical analysis, a convolutional neural network’s decision process is hidden from the user as the network optimises millions of parameters with no direct physical meaning. This prevents a clear understanding of the potential limitations and biases of the analysis, making it hard to rely on as a main analysis method. In this work, we explore the behaviour of such a convolutional neural network through a novel method. Instead of trying to analyse a network "a posteriori", i.e. after training has been completed, we study the impact on the constraining power of training the network and predicting parameters with degraded data where we removed part of the information. This allows us to gain an understanding of which parts and features of a large-scale structure survey are most important in the network’s prediction process. We find that the network’s prediction process relies on a mix of both Gaussian and non-Gaussian information, and seems to put an emphasis on structures whose scales are at the limit between linear and non-linear regimes. 1 Introduction The Lambda-Cold Dark Matter ( \Lambda CDM) model has been the standard model of cosmology for the past 20 years, and has been able to explain a wide range of observations, from the cosmic microwave background anisotropies to the large-scale structure of the Universe. However, the model is not without its issues: not only are the nature of dark matter and dark energy, the two components that make up 95% of the Universe, still unknown, but the model has also been unable to coherently explain some observations, such as the tension between the Hubble constant measurements obtained by the Planck collaboration and the SH0ES collaboration ( Planck Collaboration et al., 2020 ; Riess et al., 2022 ) , or the tension between the S_{8}\equiv\sigma_{8}\sqrt{\Omega_{m}/0.3} values found by the Planck collaboration and most large-scale structure surveys ( Planck Collaboration et al., 2020 ; Heymans et al., 2021 ; Abbott et al., 2022 ) . In order to better understand those limitations of the standard cosmological model, next generation surveys such as the Euclid space telescope, the Vera Rubin Observatory, or the Simons Observatory are under construction or already collecting data. The quality, complexity, and volume of the data sets expected from those surveys is such that the statistical tools used for data analysis may become the limiting factor of future studies. Indeed, it is impossible to directly compare the raw data from a survey to the theoretical models of the Universe, and one has to compress the information in some way to obtain constraints on the model parameters. This step is crucial and the data compression has to be chosen carefully to avoid information loss, which is not straightforward in most cases. In this work, we focus on the analysis of large-scale structure surveys that measure the distortion of the shape of distant galaxies by the presence of mass between these galaxies and the observer in order to directly probe the distribution of matter (both ordinary and dark matter) in the Universe (see Refregier, 2003 , for a review on weak lensing) . 1.1 Summary statistics Weak lensing surveys such as the Dark Energy Survey (DES) or the Kilo-Degree Survey (KiDS) measured the shape and position of hundreds of millions of galaxies to map the lensing shear over large areas of the sky. To obtain constraints on the \Lambda CDM model parameters, these maps need to be compared to the model’s predictions which can be done via the computation of summary statistics such as the power spectrum, higher-order moments, peak count, or Minkowski functionals. An intrinsic limitation of this summary statistics approach stems from the fact that the shear field probes the late-time Universe where non-linearities have arose. Therefore, unlike the cosmic microwave background anisotropies that can be very well modelled by a Gaussian random field for which the power spectrum can encapsulate the entire information ( Planck Collaboration et al., 2014 ; Aiola et al., 2020 ; Balkenhol et al., 2023 , see e.g.) , no single summary statistics can capture the entire information contained in the shear maps, and the "classical" approach of analysis via summary statistics is bound to result in some information loss ( Bernardeau et al., 1997 ; Villaescusa-Navarro et al., 2022 ) . Extensive work has been done on the theoretical modelling of the Universe beyond the 2-point correlation function or power spectrum in order to access the non-Gaussian information of cosmological surveys ( Takada & Jain, 2003a ; Takada & Jain, 2003b ; Friedrich et al., 2018 ; Gong et al., 2023 ; Heydenreich et al., 2023 , see e.g.) , but the actual data analysis remains challenging, and most baseline analyses of weak-lensing surveys only leverage 2-point correlation functions. Nevertheless, using these methods, the KiDS and DES collaborations managed to measure cosmological parameters with under 5% precision ( Heymans et al., 2021 ; Abbott et al., 2022 ) . Given the fact that lensing surveys are affected by astrophysical effects such as galaxy intrinsic alignment and galaxy bias ( Kirk et al., 2012 ; Amon et al., 2022 ) , and the existence of a tension between the S_{8}\equiv\sigma_{8}\sqrt{\Omega_{m}/0.3} measurements obtained by late-time (such as lensing) and early-time (such as primary CMB anisotropies) probes, extracting the full information from the large-scale structure surveys is crucial. This problem will be exacerbated by the next generation surveys such as the Vera Rubin Observatory or the Euclid space telescope, which will provide much larger data sets, probing even smaller scales where non-linearities dominate, requiring the extraction of non-Gaussian information. 1.2 Deep learning In recent years, machine learning methods are becoming increasingly popular in the field of cosmology and astrophysics, and have been adapted to a variety of different tasks, from classification to acceleration of simulations via emulators (see Dvorkin et al., 2022 , for a review of machine learning techniques in cosmology) . In particular, deep-learning techniques have opened up a new path for obtaining constraints on the cosmological parameters from surveys. This new approach, which is a form of simulation-based inference, has been developed to analyse surveys (including, but not limited to, large-scale structure surveys) without the information loss inherent to fixed summary statistics methods: through the use of convolutional neural networks (CNN), which are a type of neural networks particularly suited to image analysis and pattern recognition ( LeCun et al., 1989 ) , one can directly input the raw survey data into the network and obtain cosmological parameters estimation as an output. In the case of weak-lensing surveys, the CNN can be trained using simulated lensing and galaxy density maps obtained with N-body simulations of the Universe for various cosmologies. This approach is

Read the complete text