Towards a Robust Machine-Learning Pipeline for 21-cm Cosmology Data Analysis I: A Roadmap for Development and Demonstration of Robustness Against PSF Modeling Errors

Jonathan C. Pober · 2025

Read Towards a Robust Machine-Learning Pipeline for 21-cm Cosmology Data Analysis I: A Roadmap for Development and Demonstration of Robustness Against PSF Modeling Errors by Jonathan C. Pober (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-16280.txt.

Introduction

The faint radio glow from the early universe could reveal how the first stars reionized gas, but telescope flaws can warp that signal. Madhurima Choudhury and Jonathan C. Pober start a series on a learning pipeline that reads such radio images to infer early-universe traits. In this first study they test what happens when the modeled blur of the telescope is wrong.

They train a neural net on images from one antenna layout, then feed it images blurred as if the layout differed. The net's estimates of the neutral gas share drift, by amounts tied to the blur error. The work sets up ways to harden future surveys.

Catalog record

CREATORJonathan C. Pober
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-16280

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Towards a Robust Machine-Learning Pipeline for 21-cm Cosmology Data Analysis I: A Roadmap for Development and Demonstration of Robustness Against PSF Modeling Errors Jonathan C. Pober Abstract The 21-cm signal from the Epoch of Reionization (EoR) is a powerful probe of the evolution of the Universe. However, accurate measurements of the EoR signal from radio interferometric observations are sensitive to efficient foreground removal, mitigating radio-frequency interference and accounting for instrumental systematics. This work represents the first in a series of papers, where we will be introducing a novel ML based pipeline, step-by-step, to directly infer reionization parameters from 21-cm radio-interferometric images. In this paper, we investigate the impact of the variations in the point spread function (PSF) on parameter estimation by simulating visibilities corresponding to input 21-cm maps as observed by the 128-antenna configuration of the Murchison Widefield Array (MWA) Phase II. These visibilities are imaged to obtain ‘dirty images,’ which are then used to train a 2D convolutional neural network (CNN) to predict x HI \rm x_{HI} . To systematically assess the effect of PSF mis-modelling, we generate multiple test sets by varying the MWA’s antenna layout, thereby introducing controlled variations in the PSF; we then feed these alternative PSF dirty images to our CNN trained using only dirty images with the PSF of the true antenna layout. Our results demonstrate that PSF variations introduce biases in the CNN’s predictions of x HI \rm x_{HI} , with errors depending on the extent of PSF distortion. We quantify these biases and discuss their implications for the reliability of machine-learning-based parameter inference in 21-cm cosmology and how they can be utilized to improve the robustness of estimation against PSF-related systematics in future 21-cm surveys. In concluding, we also discuss how this approach to incorporating realistic instrument error into an ML analysis pipeline can be expanded to include multiple other effects. 1 Introduction The redshifted 21-cm line of neutral hydrogen would serve as an excellent probe to understand the structure and evolution of our Universe across cosmic time. This signal provides a unique window into the key epochs in the evolution of our Universe, including the Dark Ages, Cosmic Dawn, and the Epoch of Reionization, offering deep insights into the formation of the first stars, galaxies, and large-scale structure. However, observations of the 21-cm signal, both as a sky-averaged global signature and as fluctuations measured using an interferometer, are extremely challenging. Detecting the cosmological 21-cm signal is one of the key science goals for several current and upcoming low-frequency radio telescopes (for example, SKA, [ 1 , 2 ] ; HERA, [ 3 ] ; MWA, [ 4 ] ; LOFAR, [ 5 ] ; etc.). Several radio-interferometric experiments have reported upper limits on the power spectrum of 21-cm fluctuations over the past decade, from the epoch of reionization (EoR) [ 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 ] and the cosmic dawn (CD) era [ 14 , 15 , 16 , 17 , 18 ] . These upper limits have enabled theorists to rule out certain models of reionization and provide constraints on the physical parameters. In recent years, machine learning (ML) techniques have become increasingly prominent across various different domains of astrophysics and cosmology. Particularly, in 21-cm cosmology, ML has been applied to a wide range of problems, such as signal emulation to parameter estimation, highlighting its potential as a powerful tool for analyzing complex high-dimensional datasets. For instance, fast emulators for the 21-cm global signal and power spectrum have been developed using ML approaches [ 19 , 20 ] , enabling rapid exploration of parameter space. Convolutional Neural Networks (CNNs) have been employed to constrain reionization physics from 21-cm maps [ 21 , 22 ] , while deep learning models have also been used to emulate the full time-evolution of 21-cm brightness temperature maps from the EoR [ 23 ] . More recent advancements include the use of convolutional denoising autoencoders (CDAEs) to recover the EoR signal from simulated SKA images with realistic beam effects [ 24 ] , and the application of Gaussian Process Regression (GPR) for foreground separation [ 25 ] . Artificial Neural Networks (ANNs) have been used to estimate bubble size distributions from 21-cm power spectra [ 26 ] , and CNNs have been applied to 3D tomographic 21-cm images for parameter inference and posterior estimation [ 27 ] . Also, [ 28 ] implemented ANNs to extract power spectrum parameters from synthetic observations contaminated with strong foregrounds. These diverse applications underscore the growing role of ML in tackling the multifaceted challenges of 21-cm cosmology. In spite of the excellent works incorporating ML into EoR studies, ML methods have their drawbacks. All supervised-learning methods are highly problem-specific, strongly dependent on the quality, diversity and representativeness of the training process. They are mostly not generalizable and struggle to deal with out-of-distribution inputs or unknown systematics, common in real observations. While such models can perform well on narrowly defined tasks under controlled conditions, their reliability diminishes when faced with unmodelled complexities. ML becomes particularly useful when it becomes difficult to explicitly model the data, particularly where traditional physical models are computationally expensive or analytically intractable. Its strength lies in its ability to learn from data representations directly, provided the training data sufficiently captures the variability of real observations. To address these limitations, our work takes a step towards building a more resilient and informed ML model. In our case, to train a network, we need not define an explicit model for complicated systematics (a nearly impossible feat for instruments with the size and complexity of 21-cm cosmology experiments); we just need a way of representing a reasonable range of signatures in our training set. As a first case study, we explore the impact of PSF variability on ML-based inference, highlighting the need for more robust and systematics-aware training strategies in 21-cm cosmology. In real data, all the complicating factors are present. To confidently analyze real data with ML, we need an approach that will not confuse one issue for another. For instance, miscalibrated foreground removal and electromagnetic mutual coupling between antennas can both leave excess power at the same spectral scales (due to their comparable light travel time delays). An ML approach trained only to remove foregrounds is unlikely to do the job properly if mutual coupling is present. There is no existing complete end-to-end pipeline stitching all of these key aspects together. The work presented here is a first step in a series of papers, through which we will methodically incorporate more and more sophisticated effects into an ML-based end-to-end pipeline to analyze 21-cm interferometric data. In this paper, we aim to demonstrate how well we can predict the neutral hydrogen fraction directly from dirty images, bypassing the necessity to reconstruct the original image after going through a deconvolution algorithm. The outline of this paper is as follows: In § 2 , we discuss briefly the fundamentals of interferometric measurements, focusing on visibilities and the role of the point-spread function (PSF). In § 3 , we describe our approach to generate the mock-observations for preparing the training set, and how simulated 21-cm maps and visibilities are generated. We

Read the complete text