A quadratic estimator view of the transfer function correction in intensity mapping surveys

Zhaoting Chen (陈兆庭) · 2025

Read A quadratic estimator view of the transfer function correction in intensity mapping surveys by Zhaoting Chen (陈兆庭) (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-13070.txt.

Introduction

Zhaoting Chen's 2025 letter solves a puzzle in radio astronomy surveys that map the universe using faint hydrogen signals. To see the signal, astronomers must strip away far brighter foreground glow. The cleaning step also eats some of the real signal. Teams correct for the loss with a factor measured from fake signals run through the same cleaning.

One fact defied intuition. The correction needed for the signal's own power was the square root of what simple reasoning suggested. Chen shows this weaker correction is not a quirk of one survey. It must hold for any cleaning of this linear kind. The proof uses a standard estimation framework and its window functions. The same math also reveals that the cleaning mixes signals across scales, which can bias the conclusions drawn from the maps.

Catalog record

CREATORZhaoting Chen (陈兆庭)
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-13070

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A quadratic estimator view of the transfer function correction in intensity mapping surveys Zhaoting Chen (陈兆庭) Abstract In single dish neutral hydrogen (H i ) intensity mapping, signal separation methods such as principal component analysis (PCA) are used to clean the astrophysical foregrounds. PCA induces a signal loss in the estimated power spectrum, which can be corrected by a transfer function (TF). By injecting mock signals of H i into the data and performing the PCA cleaning, we can use the cleaned mock H i signal to cross-correlate with the original mock, and estimate the signal loss as a TF, 𝒯 ⁡ ( 𝒌 ) \mathcal{T}(\bm{k}) . As expected, a correction of 𝒯 ​ ( 𝒌 ) − 1 \mathcal{T}(\bm{k})^{-1} restores the cross-power between the H i and optical galaxies. However, contrary to intuition, the H i autopower also requires a 𝒯 ​ ( 𝒌 ) − 1 \mathcal{T}(\bm{k})^{-1} correction, not 𝒯 ​ ( 𝒌 ) − 2 \mathcal{T}(\bm{k})^{-2} . The 𝒯 ​ ( 𝒌 ) − 1 \mathcal{T}(\bm{k})^{-1} correction is only known empirically through simulations. In this Letter, we show that the 𝒯 ​ ( 𝒌 ) − 1 \mathcal{T}(\bm{k})^{-1} correction in autopower is universal, and can be analytically proven using the quadratic estimator formalism through window function normalization. The normalization can also be used to determine the TF correction for any type of linear process. Using the window function, we demonstrate that PCA induces mode-mixing in the power spectrum estimation, which may lead to biases in the model inference. 2026 A quadratic estimator view of the transfer function correction in intensity mapping surveys – References 1 Introduction Neutral hydrogen (H i ) intensity mapping (e.g. Bharadwaj et al. 2001 ; Battye et al. 2004 ; Chang et al. 2008 ) is an emerging probe for the large-scale structure (LSS) of the Universe. H i resides mostly inside galaxies after cosmic reionization (e.g. Villaescusa-Navarro et al. 2018 ), and can be measured using the 21 cm line. Tremendous progress has been made towards detecting the H i clustering in the post-reionization Universe (e.g. Masui et al. 2013 ; Switzer et al. 2013 ; Anderson et al. 2018 ; Wolz et al. 2022 ). In particular, the recent measurement from the MeerKAT Large Area Synoptic Survey (MeerKLASS; Santos et al. 2016 ) L-band deep-field data reported in MeerKLASS Collaboration et al. (2025) , hereafter 11 , produces a cross-correlation detection. A key technique for enabling the measurements of the H i clustering is blind foreground removal (e.g. Wolz et al. 2014 ). The foregrounds in the radio waveband consist mainly of Galactic synchrotron radiation (e.g. Remazeilles et al. 2015 ) and extragalactic radio sources (e.g. Condon et al. 1998 ), which are orders of magnitude brighter than the H i . The foregrounds are spectrally smooth and therefore can be distinguished from the H i signal. In reality, however, observational systematics such as calibration errors and chromatic instrument beam couple with the sky signal, which complicate the spectral structure of the data (see Chen et al. 2025 in the case of MeerKLASS) and call for blind signal separation methods. The most commonly used method for foreground removal is Principal Component Analysis (PCA). Given an intensity mapping data cube that is mean-centred in each frequency channel, m(\bm{l},f) , where \bm{l} is the sky coordinate and f is the observing frequency, we can calculate the frequency-frequency covariance of the data, \textbf{{C}}_{f_{1}f_{2}}={\sum_{i=1}^{N_{\theta}}\bigg[(w\,m)(\bm{l}_{i},f_{1})\times(w\,m)(\bm{l}_{i},f_{2})\bigg]}\Big/{\sum_{i=1}^{N_{\theta}}\bigg[w(\bm{l}_{i},f_{1})w(\bm{l}_{i},f_{2})\bigg]}, (1) where i iterates over each pixel in the angular plane, N_{\theta} is the total number of pixels, and w(\bm{l}_{i},f) is the weight of each cube voxel. Using the frequency-frequency covariance, we can perform an eigendecomposition and retrieve the eigenvectors of \textbf{{C}}_{f_{1}f_{2}} , [\bm{v}_{1},\bm{v}_{2},...\bm{v}_{N_{f}}] , where N_{f} is the total number of frequency channels. The eigenvectors are ranked from the largest eigenvalue to the smallest. Assuming that the first N_{\rm fg} eigenmodes contain all the foreground emission, we can form a matrix \textbf{{R}}^{\rm PCA} so that \textbf{{R}}^{\rm PCA}=\textbf{{I}}-\sum_{m=1}^{N_{\rm fg}}\bm{v}_{m}\bm{v}_{m}^{\rm T}, (2) where I denotes the identity matrix and T denotes the transpose of a matrix. The cleaned map can then be calculated by multiplying the PCA matrix on the map data vector so that m_{\rm clean}(l,m,f_{i})=\sum_{j}\textbf{{R}}^{\rm PCA}_{ij}\,m(l,m,f_{j}), (3) where j loops over each frequency channel and ij denotes the element of a matrix at the i^{\rm th} row and j^{\rm th} column. For a sufficiently large number of modes N_{\rm fg} , foregrounds should be strongly suppressed, and the residual map m_{\rm clean} can be used to estimate the H i power spectrum. However, removing the eigenmodes from the map also introduces signal loss. To quantify the signal loss, a signal injection-based transfer function (TF) approach has been proposed ( Switzer et al., 2015 ) . Given a mock signal m_{\rm\textrm{H{i}}} , we can inject the signal into the original map data m , and recalculate the PCA matrix to perform the cleaning to get the residual m_{\rm clean} . The TF correction can be calculated as ( Cunnington et al., 2023 ) \mathcal{T}_{\rm\textrm{H{i}}}(\bm{k})=\bigg\langle\frac{\mathcal{P}[m_{\rm clean},m_{\rm\textrm{H{i}}}]}{\mathcal{P}[m_{\rm\textrm{H{i}}},m_{\rm\textrm{H{i}}}]}\bigg\rangle, (4) where \mathcal{P}[,] denotes the operation of estimating the power spectrum by cross-correlating two fields and \langle\rangle denotes the ensemble average over a number of realizations of mock. Similarly, given a H i mock signal and a corresponding galaxy mock density field m_{\rm g} , the TF for the cross-power spectrum can be calculated as \mathcal{T}_{\rm\textrm{H{i}},g}(\bm{k})=\bigg\langle\frac{\mathcal{P}[m_{\rm clean},m_{\rm g}]}{\mathcal{P}[m_{\rm\textrm{H{i}}},m_{\rm g}]}\bigg\rangle. (5) Cunnington et al. (2023) , hereafter 8 , find surprising properties of the TF. First, it is found that for both cross-power and autopower, a correction of \mathcal{T}(\bm{k})^{-1} , multiplied on the estimated power spectrum after PCA cleaning, restores the correct amplitude of the underlying signal. The conclusion is intuitive for cross-power. However, for autopower, it is expected that \mathcal{T}(\bm{k})^{-2} is needed instead of \mathcal{T}(\bm{k})^{-1} , as the TF defined in Equation 4 is a cross-correlation between the cleaned and original mock signal, whereas the autopower is the autocorrelation of the cleaned signal. Second, it is found that if the autopower is calculated by cross-correlating two data sets of the same H i signal with foregrounds that are perturbed by different systematics (see Fig 12 of 8 ), the signal correction is further complicated and deviates from both \mathcal{T}(\bm{k})^{-2} and \mathcal{T}(\bm{k})^{-1} corrections. In this Letter, we review the TF correction through the quadratic estimator formalism ( Tegmark, 1997 ) . We show that the signal loss correction can be understood as a window function normalization, and link the normalization to the TF analytically. The analytical expression of the TF is used to prove the \mathcal{T}(\bm{k})^{-1} correction in the autopower, with numerical validations. 2 Quadratic estimator 2.1 Fourier convention We start with choosing a Fourier convention. The Fourier transform of an arbitrary function in a 3D rectangular box, f(\bm{x}) , and its corresponding inverse transform, can be written as \tilde{f}(\bm{k})=\int\frac{{\rm d}^{3}\bm{x}}{V}\,{\rm e}^{-i\,\bm{k}\cdot\bm{x}}f(\bm{x}),\,f(\bm{x})=V\int\frac{{\rm d}^{3}\bm{k}}{(2\pi)^{3}}\,{\rm e}^{i\,\bm{k}\cdot\bm{x}}\tilde{f}(\bm{k}). (6) where \bm{k} is the 3D wavenumber vector and V is the volume of the box. For a tracer of dark matter t , the tracer field in a 3D rectangular box can be expressed as a data vector \bm{d}_{t} , whose i^{\rm th} element is the value of the i^{\rm th} grid at \bm{x}_{i} . The Fourier transform of the tracer field,

Read the complete text