How to evaluate the sufficiency and complementarity of summary statistics for cosmic fields: an information-theoretic perspective Journal: ApJL 21cmFAST ( 44 ; 43 ) , NumPy ( 28 ) , Matplotlib ( 30 ) , SciPy ( 74 ) , scikit-learn ( 48 ) , Python3 ( 70 ) , Kymatio ( 7 ) , Tools21cm ( 23 ) ,healpy ( 2
Ce Sui, Yi Mao, Xiaosheng Zhao, Tao Jing, Benjamin D. Wandelt · 2025
Read How to evaluate the sufficiency and complementarity of summary statistics for cosmic fields: an information-theoretic perspective Journal: ApJL 21cmFAST ( 44 ; 43 ) , NumPy ( 28 ) , Matplotlib ( 30 ) , SciPy ( 74 ) , scikit-learn ( 48 ) , Python3 ( 70 ) , Kymatio ( 7 ) , Tools21cm ( 23 ) ,healpy ( 2 by Ce Sui, Yi Mao, Xiaosheng Zhao, Tao Jing, Benjamin D. Wandelt (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-08716.txt.
Introduction
Ce Sui and four co-authors bring information theory to a practical cosmology question: which summary statistics of a cosmic field actually carry the information, and which merely repeat each other? Their yardstick is mutual information, which measures how much one quantity reveals about another.
Two test cases show the method at work. For the cosmic microwave background, the power spectrum extracts nearly everything, as expected for a Gaussian random field. For the twenty-one centimeter brightness temperature map, the scattering transform captures the most non-Gaussian information, yet it still complements the power spectrum and bispectrum rather than replacing them. The authors propose mutual information as a sturdy foundation for judging and improving the summaries cosmologists rely on.
Catalog record
| CREATOR | Ce Sui, Yi Mao, Xiaosheng Zhao, Tao Jing, Benjamin D. Wandelt |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-08716
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
How to evaluate the sufficiency and complementarity of summary statistics for cosmic fields: an information-theoretic perspective Journal: ApJL 21cmFAST ( 44 ; 43 ) , NumPy ( 28 ) , Matplotlib ( 30 ) , SciPy ( 74 ) , scikit-learn ( 48 ) , Python3 ( 70 ) , Kymatio ( 7 ) , Tools21cm ( 23 ) ,healpy ( 25 ; 79 ) ,camb ( 38 ) ,ltu-ili ( 29 ) Ce Sui, Yi Mao, Xiaosheng Zhao, Tao Jing, Benjamin D. Wandelt Abstract The advent of increasingly advanced surveys and cosmic tracers has motivated the development of new inference techniques and novel approaches to extracting information from cosmic fields. A central challenge in this endeavor is to quantify the information content carried by these summary statistics in cosmic fields. In particular, how should we assess which statistics are more informative than others and assess the exact degree of complementarity of the information from each statistic? Here, we introduce mutual information (MI) that provides, from an information-theoretic perspective, a natural framework for assessing the sufficiency and complementarity of summary statistics in cosmological data. We demonstrate how MI can be applied to typical inference tasks to make information-theoretic evaluations, using two representative examples: the cosmic microwave background map, from which the power spectrum extracts almost all information as is expected for a Gaussian random field, and the 21 cm brightness temperature map, from which the scattering transform extracts the most non-Gaussian information but is complementary to power spectrum and bispectrum. Our results suggest that MI offers a robust theoretical foundation for evaluating and improving summaries, thereby enabling a deeper understanding of cosmic fields from an information-theoretic perspective. show][email protected] show][email protected] I Introduction Tracing the evolution of our Universe through different cosmological observations has been a central goal of modern cosmology. Among these endeavors, the cosmic microwave background (CMB) and the large-scale structure (LSS) stand out as the most precise observational probes. On large scales, both fields are well described as Gaussian random fields (GRFs), which means that their information content is fully captured by the two-point statistics, i.e. the power spectrum (PS) in Fourier space, which is therefore the focus of standard cosmological analysis (e.g. 51 ; 6 ; 1 ). However, the anisotropies in the CMB and the nonlinear features of LSS, as well as new observational windows such as small-scale galaxy clustering, weak lensing, and 21 cm intensity mapping ( 14 ; 17 ; 64 , e.g.,) , contain additional information beyond the PS. To extract the non-Gaussian information from these datasets, significant efforts have been devoted to construct novel, informative summary statistics. Information extraction from these summaries is facilitated with the emergence of simulation-based inference ( 29 ; 26 ; 3 ) , because these statistics can be forward-modeled by advances in theories and increasingly realistic high-resolution simulations ( 72 ; 58 ; 40 ; 46 ; 49 ; 5 ) . Examples of summary statistics include the use of cosmic voids as complementary probes to galaxy power spectra ( 41 ; 13 ; 27 ) , bispectrum (BS) analyses across multiple cosmic fields ( 32 ; 34 ; 75 ; 60 ) , and the application of Minkowski functionals to weak lensing and 21 cm maps ( 24 ; 33 ; 16 ; 36 ) . More recently, techniques such as the wavelet scattering transform (ST; 12 ) have been employed to extract multiscale non-Gaussian information from various fields ( 12 ; 78 ; 57 ) . In addition to such physically motivated summaries, machine learning–based approaches have been developed to construct “optimal” statistics, typically by maximizing an information criterion or improving inference performance ( 39 ; 4 ; 77 ) . Beyond the inference from summary statistics, field-level inference ( 62 ; 45 ; 54 ) is also developed along the line to fully exploit non-Gaussian information in these datasets. In this era of thriving information, cosmologists seek to extract the optimal (sometimes aka maximal or full ) information from different statistics, as well as providing complementary information by combining them. A key question arises: how should we assess quantitatively which statistics are more informative than others and assess the exact degree of complementarity of the information from each statistic? Assessing or learning summaries ultimately relies on quantifying their information content with respect to the underlying model parameters. In practice, this has often been approached through Fisher analysis ( 56 ; 2 ) , posterior comparisons ( 9 ; 20 ) or regression performance ( 22 ; 55 ) . Among these, Fisher information (FI; 67 ) is a widely used tool from estimation theory. However, its application in practice often relies on Gaussian likelihood assumptions and finite-difference score estimation, highlighting the need for new methods that enable more accurate estimation ( 65 ; 10 ) . In addition, FI only reflects local sensitivity around fiducial parameters. Posterior comparisons directly compare the credible region in parameter space for an inference around a fiducial test set, so they are also limited to local sensitivity. Regression-based metrics, while providing a global view, estimate the performance of point estimates, not the posteriors. In this paper, we propose the use of mutual information (MI), a fundamental concept in information theory and modern statistical inference ( 52 ; 76 ) , to assess the sufficiency and complementarity of summary statistics in cosmological data. MI is defined to quantify the reduction in uncertainty of one random variable given knowledge of another, making it a natural metric for evaluating information content. In machine learning, MI has served as the theoretical basis for numerous representation-learning objectives ( 15 ; 69 ; 61 ; 18 ) . In cosmology, it has also been employed to design new summaries of cosmic fields ( 59 ; 2 ; 39 ) . In this paper, however, we take a different perspective — here, MI is used not as a loss function, but as a diagnostic tool to assess and decompose the information content of cosmological fields and their summaries. The mathematical properties of MI enable a principled evaluation of summary statistics, providing insights into their effectiveness, potential improvements, and the extent to which they capture the available information. Note that MI, FI and regression errors are related through several interesting information-theoretic inequalities (see a brief review of these relations in Appendix B ). However, a key distinction between them is that while FI depends on the specific fiducial parameter, MI does not , because it provides a global measure of information. We emphasize that both MI and FI are useful, complementary statistical tools — MI as a metric for information assessment, and FI as a tool for direct forecast of parameter sensitivities. The remainder of this paper is organized as follows. Section II introduces the core concepts and methodology. We apply MI to two representative cases in Section III , including CMB-like GRFs and 21 cm non-Gaussian maps. We make concluding remarks in Section IV . Some technical details are left to Appendix A (on MI and Bayesian sufficiency), Appendix B (on the relationships between MI, FI, and estimation mean squared error), and Appendix C (on the definition of summary statistics). A part of preliminary results were previously