Kilo-scale point-source inference using Parametric Cataloging

Gabriel H. Collin · 2025

Read Kilo-scale point-source inference using Parametric Cataloging by Gabriel H. Collin (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-23472.txt.

Introduction

Gabriel Collin presents a 2025 method for counting point-like light sources in the sky and gauging doubt in those counts. The problem is old in astronomy. Rich methods exist, but they must hop between models with unlike numbers of sources. That hopping is hard to scale to big skies.

The new method, called parametric cataloging, keeps the model size fixed by reshaping how source brightness is coded. Standard gradient-based samplers then do the heavy lifting. The code can run in most common probability toolkits. With that change, counts scale to tens of thousands of sources. Doubt on the count comes out of the same run, not as an add-on.

Catalog record

CREATORGabriel H. Collin
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-23472

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Kilo-scale point-source inference using Parametric Cataloging Gabriel H. Collin Abstract The estimation of the number of point-sources in the sky is one the oldest problems in astronomy, yet an easy and efficient method for estimating the uncertainty on these counts is still an open problem. Probabilistic cataloging solves the general point-source inference problem, but the trans-dimensional nature of the inference method requires a bespoke approach that is difficult to scale. Here it is shown that probabilistic cataloging can be performed in a fixed-dimensional framework called Parametric Cataloging under mild assumptions on some of the priors. The method requires only a simple reparameterization of the flux coordinates, yielding an accessible method that can be implemented in most probabilistic programming environments. As the parameter space is fixed-dimensional, off the shelf gradient based samplers can be employed which allows the method to scale to tens of thousands of sources. I Introduction Cataloging is the process of turning data – such as astronomical images or lists of events – into a set of point sources that generate them. The location, flux and other parameters of each source in this set are estimated; and, when the sources are bright and separated we need only quantify the uncertainty on those parameters. There exists a regime when sources are dim or crowded, where a single set of source parameters and their uncertainties is not enough to quantify the total uncertainty of the problem. In this regime, it is difficult to distinguish whether a putative source exists or is mimicked by a statistical fluctuation in the data — the number of sources has significant uncertainty. Probabilistic cataloging Hogg and Lang 2010 ; Brewer et al. 2013 ; Daylan et al. 2017 is a Bayesian approach to quantifying uncertainty in both the number of sources and the parameters of those sources. The likelihood, \mathcal{L}(\boldsymbol{d}|n,\{\boldsymbol{\phi}_{i}\}) , for the observed data, \boldsymbol{d} , is conditioned on the number of sources, n , and a set of n vectors, \{\boldsymbol{\phi}_{i}\} , where each \boldsymbol{\phi}_{i} is the vector of parameters for a single source. The goal is to draw samples from the posterior p(n,\{\boldsymbol{\phi}_{i}\},\boldsymbol{\theta}|\boldsymbol{d})=\frac{\mathcal{L}(\boldsymbol{d}|n,\{\boldsymbol{\phi}_{i}\})\pi(\boldsymbol{\theta})\pi(n|\boldsymbol{\theta})\left(\prod_{i=1}^{n}\pi(\boldsymbol{\phi}_{i}|\boldsymbol{\theta})\right)}{\mathcal{L}(\boldsymbol{d})}, (1) where \boldsymbol{\theta} is a vector of hyperparameters – such as mean number of sources or average flux per source – with prior \pi(\boldsymbol{\theta}) ; \pi(n|\boldsymbol{\theta}) is the prior on the number of sources; \pi(\boldsymbol{\phi}|\boldsymbol{\theta}) is the prior on the parameters of one source (assumed identical across sources); and \mathcal{L}(\boldsymbol{d}) is the marginal likelihood. Each sample drawn from this posterior is a triple (n,\{\boldsymbol{\phi}_{i}\},\boldsymbol{\theta}) that represents a single catalog. The ensemble of posterior samples therefore represents equally probable catalogs that could be constructed from the data. Note that these samples are not fixed-dimensional; the size of the set \{\boldsymbol{\phi}_{i}\} varies with n . This precludes the naive application of Markov Chain Monte Carlo (MCMC) to sample from the posterior, as most MCMC algorithms are designed only to sample from fixed-dimensional spaces. An exception to this is Reversible Jump Markov Chain Monte Carlo (RJMCMC) Green 1995 ; Richardson and Green 1997 , a transdimensional MCMC that can adjust the dimensionality of the space from which it samples. RJMCMC forms the backbone of current applications of probabilistic cataloging Brewer et al. 2013 ; Brewer et al. 2016 ; Jones et al. 2015 ; Brewer and Donovan 2015 ; Daylan et al. 2017 ; Portillo et al. 2017 ; Daylan et al. 2018 ; Sottosanti et al. 2019 ; Feder et al. 2020 ; Butler et al. 2022 ; Costantin et al. 2022 ; Feder et al. 2023 , but has two major limitations. Firstly, the transdimensional updates require carefully hand-crafted proposal functions to ensure efficient proposals. This bespoke complexity is a barrier to entry for new applications of probabilistic cataloging. Secondly, RJMCMC does not scale to large numbers of parameters. Although this problem can be partially ameliorated for updates to the source parameters Daylan et al. 2017 , updates to hyperparameters or diffuse components still pose a scaling difficulty. The nature of trans-dimensional updates precludes the use of gradient-based sampling strategies – such as Hamiltonian Monte Carlo (HMC) Duane et al. 1987 ; Neal 2011 ; Betancourt 2017 – that scale to high dimensions. In this paper, it is shown that probabilistic cataloging can be performed in a fixed-dimensional framework called Parametric Cataloging. This requires a binomial assumption for the prior on n , along with some mild regularity assumptions on the flux prior. This addresses both concerns with using RJMCMC. Firstly, parametric cataloging requires only a simple reparameterization of the flux coordinates, yielding an accessible method that can be implemented in most probabilistic programming environments. Secondly, as the parameter space is fixed-dimensional, off the shelf gradient based samplers can be employed which allows the method to scale to tens of thousands of sources. Other approaches to estimating the uncertainty on the number of sources exist, such as modeling the problem using a Dirichlet process mixture Sottosanti et al. 2021 . When probabilistic catalogs are not of interest, the population hyperparameters can be modeled directly through likelihood Collin et al. 2022 ; Lee et al. 2016 ; Malyshev and Hogg 2011 ; Lee et al. 2009 or machine-learning based approaches Caron et al. 2018 ; List et al. 2020 ; List et al. 2021 ; Mishra-Sharma and Cranmer 2022 ; Caron et al. 2023 ; Butter et al. 2023 ; Amerio et al. 2023 ; Christy et al. 2024 ; Wolf et al. 2024 ; List et al. 2025 . Point source inference can be considered to be a case of the more general problem of “clustering” in the statistical literature Gormley et al. 2023 , specifically a mixture-model. There are many approaches to this problem Celeux et al. 2018 ; to this work, the closest of which is overfitted mixture-models Rousseau and Mengersen 2011 ; Malsiner-Walli et al. 2016 . These fit a large number of components (sources) to the data, and use a specific choice of shrinkage prior on the component weights (fluxes) to approximately empty the redundant components. A Dirichlet prior is chosen to heavily prefer low weights, thus driving the model to have as many near-zero weights as possible. This work, in comparison, also uses a large number of components but uses a reparameterization to implement a spike-and-slab Mitchell and Beauchamp 1988 type prior on the weights that allows a more general specification of flux prior and exact zeroing-out of redundant components. Unlike the standard spike-and-slab approach, which uses discrete indicator variables that are computationally demanding, parametric cataloging is implemented in a purely continuous parameter space, utilizing a reparameterization trick to generate the spike-and-slab. While inspired by Nonparametric Hamiltonian Monte-Carlo (NP-HMC) Mak et al. 2021 , this approach is dramatically different in implementation. NP-HMC solves general non-parametric inference problems using a novel and specialized variant of HMC. In contrast, parametric cataloging solves a specialized inference problem by casting the problem in a fixed-dimensional (parametric) framework that permits the use of any sampler. II Parametric cataloging We start with the mixture-of-likelihoods formulation of probabilistic cataloging where the mean number of sources N and flux parameters for each source F_{i} have been separated out: \mathcal{L}(\boldsymbol{d}|N,\boldsymbol{\theta})=\sum_{n=0}^{\infty}\pi(n|N)\\ \left(\prod_{i=1}^{n}\int\mathrm{d}\boldsymbol{\phi}_{i}\pi(\boldsymbol{\phi}_{i}|\boldsymbol{\theta})\int\mathrm{d}F_{i}\pi(F_{i}|\boldsymbol{\theta})\right)\mathcal{L}(\boldsymbol{d}|n,\{\boldsymbol{\phi}_{i}\},\{F_{i}\}). (2) In this representation, the integrals over the \boldsymbol{\phi}_{i} vectors are performed through

Read the complete text