Improving Bayesian inference in PTA data analysis: importance nested sampling with Normalizing Flows Journal: Astronomy and Computing
Eleonora Villa, Golam Mohiuddin Shaifullah, Andrea Possenti, Carmelita Carbone · 2025
Read Improving Bayesian inference in PTA data analysis: importance nested sampling with Normalizing Flows Journal: Astronomy and Computing by Eleonora Villa, Golam Mohiuddin Shaifullah, Andrea Possenti, Carmelita Carbone (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-01958.txt.
Introduction
Eleonora Villa, Golam Mohiuddin Shaifullah, Andrea Possenti, and Carmelita Carbone study how to speed up data analysis for pulsar timing arrays. These arrays time pulses from many pulsars and pool the results into one shared data set. The work rests on Bayesian inference, a way to weigh how well a model fits noisy data. The standard tools for that task can be slow and hard to scale.
The team adds a sampler called i-nessai to the Enterprise software framework. The sampler uses normalizing flows, a machine learning method that reshapes simple distributions into complex ones. On realistic simulated data sets, it gave accurate results and sound evidence estimates. It also cut run time sharply, by up to three orders of magnitude in some setups, next to single core parallel tempering Markov chain Monte Carlo runs. The authors present the method as a faster, stable path for array analysis.
Catalog record
| CREATOR | Eleonora Villa, Golam Mohiuddin Shaifullah, Andrea Possenti, Carmelita Carbone |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-01958
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Improving Bayesian inference in PTA data analysis: importance nested sampling with Normalizing Flows Journal: Astronomy and Computing Eleonora Villa, Golam Mohiuddin Shaifullah, Andrea Possenti, Carmelita Carbone Abstract We present a detailed study of Bayesian inference workflows for pulsar timing array data with a focus on enhancing efficiency, robustness and speed through the use of normalizing flow-based nested sampling. Building on the Enterprise framework, we integrate the i-nessai sampler and benchmark its performance on realistic, simulated datasets. We analyze its computational scaling and stability, and show that it achieves accurate posteriors and reliable evidence estimates with substantially reduced runtime, by up to three orders of magnitude depending on the dataset configuration, with respect to conventional single-core parallel-tempering MCMC analyses. These results highlight the potential of flow-based nested sampling to accelerate PTA analyses while preserving the quality of the inference. † † graphicalabstract: † † highlights: Research highlight 1: Integration of flow-based nested sampling into Pulsar Timing Array Bayesian inference pipelines Research highlight 2: Runtime reduction of one to three orders of magnitude compared to PTMCMC Research highlight 3: Robust posteriors and stable evidence estimates through importance nested sampling with Normalizing Flows 1 Introduction The era of precision pulsar timing array (PTA) science has entered a crucial phase, marked by unprecedented volumes of high-quality timing data and the evidence of a stochastic gravitational wave background (SGWB) recently reported by five international PTA collaborations ( Agazie et al. 2023a ; EPTA Collaboration et al. 2023 ; Xu et al. 2023 ; Reardon et al. 2023 ; Miles et al. 2025 , see, e.g.,) . Current and future PTA data sets present increasingly complex inferential challenges, characterized by parameter spaces that typically exceed 100 dimensions and encompass intricate correlations between the timing model parameters, the noise properties of the entire array of pulsars, and common-mode astrophysical signals ( Agazie et al. 2023b ; Antoniadis et al. 2023 , see, e.g.,) . Traditional Markov Chain Monte Carlo (MCMC) approaches ( Robert and Changye 2021 ) , while robust, often require extensive computational resources and exhibit slow convergence in these high-dimensional, multimodal parameter landscapes. The computational demands of PTA data analysis are further intensified by the growing scope of ongoing and planned observations. The International Pulsar Timing Array (IPTA) Data Release 2 ( Perera et al. 2019 ) encompasses 65 millisecond pulsars with timing baselines extending beyond two decades, while next-generation facilities, such as the Square Kilometer Array (SKA), promise to deliver datasets of much greater complexity and scale ( Janssen et al. 2015b , see, e.g.,) . These developments necessitate corresponding advances in computational methodology to ensure that inferential capabilities can stay in line with observational progress. Within this context, the Enterprise software framework developed in Ellis et al. 2020 , has emerged as the standard for PTA data analysis, providing a flexible and modular platform for constructing sophisticated probabilistic models of pulsar timing data. Enterprise currently supports several sampling algorithms, including parallel-tempering MCMC via PTMCMCSampler ( Ellis and van Haasteren 2017 ) , and nested sampling implementations such as dynesty ( Speagle 2020 ) and MultiNest ( Feroz et al. 2019 ) . Among these, PTMCMCSampler has been the canonical sampler for many recent PTA analyses, including the NANOGrav 15-year data set studies, due to its robustness in handling multimodal posteriors and complex parameter correlations through its parallel tempering scheme. However, even the most sophisticated MCMC approaches face fundamental limitations in the high-dimensional regime characteristic of comprehensive PTA analyses. Inefficient exploration of parameter space modes and the inherent serial nature of chain-based sampling contribute to computational bottlenecks that can extend analysis times to weeks or months for realistic problem sizes. These limitations become particularly critical when conducting systematic studies that require multiple model comparisons or when incorporating model uncertainties through hierarchical Bayesian frameworks. To address these computational challenges, we present a comprehensive study of flow-based nested sampling for PTA data analysis, building upon the i-nessai algorithm recently developed in Williams et al. 2023 with the use of Normalizing Flows – neural networks that learn invertible mappings between simple and complex distributions – to enhance sampling efficiency. For reviews on Normalizing Flows see Papaspiliopoulos et al. 2007 , Rezende and Mohamed 2015 , and Kobyzev et al. 2021 . Our implementation integrates i-nessai within the Enterprise tool, providing a framework that leverages the full modeling capabilities of Enterprise while achieving substantial improvements in sampling efficiency. Our study investigates how the performance of flow-based nested sampling is affected by the dimensionality and complexity of typical PTA models. We examine the trade-offs between posterior accuracy, precision of evidence estimates, and computational cost. In addition, we assess the impact of using Normalizing Flows on the exploration of multi-modal parameter spaces, which often arise in PTA data analysis. By conducting systematic benchmarks on simulated datasets, we aim to provide practical insights into the selection and tuning of sampling methods for PTA inference. The plan of the paper is as follows. In section 2 we discuss the importance nested sampling algorithm with Normalizing Flows implemented in i-nessai and highlight its main advantages. Section 3 describes the PTA modeling framework and the custom interface developed to integrate Enterprise with i-nessai . In Section 4 we present a quantitative performance comparison with the PTMCMCSampler for a simple case study and a detailed computational performance optimization of i-nessai for PTA data analysis, examining its scaling behavior, parallelization strategies, and the impact of the flow architecture. Section 5 provides diagnostic analyzes of the evolution of the internal state of the sampler and assesses its stability through multiple independent runs. The results of the inference on 10 simulated pulsars from the EPTA DR2new dataset are reported in Section 6 , including both noise-only and Noise+SGWB models. Finally, Section 7 summarizes our conclusions and outlines future directions of this work. 2 Why importance nested sampling with Normalizing Flows Bayesian inference in PTA data analysis involves exploring complex, high-dimensional parameter spaces with strong correlations and multimodality. Standard approaches such as MCMC can become inefficient under these conditions, requiring long convergence times and offering limited parallelization. Nested sampling, by contrast, provides a principled way to estimate both parameter posteriors and Bayesian evidence, yet its efficiency critically depends on how new samples are generated within the evolving likelihood constraint. This step typically represents the main computational bottleneck. The i-nessai algorithm ( Williams et al. 2023 ) addresses this challenge by integrating Normalizing Flows into the nested sampling framework. Instead of relying on traditional rejection or MCMC-based proposals, i-nessai trains a Normalizing Flow at each iteration to represent the likelihood-constrained prior, from which new live points can be efficiently drawn. This learned generative model adapts to the structure of the target distribution, greatly improving sampling performance in regions where standard methods typically slow down. In this work, the Normalizing Flows implemented in i-nessai are based on the RealNVP architecture introduced by Dinh et al. 2017 which employs affine coupling layers to ensure invertibility and stable Jacobian computations. An additional strength of i-nessai lies in its use of importance sampling and in its cumulative meta-proposal distribution, which aggregates information from all previously trained flows. Specifically, at each nested sampling iteration k , a new flow q_{k}(\theta) is trained on the current