Efficient Bayesian Sampling with Langevin Birth-Death Dynamics

Alex Leviyev, Francesco Iacovelli, Aaron Zimmerman · 2025

Read Efficient Bayesian Sampling with Langevin Birth-Death Dynamics by Alex Leviyev, Francesco Iacovelli, Aaron Zimmerman (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-01942.txt.

Introduction

Alex Leviyev, Francesco Iacovelli, and Aaron Zimmerman speed up Bayesian sampling with a diffusion that can spawn and remove walkers. Bayesian inference weighs hypotheses under uncertainty but needs many samples from complex distributions. Hard cases are skewed, multi peaked, or live on curved spaces. Wave parameter work motivates the design, where signals are noisy and spaces twist.

Their Langevin diffusion, a noise driven drift, gains a birth-death process that adds or drops samples. A simple preconditioner rescales the motion, and the method extends to cube and torus product spaces. It runs in parallel across model calls, suiting modern accelerators. Tests on toy problems succeed, and the sampler recovers the first observed black hole merger parameters.

Catalog record

CREATORAlex Leviyev, Francesco Iacovelli, Aaron Zimmerman
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-01942

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Efficient Bayesian Sampling with Langevin Birth-Death Dynamics Alex Leviyev, Francesco Iacovelli, Aaron Zimmerman Abstract Bayesian inference plays a central role in scientific and engineering applications by enabling principled reasoning under uncertainty. However, sampling from generic probability distributions remains a computationally demanding task. This difficulty is compounded when the distributions are ill-conditioned, multi-modal, or supported on topologically non-Euclidean spaces. Motivated by challenges in gravitational wave parameter estimation, we propose simulating a Langevin diffusion augmented with a birth-death process. The dynamics are rescaled with a simple preconditioner, and generalized to apply to the product spaces of a hypercube and hypertorus. Our method is first-order and embarrassingly parallel with respect to model evaluations, making it well-suited for algorithmic differentiation and modern hardware accelerators. We validate the algorithm on a suite of toy problems and successfully apply it to recover the parameters of GW150914—the first observed binary black hole merger. This approach addresses key limitations of traditional sampling methods, and introduces a template that can be used to design robust samplers in the future. Our code is available at [ 31 ] . 1 Introduction Bayesian inference provides a principled framework for estimating unknown quantities from observed data [ 64 , 7 ] . At its core, Bayesian inference involves sampling from a posterior distribution over model parameters constructed from data, prior information, and a forward model. However, in many scientific applications, this posterior distribution exhibits pathological features that make sampling difficult. One domain where these difficulties are particularly pronounced is gravitational wave (GW) parameter estimation [ 10 ] . GW signals, emitted by astrophysical events such as binary black hole or neutron star mergers, are detected as faint perturbations by ground-based observatories like LIGO and Virgo [ 1 , 6 , 29 ] . From these noisy signals, the task is to infer physical properties of the source—including the component masses, spins, sky location, and distance—by matching the observed data against theoretical waveform models [ 58 , 16 ] . Accurate inference of these parameters enables tests of general relativity [ 69 ] , places constraints on the neutron star equation of state [ 8 ] , and provides insights into astrophysical processes (e.g, those that govern binary formation and evolution [ 5 ] ). However, the problem is computationally challenging due to the slow convergence of sampling algorithms, which require millions of expensive forward models queries. Current analyses using state-of-the-art techniques often take several hours to days per event, even with large-scale computational resources. As detector sensitivity increases and the detection rate grows, the computational burden is expected to become significantly more demanding. This motivates the development of faster, more scalable inference methods that can keep pace with the growing volume of GW data. GW parameter estimation is a source of many intriguing issues from an algorithm design perspective. For instance, GW posteriors are supported on the product of three topological spaces. Orientation parameters such as spins or sky location belong to the sphere \mathbb{S}^{2} , coordinates that are prior bounded belong to the hypercube \mathbb{H}^{m} , and periodic coordinates such as signal phases belong to the hypertorus \mathbb{T}^{n} . Moreover, the posteriors are of moderately high-dimension, and exhibit (pathological) features such as multi-modality [ 51 ] and ill-conditioning. Coupled together, these issues make estimating parameters from GW data a formidable and unique challenge. A variety of sampling algorithms have been adopted for GW parameter estimation. Nested sampling remains one of the most popular approaches [ 53 , 61 , 9 ] , with implementations such as CPNest [ 17 ] , PyMultiNest [ 21 ] , and the widely used Dynesty library [ 55 ] . Although robust, nested sampling is computationally expensive, especially for high-dimensional problems with pathological features. Markov chain Monte-Carlo (MCMC) methods are also extensively used, coupled with advanced techniques like parallel tempering [ 18 ] , affine-invariant ensemble sampling [ 24 ] , and custom jump proposals [ 61 , 11 ] . However, many MCMC algorithms are zeroth order, meaning they only query the forward model, and not its gradient. Due to the recent ports of GW models to differentiable programming languages [ 27 , 19 ] , sampling methods utilizing gradient information also are under active development [ 68 ] . However, these have only recently been applied to GW parameter estimation, and have not yet been widely adopted. To date, a diffusion based sampling method robust to the issues presented above which can be efficiently implemented on modern hardware accelerators has not yet been developed. Our goal in this paper is to propose such a method using Langevin diffusion. In Section 2.1 , we review Langevin dynamics, and the idea of ensemble particle diffusions. Ensemble diffusions offer many advantages in constrast to single particle methods, such as the ability to construct preconditioners and more robustly discover modes. In Section 2.2 , we propose a simple way to calculate the optimal Fisher preconditioner introduced in [ 59 ] for ensemble methods. We show that incorporating this preconditioner significantly improves convergence rates on ill-conditioned test problems. In Section 2.3 we thoroughly investigate the procedure of inheriting flows over \mathbb{H}^{m} from flows over \mathbb{R}^{m} via reparameterization. Using the framework we develop, we provide guidelines on how to construct reparameterized diffusions with desirable behavior. We also illustrate that reparameterization couples non-trivially with well known techniques such as preconditioning and annealing. Finally, in Section 2.4 , we discuss our implementation of the birth-death process introduced in [ 37 , 46 ] , which is crucial for accurately reconstructing multi-modal distributions. All the tools introduced are generalized to be applicable on the hypercube, the hypertorus, and products thereof, and validated with experiments in Section 3 . In Section 4 we conclude with a proof of principle by estimating the parameters of GW150914 [ 2 , 3 ] , the first detected binary black-hole coalesence. 2 Background Let us consider the concrete application of parameter estimation. In this setting, one has a posterior p:\chi\to\mathbb{R}^{+} supported on a (possibly non-Euclidean) space \chi , and the task is to draw a large quantity of independent and identically distributed (i.i.d.) samples from it. A large i.i.d. sample set from a probability distribution is practically equivalent to a complete characterization of p . Indeed, the samples provide information regarding the morphology of p , including the presence of correlations or multimodality. On the other hand, the samples can be used to construct well-behaved estimators of expectation values with respect to p via the central limit theorem [ 67 ] . Unfortunately, drawing i.i.d. samples is impossible in most modern applications, and can only be done for a handful of classical probability distributions. Hence, we must resort to approximate methods to draw representative samples. 2.1 Ensemble Langevin Diffusion The Langevin diffusion [ 48 ] is a stochastic process X_{t} defined over \mathbb{R}^{d} which obeys the following stochastic differential equation: \displaystyle dX_{t}=-\nabla V(x)dt+\sqrt{2}dB_{t}, (1) where V:\mathbb{R}^{d}\to\mathbb{R} is the potential , and B_{t} is a standard Brownian motion. The density corresponding to X_{t} , denoted by \rho_{t}:=\Law X_{t} , in this case obeys the Fokker-Planck equation : \displaystyle\partial_{t}\rho_{t}=\nabla\cdot(\nabla\rho_{t}+\rho_{t}\nabla V), (2) and that under appropriate conditions on the potential that density \rho_{t}\to e^{-V} as t\to\infty [ 48 ] ,

Read the complete text