Covariance-Adaptive Bouncy Particle Samplers via Split Lagrangian Dynamics

A. Chevallier, E. Raab · 2025

Read Covariance-Adaptive Bouncy Particle Samplers via Split Lagrangian Dynamics by A. Chevallier, E. Raab (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-24847.txt.

Introduction

Sampling methods draw values from a target distribution so that averages can be computed, and a popular family moves a particle in straight lines that bounce off slopes. Augustin Chevallier and Erik Raab extend that family in this 2025 paper. Their aim is to let the sampler adapt not just its step size but also its sense of direction, based on the local shape of the target.

Their method gives the particle a velocity spread that depends on where it sits, using a metric drawn from the target's curvature. When the metric changes along the path, extra velocity updates are triggered. Tests on controlled problems guide when this covariance-adaptive sampler beats standard versions. The paper should help users pick the right tool for targets whose shape twists from place to place.

Catalog record

CREATORA. Chevallier, E. Raab
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE46 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-24847

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Covariance-Adaptive Bouncy Particle Samplers via Split Lagrangian Dynamics A. Chevallier, E. Raab Abstract Piecewise Deterministic Markov Processes (PDMPs) provide a powerful framework for continuous-time Monte Carlo, with the Bouncy Particle Sampler (BPS) as a prominent example. Recent advances through the Metropolised PDMP framework allow local adaptivity in step size and effective path length, the latter acting as a refreshment rate. However, current PDMP samplers cannot adapt to local changes in the covariance structure of the target distribution. We extend BPS by introducing a position-dependent velocity distribution that varies with the local covariance structure of the target. Building on ideas from Riemannian Manifold Hamiltonian Monte Carlo and its velocity-based variant, Lagrangian Dynamical Monte Carlo, we construct a PDMP for which changes in the metric trigger additional velocity update events. Using a metric derived from the target Hessian, the resulting algorithm adapts to the local covariance structure. Through a series of controlled experiments, we provide practical guidance on when the proposed covariance-adaptive BPS should be preferred over standard PDMP algorithms. 1 Introduction Piecewise Deterministic Markov Processes (PDMPs) have recently emerged as a promising class of continuous-time Monte Carlo algorithms, offering non-reversible dynamics, rejection-free proposals, and competitive performance in high-dimensional settings [ 8 ] . Among these, the Bouncy Particle Sampler (BPS) [ 7 ] has become one of the most widely used examples, combining deterministic linear trajectories with stochastic bounce and refreshment events. Recent work has extended BPS through the framework of Metropolised PDMPs [ 13 ] , in which numerical approximations of the event rate are combined with a Metropolis-Hastings correction. This approach removes the need for manually derived upper bounds on event rates, which had to be tailored to each target. This requirement was a serious limitation, since it discouraged the design of PDMPs with more sophisticated rates. At the same time, Metropolised PDMPs make it possible to introduce local adaptivity, most notably in the step size of the numerical approximation and the effective path length of the process, the latter acting as a mechanism for controlling the refreshment rate. In addition, non-local adaptation has been proposed for the covariance matrix [ 11 ] . While these methods represent a significant advance, current PDMP-based samplers still cannot adapt to local changes in the covariance structure of the target distribution. The goal of this paper is to address this limitation by extending BPS to incorporate position-dependent velocity distributions , informed by a Riemannian metric on the position space. Our construction draws inspiration from Riemannian Manifold Hamiltonian Monte Carlo (RMHMC) [ 2 ] , and in particular from the Lagrangian Dynamical Monte Carlo formulation [ 6 ] , which replaces the momentum formulation of RMHMC with a velocity-based parametrization. Translating these ideas into the PDMP framework yields a new variant of BPS that adapts naturally to the local covariance structure: when the metric changes with position, additional events are introduced to update the velocity accordingly. In this work, we employ a metric based on the Hessian of the log-density of the target distribution, following [ 4 ] . This metric captures local covariance structure of the target and adapts the dynamics to anisotropic targets. The paper is organised as follows. Section 2 reviews background on PDMP sampling and Lagrangian Dynamical Monte Carlo. Section 3 introduces a PDMP based on split Lagrangian dynamics and our extension of BPS with position-dependent velocities. Section 4 outlines the numerical simulation of these processes. Section 5 reports controlled experiments designed to indicate when the proposed algorithm should be preferred to standard BPS. Section 6 discusses the strengths and limitations of the method and concludes with directions for future research. 2 Previous work 2.1 Piecewise deterministic Markov processes samplers A piecewise deterministic Markov process (PDMP) is a continuous-time Markov process (X_{t})_{t\geq 0} whose dynamics are governed by deterministic flows punctuated by random events [ 1 ] . Between events, the state evolves deterministically according to an ordinary differential equation (ODE): \frac{d}{dt}X_{t}=\Phi(X_{t}), where \Phi is a vector field. Event times are generated according to an inhomogeneous Poisson process with rate \lambda(X_{t}) . In other words, the probability of having an event in the time interval [t,t+\mathrm{d}t] is \lambda(X_{t})\,\mathrm{d}t+o(\mathrm{d}t) . At each event time, the process undergoes a stochastic update X_{t}\sim Q(\cdot\mid X_{t}), where Q is a transition kernel. In PDMP-based Monte Carlo, the triplet (\Phi,\lambda,Q) is chosen so that a target probability measure \mu is invariant [ 8 ] . Let \rho(x,t) denote the probability density of X_{t} at position x and time t . Between events, the density flows deterministically along \Phi , satisfying the Liouville equation \frac{\partial\rho}{\partial t}+\mathrm{div}(\rho\,\Phi)=0. Events occur at rate \lambda(x) and redistribute probability according to Q , contributing \frac{\partial\rho}{\partial t}\Big|_{\text{events}}=\int\lambda(x^{\prime})\,Q(x\mid x^{\prime})\,\rho(x^{\prime},t)\,dx^{\prime}-\lambda(x)\,\rho(x,t). Combining these terms gives the Kolmogorov forward equation (or Fokker–Planck equation) for the PDMP: \frac{\partial\rho(x,t)}{\partial t}=-\mathrm{div}(\rho(x,t)\,\Phi(x))+\int\lambda(x^{\prime})\,Q(x\mid x^{\prime})\,\rho(x^{\prime},t)\,dx^{\prime}-\lambda(x)\,\rho(x,t). Stationarity is thus achieved when \rho(x,t)=\mu(x) satisfies \mathrm{div}(\mu(x)\,\Phi(x))=\int\lambda(x^{\prime})\,Q(x\mid x^{\prime})\,\mu(x^{\prime})\,dx^{\prime}-\lambda(x)\,\mu(x), which expresses ”mass conservation”: any change of density due to the deterministic flow is offset by stochastic events to and from the state. A common special case occurs when events correspond to a deterministic, bijective, volume-preserving map F : X_{t}\mapsto F(X_{t}),\quad\text{with }|\det DF(x)|=1. In this case, the jump term in the Kolmogorov forward equation simplifies, and the density evolution becomes \frac{\partial\rho(x,t)}{\partial t}=-\mathrm{div}(\rho(x,t)\,\Phi(x))+\lambda(F^{-1}(x))\,\rho(F^{-1}(x),t)-\lambda(x)\,\rho(x,t), where the gain term accounts for mass arriving from the unique pre-image under F . Consequently, stationarity is achieved when \rho(x,t)=\mu(x) satisfies \mathrm{div}(\mu(x)\,\Phi(x))=\lambda(x)\,\mu(F^{-1}(x))-\lambda(x)\,\mu(x), (1) which expresses conservation of mass under deterministic, bijective, volume-preserving jumps. Remark 1 . While the mass-conservation perspective provides an intuitive understanding of invariance, a fully rigorous treatment of PDMPs requires the formalism of the extended infinitesimal generator [ 1 , 10 , 12 ] . Bouncy Particle Sampler The Bouncy Particle Sampler (BPS) [ 7 ] is a PDMP-based Markov chain Monte Carlo (MCMC) method for sampling from a target density \pi . The process is defined on the extended state space (x,v)\in\mathbb{R}^{d}\times\mathbb{R}^{d}, and admits the stationary density \mu(x,v)=\pi(x)\,p_{v}(v), where p_{v}(v) is a chosen distribution for the velocity. Two common choices are: • the uniform distribution on the unit sphere , p_{v}(v)=\text{Unif}(\{v\in\mathbb{R}^{d}:\|v\|=1\}) ; • the standard Gaussian distribution , p_{v}(v)=\mathcal{N}(0,I_{d}) . The deterministic dynamics are governed by the vector field \Phi(x,v)=(v,0), so that between events the system evolves according to \frac{d}{dt}X_{t}=V_{t},\qquad\frac{d}{dt}V_{t}=0, i.e. linear motion. Event times are generated according to the inhomogeneous Poisson rate \lambda(x,v)=[-\langle v,\nabla\log\pi\rangle]^{+}. At such an event, the velocity is updated deterministically by reflection: F:V\mapsto V-2\frac{\langle V,\nabla\log\pi\rangle}{\|\nabla\log\pi\|^{2}}\,\nabla\log\pi, which corresponds to a “bounce” against the energy gradient. One readily verifies that equation ( 1 ) is satisfied, hence \mu is stationary. This follows from directly from 1. \mathrm{div}(\mu\Phi)=\mu\,v\cdot\nabla\log\pi , 2. The reflection F reverses the sign of \langle v,\nabla\log\pi\rangle hence \lambda(F(x,v))-\lambda(x,v)=v\cdot\nabla\log\pi , 3. F preserves volumes and p_{v} is invariant under F , so \mu(F(x,v))=\mu(x,v) . Remark 2 . To ensure ergodicity, additional refreshment events are introduced at a constant rate, where V is resampled from p_{v} . 2.2 Metropolised PDMP samplers Exact simulation of PDMP samplers typically requires manually derived upper bounds on the event rates to implement the standard thinning procedure. For complex rates, this approach is often infeasible. To address this limitation, we adopt the Metropolised PDMP framework [ 13 ] . For clarity, we present the framework in a simplified setting with: 1. a target

Read the complete text