A Replica Exchange Markov Chain Monte Carlo Method for Disconnected Implicit Manifolds via Tubular Relaxation
Xuyuan WangDonglin Han · 2026
Read A Replica Exchange Markov Chain Monte Carlo Method for Disconnected Implicit Manifolds via Tubular Relaxation by Xuyuan WangDonglin Han (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-22055.txt.
Introduction
Wang and Han present a swap MCMC method linking a tied chain moving on a hidden manifold with a loose helper chain set in a tube around the constraint. In real cases, surfaces are sometimes disconnected from tricky shapes forced by bent rules. The loose chain lets the sampler jump between disconnected parts. The authors show the result samples a wider set of hidden manifolds, even disconnected ones. They prove the sampler meets balance, ergodicity, and convergence.
Catalog record
| CREATOR | Xuyuan WangDonglin Han |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 102084 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.22055
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Replica Exchange Markov Chain Monte Carlo Method for Disconnected Implicit Manifolds via Tubular Relaxation Xuyuan WangDonglin Han Abstract Markov chain Monte Carlo (MCMC) methods provide powerful framework for sampling unknown probability measures across a wide range of scientific applications. In some settings, the target distribution is supported on a lower-dimensional submanifold of Euclidean space defined by nonlinear constraints, motivating the development of constrained Hamiltonian Monte Carlo (CHMC) methods. Most existing CHMC algorithms rely on the assumption that the implicit manifold is connected, allowing local constrained integrators such as RATTLE to explore the posterior ergodically. In practice, this assumption is occasionally violated due to complex geometric structures induced by nonlinear constraints of a model. We propose a replica exchange MCMC framework that couples a constrained chain evolving on the implicit manifold with a relaxed auxiliary chain defined in a tubular neighborhood of the constraint. The relaxed chain enables transitions between disconnected components. We show that the resulting algorithm enables sampling from a broader class of implicit manifolds, including those with disconnected components. We prove that the proposed sampler satisfies detailed balance, irreducibility, ergodicity, and convergence. We also demonstrate its effectiveness on examples from molecular and biological dynamical systems. Keywords: Markov chain Monte Carlo, Replica exchange, Bayesin inverse problem, Non-identifiability, Molecular dynamics 1 Introduction Markov Chain Monte Carlo (MCMC) methods are an important class of algorithms for sampling from complex probability measures when only an unnormalized target density is available. Thanks to this flexibility, MCMC has been widely adopted across scientific disciplines, including molecular dynamics ( 2 ) , statistical physics ( 33 ) , and the calibration of biological dynamical models ( 23 ) . In these applications, MCMC enables uncertainty quantification and statistical inference in settings where direct sampling is infeasible due to high dimensionality, nonlinear structure, or intractable normalizing constants. In a number of important settings, the target probability measure is not supported on the full ambient Euclidean space but rather on a lower-dimensional manifold that is defined implicitly through holonomic constraints. This situation arises naturally in molecular dynamics, where one is often interested in Monte Carlo estimation of equilibrium measures subject to fixed bond lengths, bond angles, or other constraints on particle positions ( 16 ; 36 ) . These constraints define a configuration space that is a smooth submanifold of the ambient space, typically specified as the zero level set of a nonlinear constraint function. Sampling methods that fail to keep this geometric structure may suffer from poor efficiency or produce invalid samples. A similar challenge arises in Bayesian inverse problems for parameter calibration in biological and epidemiological models governed by systems of differential equations. In such models, structural or practical non-identifiability is common: the available data are insufficient to uniquely determine all model parameters, even in the absence of observation noise ( 32 ) . Instead, only certain identifiable combinations of parameters can be inferred from the observable quantities. From a geometric perspective, the inverse image of a calibrated identifiable parameter combination typically forms a lower-dimensional manifold embedded in the original parameter space. Consequently, recovering samples in the original parameterization from the calibrated parameter combination value requires algorithms that can accurately and efficiently explore the implicit manifold at the calibrated identifiable quantities ( 3 ; 17 ; 34 ) . These considerations have motivated a growing body of work on numerical methods for sampling from probability measures constrained to implicit manifolds. One class of approaches is based on projecting stochastic differential equations, such as Langevin dynamics, onto the tangent space of the constraint manifold ( 16 ; 24 ; 9 ) . These methods employ local projection schemes that correct unconstrained dynamics by orthogonally projecting proposed moves back onto the manifold. Another line of research is rooted in constrained Hamiltonian dynamics. In this framework, auxiliary momentum variables are introduced and the target distribution is augmented to a phase-space measure, allowing the use of Hamiltonian Monte Carlo (HMC) type proposals ( 27 ; 8 ) . The evolution of the system is governed by Hamilton’s equations subject to holonomic constraints, ensuring that both position and momentum remain consistent with the manifold structure. Numerical integrators such as the SHAKE and RATTLE algorithms ( 1 ) enforce the constraints at each integration step while preserving symplectic structure and time reversibility. When combined with a Metropolis correction ( 10 ) , these methods yield valid MCMC algorithms that can achieve long-range proposals and improved mixing compared to purely diffusive schemes. Despite these advances, sampling on implicitly defined manifolds remains challenging, particularly when the holonomic constraints induce disconnected implicit manifold ( 26 ) . Such disconnected manifolds arise naturally in several applications. In molecular dynamics, for example, nonlinear bond-length and bond-angle constraints can induce multiple disconnected configuration components corresponding to distinct molecular conformations ( 13 ) . Similarly, in inverse problems with parameter non-identifiability, identifiable parameter combinations are often obtained through algebraic mappings from the original parameter space ( 35 ) . As a result of algebraic symmetries, sign ambiguities, or polynomial invariants, the inverse image of an identifiable parameter value may decompose into multiple disconnected branches. Disconnectedness poses a fundamental difficulty for most existing MCMC algorithms. Methods based on local projection of Langevin dynamics or constrained Hamiltonian systems generate proposals by evolving dynamics in the local tangent space of the manifold. These algorithms are inherently local: step sizes must be sufficiently small to ensure numerical stability, constraint satisfaction, and reversibility ( 37 ) . Consequently, transitions between disconnected components, are generally impossible. This limitation leads to a failure to explore the full support of the target distribution when the manifold is disconnected. In this work, we propose a new MCMC sampling method on implicitly defined manifolds that addresses the challenge of disconnected components. Our approach is based on two key ideas. First, instead of restricting proposals strictly to the constraint manifold, we exploit the existence of local tubular neighborhoods around the manifold. Within such a neighborhood, points in the ambient space admit a well-defined projection onto the manifold, allowing us to construct proposal kernels that move in the surrounding space while remaining coupled to the geometry of the constraint. Second, to enable transitions between disconnected components, we apply the local proposal mechanism in a replica exchange framework ( 28 ) . By introducing a sequence of auxiliary distributions that progressively relax the constraint enforcement, we allow the chains to explore regions of the ambient space that connect isolated components of the manifold. We show that under regularity assumptions on the constraint mapping, the resulting Markov chain satisfies detailed balance with respect to the target measure and is ergodic over the full support of the manifold. The paper is organized as follows. In section 2 , we present some of the related works to this matter. In section 3 , we review some of the key concepts in the literature which forms a basis for our method, and introduce our methods. Section 4 provides the numerical examples to demonstrate the effectiveness of our method. Lastly in section 5 we provide a summary of the method and the potential future directions. 2 Related Work The foundation of this paper builds on the well-established constrained Hamiltonian Monte Carlo (CHMC) methodology, which has