Time-Inhomogeneous Preconditioned Langevin Dynamics

Alexander Falk, Laurenz Nagler, Andreas Habring, Thomas Pock · 2026

Read Time-Inhomogeneous Preconditioned Langevin Dynamics by Alexander Falk, Laurenz Nagler, Andreas Habring, Thomas Pock (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06091.txt.

Introduction

Alexander Falk, Laurenz Nagler, Andreas Habring, and Thomas Pock improve Langevin sampling with a preconditioner that changes over time and position. Sampling from a peaked distribution faces two hurdles: reaching far apart modes, and exploring each mode's local shape well. Standard preconditioners use fixed side information and trade one hurdle against the other, the authors argue.

Their method, TIPreL, adapts its preconditioner as the sampler moves, aiming to handle both hurdles in one framework. They prove convergence in continuous time and for a tamed discrete version, under weaker conditions than prior work allowed. Experiments on a hard two dimensional example and a Bayesian logistic regression task back the theory. The method beat competing preconditioning schemes in those tests.

Catalog record

CREATORAlexander Falk, Laurenz Nagler, Andreas Habring, Thomas Pock
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE90 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.06091

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Time-Inhomogeneous Preconditioned Langevin Dynamics Alexander Falk, Laurenz Nagler, Andreas Habring, Thomas Pock Abstract Langevin sampling from distributions of the form p ⁡ ( x ) ∝ exp ⁡ ( − Ψ ⁡ ( x ) ) p(x)\propto\exp(-\Psi(x)) faces two major challenges: (global) mode coverage and (local) mode exploration . The first challenge is particularly relevant for multi-modal distributions with disjoint modes, whereas the second arises when the potential Ψ \Psi exhibits diverse and ill-conditioned local mode geometry. To address these challenges, a common approach is to precondition Langevin dynamics with problem-specific information, such as the sample covariance or the local curvature of Ψ \Psi . However, existing preconditioner choices inherently involve a trade-off between global mode coverage and local mode exploration, and no prior method resolves both simultaneously. To overcome this limitation, we propose the time-inhomogeneous preconditioned Langevin algorithm (TIPreL), which introduces a time- and position-dependent preconditioner. This design effectively addresses both challenges mentioned above within a single framework. We establish convergence of the resulting dynamics in the Wasserstein-2 distance both in continuous time and for a tamed Euler discretization. In particular, our analysis extends the existing state of the art by proving convergence under time- and space-dependent diffusion coefficients, and only locally Lipschitz drifts, which has not been covered by prior work. Finally, we experimentally compare TIPreLwith competing preconditioning schemes on a two-dimensional, severely ill-posed example and on a Bayesian logistic regression task in higher dimensions, confirming the efficiency of the proposed method. 1 Introduction We are interested in sampling from a probability distribution \mathrm{d}\pi(x)=p(x)\mathrm{d}x on \mathbb{R}^{d} with d\geq 1 , characterized via a density of Gibbs-Boltzmann form p(x)=\frac{\exp(-\Psi(x))}{\int_{\mathbb{R}^{d}}\exp(-\Psi(\xi))\,\mathrm{d}\xi} (1) with potential function \Psi\colon\mathbb{R}^{d}\to\mathbb{R} . Throughout, we assume that \Psi is twice continuously differentiable with L -Lipschitz continuous gradient. More specifically, we are interested in sampling from \pi via preconditioned Langevin dynamics with temporally and spatially varying preconditioning. Sampling from Gibbs distributions of the above form is a prevalent task within machine learning and Bayesian inverse problems [ 20 , 28 , 40 ] . Due to the complexity of \Psi in most applications, direct sampling is not feasible, and researchers resort to Markov chain Monte Carlo (MCMC)methods. Among those, the most popular ones are based on discretizations of the (overdamped) Langevin stochastic differential equation (SDE) \mathrm{d}X_{t}=-\nabla\Psi(X_{t})\,\mathrm{d}t+\sqrt{2}\,\mathrm{d}W_{t}. (2) It is well-known that under mild conditions, such as Lipschitz-smoothness and certain growth assumptions on the potential, the law of the solution of ( 2 ) converges to its unique stationary distribution \pi as t\rightarrow\infty in different metrics such as the Kullback-Leibler divergence (KLD)or the Wasserstein-2 distance [ 32 ] . Similarly, discretizing ( 2 ) via, e.g. , an Euler-Maruyama discretization leads to an ergodic Markov chain whose stationary distribution approximates \pi as the discretization step size vanishes [ 12 , 14 , 32 ] . However, Langevin sampling suffers from slow convergence, especially in high-dimensional and/or multi-modal settings. While there exist several techniques for acceleration of Langevin sampling, in particular based on annealing/tempering [ 7 , 11 , 21 , 19 ] or momentum/inertia [ 8 , 16 ] , we believe that the gap to acceleration techniques in numerical optimization is still significant. In this article, we consider accelerating Langevin sampling by the incorporation of a time- and position-dependent preconditioning, that is, we consider for a symmetric, positive definite matrix B(t,x)\in\mathbb{R}^{d\times d} the Langevin SDE \mathrm{d}X_{t}=[-B(t,X_{t})\nabla\Psi(X_{t})+\divergence B(t,X_{t})]\,\mathrm{d}t+\sqrt{2}B^{1/2}(t,X_{t})\,\mathrm{d}W_{t}. (3) where the divergence of the matrix-field B is defined as the row-wise divergence (\divergence B(t,x))_{i}=\sum_{j=1}^{d}\partial_{x_{j}}B_{ij}(t,x),\quad i=1,\dots,d. (4) Note that, in addition to the preconditioning appearing in front of the force \nabla\Psi and the Brownian motion, the term \divergence B within ( 3 ) is necessary to maintain \pi as a stationary distribution. Whenever B(t,x) is independent of x , the divergence vanishes, yielding simpler dynamics. In the case that B(t,x) is, in fact, independent of t , ( 3 ) is the so-called Riemannian Langevin dynamics (RML), i.e. , Langevin dynamics on a Riemannian manifold with metric B^{-1}(x) [ 18 ] . Let us denote for simplicity the drift as b(t,x)=-B(t,x)\nabla\Psi(x)+\divergence B(t,x) . As the space dependence of the preconditioner leads to a loss of global Lipschitz continuity of b(t,x) , we employ a tamed Euler discretization. More precisely, as proposed in [ 6 ] we consider as a discrete scheme approximating ( 3 ) Y_{t_{k+1}}=Y_{t_{k}}+{h}_{k}b_{{h}_{k}}(t_{k},X_{k})+\sqrt{2{h}_{k}}B^{1/2}(t_{k},Y_{t_{k}})Z_{k},\quad Z_{k}\sim\mathcal{N}(0,\id) (5) with step size {h}_{k}>0 , time points t_{k}=\sum_{\ell=0}^{k-1}{h}_{\ell} and the tamed drift b_{h}(t,x)=\frac{b(t,x)}{1+{h}|b(t,x)|}. (6) This process corresponds to a sampling at the time-steps (t_{k})_{k} of SDEdefined piece-wise for t\in(t_{k},t_{k+1}] as \mathrm{d}Y_{t}=b_{{h}_{k}}(t_{k},Y_{t_{k}})\mathrm{d}t+\sqrt{2}B^{1/2}(t_{k},Y_{t_{k}})\mathrm{d}W_{t}. (7) While the considered algorithm will be proven to converge to the target under rather general assumptions on B(t,x) , inspired by quasi-Newton methods in optimization, we will specifically consider approximations of the inverse Hessian B(t,x)\approx\nabla^{2}\Psi(x)^{-1} (see section 4 for details) as well as time-dependent convex combinations of the form B(t,x)=\lambda_{t}B_{1}(x)+(1-\lambda_{t})B_{0} where B_{0}\in\mathbb{R}^{d\times d} is a global ( i.e. , position-independent) preconditioner, B_{1}(x)\in\mathbb{R}^{d\times d} is the above mentioned approximation of the Hessian, and \lambda_{t}\in[0,1] satisfies \lambda_{t}\rightarrow 1 as t\rightarrow\infty . Contributions In summary, we provide the following contributions. • We propose TIPreL, Langevin sampling with time- and position-dependent preconditioning. Specifically, we propose to use a time-dependent convex combination of the (estimated) covariance and a quasi-Newton matrix to combine global and local curvature information in an ideal manner. • We provide a rigorous and complete convergence analysis of the proposed method. This convergence analysis provides a novelty beyond the considered problem of preconditioned Langevin sampling since we prove convergence of Langevin sampling via a tamed Euler-Maruyama discretization for locally Lipschitz drift and time-dependent drift and diffusion. Under such general conditions these convergence results have not been available yet to our knowledge. • We provide numerical results in two dimensions as well as for a high-dimensional Bayesian logistic regression example. The numerical experiments confirm the theoretical results and the efficacy of the proposed preconditioning. Outline The remainder of the article contains a discussion of related works in section 2 , a short overview over the theoretical analysis of the method in section 3 with the detailed proofs in the appendix, appendix A , and numerical results for low-dimensional, but severely ill-posed potentials as well as for higher-dimensional Bayesian logistic regression in section 4 . 2 Related work In optimization, preconditioners are used to accelerate the gradient-based minimization of ill-conditioned objective functions (see, e.g. , [ 29 , Chapter 5] ). The observed gain in convergence speed has led to the adoption of various preconditioning schemes in the field of MCMCmethods [ 18 , 22 , 25 , 27 , 31 , 39 , 42 ] . The simplest way to improve the behavior of the potential function in the Langevin MCMCcase is to employ a global , i.e. , time- and space-invariant, preconditioner B [ 18 ] . There exist various proposals for choices of B most prominently, (the empirical estimate of) the target covariance B=\cov(X) [ 25 ] or the inverse of the expected Fisher information matrix B=\mathbb{E}_{X\sim\pi}[\nabla^{2}\Psi(X)]^{-1} [ 37 , 38 ] where it should be noted that the latter is the provably optimal global preconditioner with respect to the expected squared jump distance [ 37 ] . Position-dependent preconditioning Position dependent preconditioning is significantly more difficult due to the appearance

Read the complete text