Transition probabilities for stochastic differential equations using the Laplace approximation: Analysis of the continuous-time limit
Uffe Høgsbro Thygesen · 2025
Read Transition probabilities for stochastic differential equations using the Laplace approximation: Analysis of the continuous-time limit by Uffe Høgsbro Thygesen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-21399.txt.
Introduction
Uffe Høgsbro Thygesen sharpens a Laplace-based gauge of transition odds for stochastic differential equations. The paper from twenty twenty-five grows from an estimation method the author helped build. That method filled gaps between observations with mid-time states and integrated them out by Laplace approximation. Here the time step shrinks to zero, and the limit form is the prize.
The driving noise is recast as a control signal. The task becomes a least-effort steering problem between two states. A Girsanov shift of measure and a weak-noise step yield the limit formula. One example is exact, thanks to a coordinate trait. Another shows where far-off paths spoil the gauge. Splitting schemes beat plain Euler steps on order and care. Noise size and span length tune the accuracy in numeric checks.
Catalog record
| CREATOR | Uffe Høgsbro Thygesen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 55 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-21399
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Transition probabilities for stochastic differential equations using the Laplace approximation: Analysis of the continuous-time limit Uffe Høgsbro Thygesen Abstract We recently proposed a method for estimation of states and parameters in stochastic differential equations, which included intermediate time points between observations and used the Laplace approximation to integrate out these intermediate states. In this paper, we establish a Laplace approximation for the transition probabilities in the continuous-time limit where the computational time step between intermediate states vanishes. Our technique views the driving Brownian motion as a control, casts the problem as one of minimum effort control between two states, and employs a Girsanov shift of probability measure as well as a weak noise approximation to obtain the Laplace approximation. We demonstrate the technique with examples; one where the approximation is exact due to a property of coordinate transforms, and one where contributions from non-near paths impair the approximation. We assess the order of discrete-time scheme, and demonstrate the Strang splitting leads to higher order and accuracy than Euler-type discretization. Finally, we investigate numerically how the accuracy of the approximation depends on the noise intensity and the length of the time interval. 1 Introduction Computation of transition probabilities is a fundamental problem for numerical analysis of stochastic differential equations, and arises in many different contexts. Here, our primary motivation comes from time series analysis, i.e., estimating states and parameters based on incomplete and/or noisy measurements of states in discrete time. Then, the joint density of the states are determined by the transition probabilities of the underlying stochastic differential equation. Recently [ Thygesen and Kristensen (2025) ] , we considered an approach to this problem based on inserting unobserved states at intermediate time points between observations, and using the Laplace approximation to integrate out unobserved random variables; the present paper is a continuation of this research. For general stochastic differential equations, the transition probabilities cannot be found in closed form, but a range of different numerical methods can be applied for their approximation [ Kloeden and Platen (1999) ] . The probabilities are governed by the forward Kolmogorov equation (a.k.a. the Fokker-Planck equation), and numerical analysis of this partial differential equation is feasible with standard techniques (e.g., finite volume) in low-dimensional state spaces; up to three, say. Such a discretization of space can lead to approximating the entire time series analysis problem with a Hidden Markov Model [ Thygesen (2023) ] , which is particularly useful for models with very strong nonlinear effects such as multimodal posteriors [ Thygesen et al. (2009) ] . However, grid-based methods are infeasible for high-dimensional state spaces and inefficient when the posterior probability is centered on a small region of state space. When times between measurements are small, approximate expressions for the transition probabilities can be derived from time discretization schemes [ Kloeden and Platen (1999) ] . Most basically, the explicit Euler-Maruyama method for an Itô equation leads to a Gaussian approximation for the transition probability. This approximation can serve as a basis for time series analysis which was noted already in the 1970’s [ Prakasa Rao and Rubin (1979) , e.g.] and elaborated on many times since; for example, the approach can be refined with improved estimates for the conditional mean and variance [ Kessler (1997) ] . Increased accuracy can be obtained with stronger discretization schemes [ Pilipovic et al. (2024) ] which makes the approach applicable to situations with larger time steps. Approximations to the transition probabilities can also be obtained with linearization techiques [ Jazwinski (1970) ] . Here, a nominal trajectory is determined as the solution to an ordinary differential equation, while deviations from this nominal trajectory are approximated with a Gaussian process which is determined from the linearization of the dynamics around the nominal path. This is particular useful when nonlinearities in the drift function are important, also at the time scale between measurements, while the stochastic noise is weak. In the context of time series analysis, this leads to the Extended Kalman Filter, which have many variants [ Jimenez and Ozaki (2003) , Simon (2006) ] . In this paper, we focus on yet a different approach to obtaining approximating transition densities, viz., the Laplace approximation. This approximation assists analysis of models with unobserved random variables, which are to be integrated out, by approximating the integrand with a Gaussian for which the integral is available in closed form. In the context of time series analysis, this approach has the appeal that it can also address the uncertainty of the states at the times of measurements, and thereby provides a unifying framework. [ Karimi and McAuley (2014) ] investigated the application of the Laplace approximation to problems of filtering and estimation, under the assumption of additive noise; see also [ Karimi and McAuley (2016) ] and [ Thygesen (2023) ] . The main contribution of [ Thygesen and Kristensen (2025) ] was to extend this methodology beyond additive noise. The contribution of the present paper is to examine the continuous-time limit of the discrete-time schemes considered in [ Thygesen and Kristensen (2025) ] for approximating transition densities. That is, we investigate the limit where the computational time steps between intermediate time points vanishes. An analysis with a similar objective, but somewhat different methods, has previously been performed by [ Markussen (2009) ] . Here, our analysis (section 3 ) consists of four main elements: First, we identify the so-called most probable path connecting the start and end points, by means of a minimum effort optimal control problem. Next, we shift the underlying probability measure using a Girsanov transformation to center the probability at this most probable path. Then, we analyze the properties of the control problem in the neighborhood of the most probable path, using linearization techniques and, in particular, a certain Riccati equation from optimal control. Finally, we examine the variance of weak-noise fluctuations around the most probable path, using a Lyapunov equation. These ingredients can then be combined to yield a Laplace approximation to the path integral, i.e., the integral over sample space. At the end, our method allows the computation of approximated transition probabilities, by solving ordinary differential equations. The primary application of this method, we believe, is not so much computation of actual transition probabilities in specific time series analysis, but rather that the continuous-time limit facilitates the analysis of discrete-time algorithms, and in particular, to disentangle errors from the Laplace approximation and from the time discretization. To demonstrate this potential, we examine the accuracy of the Laplace approximation (section 4 ) and compare the continuous-time limit with discrete-time approximations derived both from an Euler-type algorithm and from one involving Strang splitting. We also examine the error in the Laplace approximation itself. 2 Transition densities and their discretized Laplace approximation We consider the Stratonovich stochastic differential equation in {\mathbf{R}}^{n} dX_{t}=f(X_{t})~dt+g(X_{t})\circ dB_{t},\quad X_{0}=x_{0}, (1) where \{B_{t}:t\geq 0\} is n -dimensional Brownian motion on a probability space (\Omega,{\mbox{$\cal F$}},{\mathbf{P}}) and \circ dB_{t} indicates the Stratonovich integral. We assume throughout that f and g satisfy the standard conditions (see, e.g., [ Thygesen (2023) ] ) for existence and uniqueness of a strong solution \{X_{t}:t\geq 0\} , and that g(x) is invertible for all x . This implies that