The Stochastic Occupation Kernel (SOCK) Method for Learning Stochastic Differential Equations
Michael L. Wells, Kamel Lahouel, Bruno Jedynak · 2025
Read The Stochastic Occupation Kernel (SOCK) Method for Learning Stochastic Differential Equations by Michael L. Wells, Kamel Lahouel, Bruno Jedynak (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-11622.txt.
Introduction
Michael Wells, Kamel Lahouel, and Bruno Jedynak teach machines in 2025 to learn the rules of a noisy random system from its paths alone. Such systems, written as stochastic equations, drive fields from finance to brain imaging. Learning them usually means fighting likelihood math that will not close.
Their method, SOCK, works in two steps: first the drift, the push that steers the path, then the spread, which sets how wildly it jitters. Special path-averaging tools, one for the push and a wider one for the spread, feed a fit scored by rebuild error, avoiding the likelihood trap. A math shortcut keeps the fitting fast. Tests cover mock data and real amyloid brain scans from healthy and Alzheimer subjects, with accuracy held high.
Catalog record
| CREATOR | Michael L. Wells, Kamel Lahouel, Bruno Jedynak |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 82 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-11622
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Stochastic Occupation Kernel (SOCK) Method for Learning Stochastic Differential Equations Michael L. Wells, Kamel Lahouel, Bruno Jedynak Abstract We present a novel kernel-based method for learning multivariate stochastic differential equations (SDEs). The method follows a two-step procedure: we first estimate the drift term function, then the (matrix-valued) diffusion function given the drift. Occupation kernels are integral functionals on a reproducing kernel Hilbert space (RKHS) that aggregate information over a trajectory. Our approach leverages vector-valued occupation kernels for estimating the drift component of the stochastic process. For diffusion estimation, we extend this framework by introducing operator-valued occupation kernels, enabling the estimation of an auxiliary matrix-valued function as a positive semi-definite operator, from which we readily derive the diffusion estimate. This enables us to avoid common challenges in SDE learning, such as intractable likelihoods, by optimizing a reconstruction-error-based objective. We propose a simple learning procedure that retains strong predictive accuracy while using Fenchel duality to promote efficiency. We validate the method on simulated benchmarks and a real-world dataset of Amyloid imaging in healthy and Alzheimer’s disease subjects. keywords occupation kernel, SDE, RKHS, dynamical system, kernel method, optimization, convex optimization † † runningheads: The Stochastic Occupation Kernel Method / M. Wells, K. Lahouel, B. Jedynak MSC 65C20, 46E22, 46N10, 62J07, 60H10 1 Introduction The modeling of time series data using dynamical systems is a common practice in the sciences and engineering. Traditionally, a technician would select an appropriate parametric model using prior knowledge of the system under investigation, and then they would fit the parameters with the available data. In recent years, there has been an explosion in the development of methods for automatic system identification when there is limited prior knowledge of the system available, for example, see [ 5 ] , [ 6 ] , [ 20 ] . When the dynamics of the system itself are thought to contain randomness, SDEs may be used [ 1 ] . These are dynamical systems consisting of a deterministic drift and a stochastic diffusion . SDEs are frequently used in domains like physics [ 23 ] , biology [ 8 ] , and finance [ 35 ] , [ 10 ] . The SDE learning task is that of estimating the drift and diffusion. There are a variety of existing methods for automatically inferring SDEs. In [ 7 ] [ 38 ] , the drift and diffusion are parametrized by Gaussian processes (GPs), while in [ 40 ] , they use neural networks. The method of [ 36 ] fits the model over a library of functions using sparse regression, similar to SINDy [ 5 ] for ordinary differential equations (ODEs). Finally, the method of [ 19 ] approximates the Koopman generator of the SDE from which one may obtain the drift and diffusion. A different but related set of methods are neural SDEs [ 17 ] , [ 39 ] , [ 25 ] , which parametrize SDEs on latent space with neural networks. These methods are the stochastic analogs of neural ODEs, first investigated in [ 6 ] . Occupation kernels were pioneered in the work of [ 33 ] [ 34 ] and extended in [ 30 ] as a tool for estimating the slope field of an ODE. They are functions belonging to a reproducing kernel Hilbert space (RKHS) [ 3 ] which reduce the computation of an integral over a trajectory to an inner product in the RKHS. Using a representer theorem, the process of optimizing a slope field becomes a non-parametric regression, similar to gradient matching. However, gradient matching is a finite difference-based approach, and thus susceptible to error in the case of noisy data, while occupation kernels are finite element-based, making them more robust to noise. A weak formulation of the occupation kernel method was investigated in [ 29 ] . To adapt the concept of occupation kernels to the stochastic setting, we introduce an expected value over trajectories with fixed initial condition in the associated functionals. We use the Itô isometry to introduce a reconstruction-error-based loss function for the diffusion and present a novel, operator occupation kernel construction to optimize this loss. We use the parametrization from [ 22 ] , [ 24 ] and adapt the representer theorem for PSD matrix-valued functions therein to the setting of occupation kernels by accommodating integral operators in the place of evaluation operators. In this way, we constrain our estimate of the squared diffusion \sigma_{0}\sigma_{0}^{T} to be PSD-matrix-valued, lending it further validity. The paper is organized as follows: We present the problem setting and notation in section 2 , the method in section 3 , results of numerical experiments in section 4 , and our conclusions in section 5 . 2 Problem setup and notation Suppose we have a collection of d -dimen-sional snapshots of a trajectory at the times t_{0}<t_{1}<\ldots<t_{n} of an Itô SDE whose solution x\colon[0,T]\times\Omega\to\mathbb{R}^{d} satisfies the following: dx_{t}=f_{0}(x_{t})dt+\sigma_{0}(x_{t})dW_{t} (1) where f_{0}\colon\mathbb{R}^{d}\to\mathbb{R}^{d} is the unknown drift , \sigma_{0}\colon\mathbb{R}^{d}\to\mathbb{R}^{d\times d} is the unknown diffusion and W_{t} is d -dimensional Brownian motion. We assume that strong solutions of the system exist and are unique for any choice of initial condition (see [ 26 , Theorem 5.2.1] ). Suppose also that we have M realizations of these observations, which we denote by \bigcup_{u=1}^{M}\{y_{i}^{(u)}\}_{i=0}^{n} . Thus, we have y_{i}^{(u)}:=x(t_{i},\omega^{(u)}) with \omega^{(u)}\in\Omega for each u=1,\ldots,M . We additionally require that x_{0}:=x(0,\omega^{(u)}) is fixed for all u . Extending the following derivation to the case of multiple trajectories with multiple initial conditions is straight-forward. Let k\colon\mathbb{R}^{d}\times\mathbb{R}^{d}\to\mathbb{R} denote a positive-definite, scalar-valued kernel. Let K\colon\mathbb{R}^{d}\times\mathbb{R}^{d}\to\mathbb{R}^{d\times d} denote a positive-definite, matrix-valued kernel. If a kernel K has the property that K(x,y)=k(x,y)I_{d} for some scalar kernel k , we say that K is I -separable [ 30 ] . Let H be the RKHS corresponding to K . Let Q_{[a,b]}[g(y_{t}^{(u)})] denote a quadrature of the integral \int_{a}^{b}g(y_{t}^{(u)})dt using the u^{th} realization of the trajectory in the training set. Similarly let Q_{[a,b]\times[c,d]}[g(y_{s}^{(u)},y_{t}^{(v)})] be a double integral quadrature over the rectangle [a,b]\times[c,d] . The proofs of the following propositions and theorems are deferred to the appendices for space considerations. 3 Method 3.1 Estimating the drift The integral form of ( 1 ) is given by x_{t_{i+1}}-x_{t_{i}}=\int_{t_{i}}^{t_{i+1}}f_{0}(x_{t})dt+\int_{t_{i}}^{t_{i+1}}\sigma_{0}(x_{t})dW_{t} (2) where \int dW_{t} denotes the Itô integral. We take the conditional expectation of both sides given that the trajectory under consideration has fixed initial condition x_{0} : \mathbb{E}[x_{t_{i+1}}-x_{t_{i}}|x_{0}]=\mathbb{E}\left[\int_{t_{i}}^{t_{i+1}}f_{0}(x_{t})dt\Bigg|x_{0}\right] (3) which follows since the expectation of an Itô integral is zero [ 26 ] . This suggests that we minimize the following cost function over candidate drift estimates f\in H , an RKHS with kernel K : J_{drift}(f)=\frac{1}{n}\sum_{i=0}^{n-1}\left\|\mathbb{E}\left[\int_{t_{i}}^{t_{i+1}}f(x_{t})dt\Bigg|x_{0}\right]-\overline{y_{i+1}-y_{i}}\right\|^{2}_{\mathbb{R}^{d}}+\lambda_{f}\|f\|^{2}_{H} (4) where \overline{y_{i+1}-y_{i}}:=\frac{1}{M}\sum_{u=1}^{M}\left(y_{i+1}^{(u)}-y_{i}^{(u)}\right) is an empirical estimate of the left-hand side of ( 3 ) and \lambda_{f}>0 is a hyperparameter governing the amount of regularization to be applied. Theorem 1 (Representer theorem). Suppose that the following regularity condition holds: \mathbb{E}\left[\int_{t_{i}}^{t_{i+1}}\mbox{\rm Tr}(K(x_{t},x_{t}))dt\Bigg|x_{0}\right]<\infty (5) for i=0,\ldots,n-1 where \mbox{\rm Tr}(\cdot) denotes the matrix trace. Then there exists a minimizer f^{*}\in H of ( 4 ) given as a linear combination of functions L_{i}^{*} : f^{*}=\sum_{i=0}^{n-1}L_{i}^{*}\alpha_{i} (6) where \alpha_{i}\in\mathbb{R}^{d} and L_{i}^{*}\colon\mathbb{R}^{d}\to\mathbb{R}^{d\times d} is the function defined by L_{i}^{*}(x):=\mathbb{E}\left[\int_{t_{i}}^{t_{i+1}}K(x,x_{t})dt\Bigg|x_{0}\right] (7) for i=0,\ldots,n-1 . The coefficients \alpha_{i} may be found by solving (L^{*}+n\lambda_{f}I_{nd})\alpha=\overline{\Delta y} (8) where L^{*} is