Goal-oriented learning of stochastic dynamical systems using error bounds on path-space observables
Joanna Zou, Han Cheng Lie, Youssef Marzouk · 2026
Read Goal-oriented learning of stochastic dynamical systems using error bounds on path-space observables by Joanna Zou, Han Cheng Lie, Youssef Marzouk (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-20467.txt.
Introduction
Zou and co-authors learn surrogate models for stochastic differential equations with a goal in mind. Cheap surrogates speed up simulation of costly systems. But standard loss functions give no error bounds for path based outputs. Mean first hitting times are one such output. The team derives a bound for these path-space observables. They use that bound as a new loss for learning the drift function. A Fréchet derivative formula makes the loss gradient tractable in practice.
Catalog record
| CREATOR | Joanna Zou, Han Cheng Lie, Youssef Marzouk |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 82759 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.20467
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Goal-oriented learning of stochastic dynamical systems using error bounds on path-space observables Joanna Zou, Han Cheng Lie, Youssef Marzouk Abstract The governing equations of stochastic dynamical systems often become cost-prohibitive for numerical simulation at large scales. Surrogate models of the governing equations, learned from data of the high-fidelity system, are routinely used to predict key observables with greater efficiency. However, standard choices of loss function for learning the surrogate model fail to provide error guarantees in path-dependent observables, such as reaction rates of molecular dynamical systems. This paper introduces an error bound for path-space observables and employs it as a novel variational loss for the goal-oriented learning of a stochastic dynamical system. We show the error bound holds for a broad class of observables, including mean first hitting times on unbounded time domains. We derive an analytical gradient of the goal-oriented loss function by leveraging the formula for Frechét derivatives of expected path functionals, which remains tractable for implementation in stochastic gradient descent schemes. We demonstrate that surrogate models of overdamped Langevin systems developed via goal-oriented learning achieve improved accuracy in predicting the statistics of a first hitting time observable and robustness to distributional shift in the data. keywords Stochastic differential equations, summary statistics, data-driven learning, information inequalities, molecular dynamics † † runningheads: Goal-oriented learning of stoch. dyn. sys. / J. Zou, H. C. Lie, Y. Marzouk MSC 60H10, 60H35, 94A15, 62M99 1 Introduction Stochastic differential equations (SDEs) serve as the governing equations of stochastic dynamical systems across scientific fields, but the drift function of the SDE often has a high cost of evaluation which can severely limit the scale of numerical simulation. In these settings, a surrogate model of the drift function is essential for accelerating simulations at scales relevant to key properties of the dynamical system. In this work, we introduce a novel objective function for learning a data-driven surrogate model of a stochastic dynamical system. Our objective controls the error in a chosen path-based statistic, such that the model is reliable for downstream tasks in multiscale simulation and property prediction. We use molecular dynamics as a motivating example, where ab initio quantum mechanical methods provide the highest fidelity representation of interatomic forces driving the microscopic dynamics of molecules. However, these methods remain cost-prohibitive for simulations of time scales beyond picoseconds or systems of a few hundred atoms [ 2 ] . Machine learning force fields address these limitations by learning statistical approximations of the interatomic forces, trained on quantum mechanical data, which enable accelerated simulations with near quantum-level fidelity [ 2 , 11 , 3 , 30 ] . These models facilitate the prediction of macroscopic properties of molecular systems, which take the form of statistical averages of functionals of the simulation path, referred to in this work as path-space observables . One example of such a property is the expected transition time between two metastable states of a molecular system, which is inversely proportional to the chemical reaction rate [ 23 ] . Reaction rates are key inputs to kinetic Monte Carlo, a coarse-graining approach which reduces molecular dynamics to a jump process driven by transition probabilities [ 44 ] . However, reaction rates are often challenging to quantify, particularly when few, if any, instances of the transition event are observed due to high computational costs of the interatomic force field. In such regimes, Monte Carlo estimators of the expected transition time, as used in transition path sampling and forward flux sampling, suffer from high variance [ 10 , 1 ] . Whereas machine learning force fields are often employed to accelerate simulations, error analysis of path-dependent, non-equilibrium properties of these models remains largely unexplored. Our aim is to learn a surrogate model of the force field of a stochastic dynamical system, corresponding to the drift function of the underlying SDE, which enables efficient and reliable prediction of a path-space observable such as an expected transition time. We introduce a learning objective that relies only on data of the drift function, the most widely available class of data in molecular dynamics applications, rather than reference data of the path-space observable itself, which is often noisy, inaccurate, or unavailable. The learning objective is goal-oriented in the sense that it targets the fidelity of a specific path-space observable of the stochastic dynamics. We show that this goal-oriented approach enjoys advantages over prototypical choices of objective function, which have limited or no provable guarantees on the fidelity of the path-space observable corresponding to the learned SDE. 1.1 Review of learning objectives for SDEs To draw comparison with the goal-oriented approach, we review common approaches to learning drift functions of first-order time-invariant SDEs, which can be classified by the nature of the available data and the corresponding learning objective. Consider the strong solution to an Itô SDE on m -dimensional state space, satisfying the stochastic integral equation X_{t}=X_{0}+\int_{0}^{t}b(X_{s})\textup{d}s+\int_{0}^{t}\sigma(X_{s})\textup{d}W_{s}\ , where b(x) and \sigma(x) denote the drift and diffusion, respectively, at x\in\mathbb{R}^{m} and W_{t} denotes standard m -dimensional Brownian motion. Let \tilde{b}(x;\theta)=\tilde{b}_{\theta}(x) be a surrogate of the drift function which belongs to a parametric model class indexed by \theta\in\Theta . The learning problem is to find a parameter \theta^{*}\in\Theta which minimizes a prescribed loss function \mathcal{L} , \theta^{*}\in\underset{\theta\in\Theta}{\text{argmin}}\ \mathcal{L}(\theta)\ . 1.1.1 Regression of the drift function In regression approaches, the goal is to match the surrogate drift function to the reference drift function in a pointwise sense, given a dataset of reference drift evaluations at a finite collection of states, e.g., \{X_{i},b(X_{i})\}_{i=1}^{N} . A standard choice of loss function is the mean squared error in drifts, also referred to as the “force matching” objective [ 3 , 30 ] , \mathcal{L}^{\textup{FM}}(\theta;b)\coloneqq\frac{1}{N}\sum^{N}_{i=1}\left\|b(X_{i})-\tilde{b}_{\theta}(X_{i})\right\|^{2}_{2}\,. (1) For stochastic dynamical systems where the drift function is the gradient of a potential energy function V , e.g., b(x)=-\nabla_{x}V(x) , then the surrogate drift function is typically modeled also as a gradient force, \tilde{b}_{\theta}(x)=-\nabla_{x}\tilde{V}_{\theta}(x) . Given data \{X_{i},V(X_{i})\}_{i=1}^{N} , one can then learn the surrogate drift function via regression of the potential energy function with the “energy matching” objective [ 3 , 30 ] , \mathcal{L}^{\textup{EM}}(\theta;V)\coloneqq\frac{1}{N}\sum^{N}_{i=1}\big|V(X_{i})-\tilde{V}_{\theta}(X_{i})\big|^{2}\,. (2) If V and \tilde{V}_{\theta} are identical up to an additive constant and differentiable everywhere on a domain, then their first derivatives are identical on the domain and the force error \frac{1}{N}\sum^{N}_{i=1}||\nabla_{x}V(X_{i})-\nabla_{x}\tilde{V}_{\theta}(X_{i})||^{2} is also minimized. 1.1.2 Minimization of discrepancy in probability measures In measure -centric approaches, a surrogate drift function is learned from a dataset of possibly unordered states whose distribution corresponds to a probability measure of the SDE. When the states are ordered, e.g., corresponding to a strong solution of the reference SDE, X=(X_{t})_{t\in[0,T]} , one approach is to maximize the likelihood of the trajectory by minimizing the negative log likelihood, where the corresponding loss function is \mathcal{L}^{\text{MLE}}(\theta;X)=-\sum_{t=0}^{T}\log p_{t}(X_{t}|X_{t-1}) for transition densities p_{t} [ 16 ] . The objective may also be expressed in terms of path measures, where the likelihood of the path is given by the Radon-Nikodym derivative of the law of the surrogate SDE, \tilde{\mathbb{P}}^{x}_{\theta} , with respect to the Wiener measure, \mathbb{W}^{x} [ 35 , 34 ] . The expected negative log likelihood evaluated at a set of paths with law \mathbb{P}^{x} is \mathcal{L}^{\textup{MLE}}(\theta;\mathbb{P}^{x})\coloneqq\mathbb{E}_{\mathbb{P}^{x}}\Bigg[-\log\bigg(\frac{\textup{d}\tilde{\mathbb{P}}^{x}_{\theta}}{\textup{d}\mathbb{W}^{x}}\bigg)\Bigg]=\mathbb{E}_{X\sim\mathbb{P}^{x}}\Bigg[\frac{1}{2}\int_{0}^{T}|\tilde{b}_{\theta}(X_{s})|^{2}\textup{d}s-\int_{0}^{T}\tilde{b}_{\theta}(X_{s})\textup{d}W_{s}\Bigg]\ . It is well known that the maximum likelihood objective coincides with minimizing