Artificial neural network solver for Fokker-Planck and Koopman eigenfunctions

Max Kreider, Peter J. Thomas, Yao Li · 2025

Read Artificial neural network solver for Fokker-Planck and Koopman eigenfunctions by Max Kreider, Peter J. Thomas, Yao Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-20339.txt.

Introduction

Max Kreider, Peter J. Thomas, and Yao Li build, in a 2025 paper, a neural network solver for the eigenfunctions of two linked operators in random systems. One operator tracks how a probability cloud drifts; its twin tracks how measured quantities evolve on average. Their eigenfunctions unlock the long-run behavior of noisy oscillators and like systems.

Direct math on these functions means solving hard equations in many dimensions over endless domains. The authors' data-driven solver bakes the operator into its own loss, which sharpens accuracy and cuts the need for vast clean training sets. Tests run in two, three, and four dimensions. The approach extends past work and may serve fields from cell biology to power grids, wherever random dynamics rule.

Catalog record

CREATORMax Kreider, Peter J. Thomas, Yao Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-20339

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Artificial neural network solver for Fokker-Planck and Koopman eigenfunctions Max Kreider, Peter J. Thomas, Yao Li Abstract For a stochastic differential equation (SDE) that is an Itô diffusion or Langevin equation, the Fokker-Planck operator governs the evolution of the probability density, while its adjoint, the infinitesimal generator of the stochastic Koopman operator, governs the evolution of system observables, in the mean. The eigenfunctions of these operators provide a powerful framework to analyze SDEs, and have shown to be particularly useful for systems of stochastic oscillators. However, computing these eigenfunctions typically requires solving high-dimensional PDEs on unbounded domains, which is numerically challenging. Building on previous work, we propose a data-driven artificial neural network solver for Koopman and Fokker-Planck eigenfunctions. Our approach incorporates the differential operator into the loss function, improving accuracy and reducing dependence on large amounts of accurate training data. We demonstrate our approach on several numerical examples in two, three, and four dimensions. keywords Stochastic Oscillators, Stochastic Koopman Operator, Artificial Neural Networks, Partial Differential Equations † † runningheads: ANN Koopman eigenfunction solver / M. Kreider, P. J. Thomas, and Y. Li MSC 60H10, 37M10, 65M75, 92C20, 47N40 1 Introduction Many physical and biological systems have some degree of noise or uncertainty, and are widely modeled as systems of stochastic differential equations. Traditionally, such systems have been characterized by studying the time-dependent and stationary probability densities associated with the underlying stochastic dynamics [ 13 , 14 , 43 ] . The Fokker-Planck operator describes the evolution of the probability density analytically. However, recent attention has focused on the infinitesimal generator of the stochastic Koopman operator (SKO) 1 1 1 For brevity, we will write “SKO” to mean the infinitesimal generator of the stochastic Koopman operator. as a complementary descriptor of stochastic processes. The SKO is adjoint to the Fokker-Planck operator, and describes the evolution of the expectation of system observables. Because the action of the SKO is linear on the space of \mathcal{C}^{2} -continuous system observables, the eigenspectrum of the SKO characterizes the original nonlinear, stochastic dynamics [ 9 ] . SKO approaches have gained significant traction in fluid dynamics [ 36 , 44 ] , control problems [ 26 , 39 ] , neuroscience [ 3 , 34 ] , and stochastic oscillators [ 29 , 40 , 41 , 51 ] . The space of system observables is infinite-dimensional, so obtaining finite dimensional approximations of the SKO is important for practical computations [ 6 ] . While traditional PDE solvers (finite differences, finite elements) are effective for low-dimensional problems, they lose effectiveness for high-dimensional problems (n\geq 3) . Non-trivial boundary conditions on unbounded domains can further complicate numerical implementation, as can the potential presence of continuous spectra [ 35 ] . While much effort has been devoted to overcome these challenges, solving high-dimensional Fokker-Planck and Koopman eigenvalue problems is still a challenging task. Machine learning is a powerful approach for solving high-dimensional PDEs and related eigenvalue problems. Some works have employed diffusion Monte Carlo methods [ 16 , 46 ] , deep Ritz methods [ 22 , 33 ] , physics-informed neural network (PINN) [ 42 , 49 ] , and BSDE methods [ 15 , 50 , 53 ] , among other approaches [ 1 , 2 , 17 , 54 ] . Recent work proposed a data-driven scheme that replaces boundary conditions by Monte Carlo simulation data when solving the Fokker-Planck equation [ 11 , 31 ] . This method was extended into an artificial neural network (ANN) approach, and was found to be effective for solving high-dimensional problems [ 57 ] . The idea behind the method is to train an ANN to approximate a probability density function that minimizes both (i) the distance to the Monte Carlo reference data, and (ii) the norm of the residual of the forward operator \mathcal{L} . Importantly, it was found that relatively inaccurate Monte Carlo approximations at only a small number of reference points were sufficient to guide the ANN to an accurate solution of the invariant distribution. We also refer to [ 7 ] for a PINN-based Fokker-Planck solver that uses a different regularization term based on Monte Carlo simulations. In this manuscript, we will extend previous results [ 31 , 57 ] to develop a novel ANN approach to solve for the low-lying eigenfunctions and eigenvalues of the SKO and Fokker-Planck operators associated with stochastic oscillators. Leveraging results from [ 51 ] , we use Monte Carlo approximations of the time-dependent probability densities to estimate the low-lying eigenvalues of a given system. Then, we obtain coarse approximations of the low-lying forward and Koopman eigenfunctions as solutions of a linear least squares problem. This Monte Carlo data for the eigenmodes serves as a reference in a loss function (as a replacement for the boundary conditions, which are not explicitly considered), which is minimized with an ANN, analogous to the approach considered in [ 57 ] . Our ANN approach is advantageous for several reasons. Existing ANN solvers for eigenfunction mainly use normalization to avoid converging to the trivial solution [ 16 , 23 ] . In comparison, our approach directly estimates the value of an eigenfunction at numerous collocation points in the domain, leading to both fast convergence and improved solution quality. Other methods, such as extended dynamic mode decomposition (EDMD) and variants, have recently gained traction as data-driven methods to approximate the low-lying spectrum of the SKO [ 4 , 5 , 8 , 37 , 27 , 55 ] . However, such methods rely on choosing a dictionary of functions; a poor choice of dictionary results in poor performance of the EDMD algorithm, and dictionaries which are too large often result in computational bottlenecks and ill-conditioned systems. In contrast, our novel ANN approach does not require a-priori system knowledge, nor a collection of dictionary functions. Instead, it requires only time-series data, making it more broadly applicable to a wide range of problems. Our ANN approach is also capable of simultaneously approximating several low-lying eigenfunctions of the Fokker-Planck and Koopman operators. Importantly, the user is free to define reference points in the domain at which solution values are required. This mesh-free approach is advantageous for solving high-dimensional problems because it requires relatively few reference points. The remainder of this work is organized in the following manner. We first describe necessary assumptions and mathematical preliminaries in § 2 . Then, we detail our ANN approach and numerical algorithms in § 3 , discuss error associated with the eigenfunction approximation in § 4 , and apply our technique to several examples in two, three, and four dimensions in § 5 . 2 Mathematical preliminaries We consider stochastic oscillators of the form d\mathbf{X}=\mathbf{f}(\mathbf{X})dt+\mathbf{g}(\mathbf{X})d\mathbf{W}(t) (1) with \mathbf{X}(t) a stochastic process taking values in a domain \Omega\subseteq\mathbb{R}^{n} , \mathbf{f}:\Omega\to\mathbb{R}^{n} a \mathcal{C}^{2} -continuous vector field, \mathbf{g} an n\times m matrix with \mathcal{C}^{2} -continuous entries such that \mathbf{g}\mathbf{g}^{T} is nonsingular for all \mathbf{x}\in\Omega , and d\mathbf{W}(t) an m\times 1 vector of increments of m independent Wiener process. We interpret ( 1 ) in the sense of Itô. We assume throughout that the time-dependent transition density of the Markov process \rho(\mathbf{y},t\>|\>\mathbf{x},s)=\lim_{|d\mathbf{y}|\to 0}\frac{\mathbb{P}\left(\mathbf{X}(t)\in[\mathbf{y},\mathbf{y}+d\mathbf{y})\>|\>\mathbf{X}(s)=\mathbf{x}\right)}{|d\mathbf{y}|} (2) exists for all t>s and for all \mathbf{x} and \mathbf{y} in

Read the complete text