Physics-informed machine learning for reconstruction of dynamical systems with invariant measure score matching
Yongsheng Chen, Suddhasattwa Das, Wei Guo, Xinghui Zhong · 2026
Read Physics-informed machine learning for reconstruction of dynamical systems with invariant measure score matching by Yongsheng Chen, Suddhasattwa Das, Wei Guo, Xinghui Zhong (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-12675.txt.
Introduction
Yongsheng Chen, Suddhasattwa Das, Wei Guo, and Xinghui Zhong rebuild dynamical systems from raw point cloud data. The data are unlabeled, but they capture the invariant measure of the system. That measure says where the system spends its time in the long run. Its density obeys the steady state Fokker Planck equation, a known physical law.
The team build a mesh free framework that joins physics informed neural networks with score matching. The physics law guides the network, while score matching fits the density shape. Rebuilding a system from its long run footprint is a hard inverse problem. A method that needs no labels and no mesh could serve many fields. Climate, fluids, and biology all produce such point cloud data.
Catalog record
| CREATOR | Yongsheng Chen, Suddhasattwa Das, Wei Guo, Xinghui Zhong |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 78 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-12675
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Physics-informed machine learning for reconstruction of dynamical systems with invariant measure score matching Yongsheng Chen, Suddhasattwa Das, Wei Guo, Xinghui Zhong Abstract In this paper, we develop a novel mesh-free framework, termed physics‑informed neural networks with invariant measure score matching (PINN‑IMSM), for reconstructing dynamical systems from unlabeled point‑cloud data that captures the system’s invariant measure. The invariant density satisfies the steady-state Fokker-Planck (FP) equation. We reformulate this equation in terms of its score function (the gradient of the log-density), which is estimated directly from data via denoising score matching, thereby bypassing explicit density estimation. This learned score is then embedded into a physics‑informed neural network (PINN) to reconstruct the drift velocity field under the resulting score-based FP equation. The mesh‑free nature of PINN allows the framework to scale efficiently to higher dimensions, avoiding the curse of dimensionality inherent in mesh‑based methods. To address the ill-posed nature of high-dimensional inverse problems, we further recast the problem as a PDE‑constrained optimization that seeks the minimal‑energy velocity field. Under suitable conditions, we prove that this problem admits a unique solution that depends continuously on the score function. The constrained formulation is solved using a stochastic augmented Lagrangian method. Numerical experiments on representative dynamical systems, including the Van der Pol oscillator, an active swimmer in an anharmonic trap, chaotic Lorenz-63 and Lorenz-96 systems, demonstrate that PINN-IMSM accurately recovers invariant measures and reconstructs faithful dynamical behavior, successfully handling problems in up to five dimensions. Keywords: Dynamical system learning, invariant measure, score matching, physics-informed neural networks (PINNs). 1 Introduction Reconstructing dynamical systems from observational data is a fundamental task across science and engineering, central to understanding and predicting complex phenomena from chaotic attractors and turbulent flows to pattern formation and neural activity. The problem involves finding a mathematical model, often parameterized in a trainable manner, such that its simulated behavior aligns with the observed data. Recent data-driven machine learning approaches have significantly advanced this field, providing flexible frameworks for systems with incomplete or noisy observations. Neural ordinary differential equations (ODEs) [ 8 , 46 , 37 , 36 ] and sparse identification of nonlinear dynamics (SINDy) [ 7 , 43 , 17 ] have proven effective for dynamical system identification. However, these methods adopt a Lagrangian perspective and rely heavily on accurate trajectory data to estimate derivatives, limiting their applicability when temporal information is sparse or unavailable. A scenario for recovering unknown dynamical systems from data with missing time labels was considered in [ 64 ] , where the data are assumed to lie on a one-dimensional manifold. Their method minimizes the sliced-Wasserstein distance between samples generated by neural ODEs and training data, employing a trajectory segmentation technique to facilitate training. Nevertheless, the approach remains Lagrangian and is limited to lower-dimensional manifolds. In this paper, we focus on the scenario where observational data are provided as a point cloud consisting of samples from an underlying dynamical system, but lack reliable temporal labels due to slow or unrecorded sampling. Such data frequently appear in fields including molecular dynamics, biology, healthcare, medical research, and numerical weather prediction. For dynamical systems, the distribution of states converges over time to a time‑independent limit known as invariant measure . The observational data, though devoid of explicit timing, provides an empirical approximation of this invariant measure, which in turn encodes key information about the system’s dynamic law. Classical Lagrangian methods, which rely on time‑labeled trajectories to estimate derivatives, are ineffective in this label‑deficient setting. To address the challenge, an Eulerian approach has been developed in [ 61 , 5 ] to learn the dynamics from such data. This approach formulates the reconstruction as a partial differential equation (PDE) inverse problem, which infers the unknown velocity field directly from data by imposing the steady‑state Fokker–Planck (FP) equation as a physical constraint, thereby circumventing the need for time‑labeled trajectories. The method proceeds in three steps. First, the invariant density is approximated empirically by binning the data into a histogram \rho^{\star} . This invariant density is known to satisfy the steady-state FP equation. Second, a finite volume scheme is employed to compute the solution \rho(v(\theta)) of the FP equation, for a velocity field v(\theta) , which is parameterized by a neural network with trainable parameters \theta . Third, v(\theta) is optimized using a gradient-based method to minimize the loss function \mathcal{J}(\theta):=\mathcal{D}(\rho(v(\theta)),\rho^{\star}) , where \mathcal{D} denotes a metric or divergence between probability measures. This framework has been validated on several benchmark examples. However, because it relies on a mesh-based PDE solver, it suffers from the curse of the dimensionality and is practically limited to problems of low dimensions (d\leq 3) . The practical scalability of the aforementioned mesh‑based Eulerian method is limited by their reliance on mesh-based discretization and the need to repeatedly solve the governing PDE, which becomes computationally prohibitive in higher dimensions. This limitation has motivated the development of mesh-free learning paradigms that encode the governing PDE structure directly directly within neural network parameterizations while maintaining differentiability for gradient-based optimization. Physics-informed neural networks (PINNs) [ 49 , 30 , 60 , 27 , 56 ] provide one such framework by embedding the equations as soft or hard constraints in the training loss, enabling parameter/field identification without an explicit mesh-based PDE solver. Another direction is to use deep operator networks, such as DeepONet [ 40 ] , Fourier neural operators [ 34 ] , and graph neural operators [ 1 ] , which learn mappings between function spaces to recover unknown parameters from observational data. While powerful, these operator methods typically demand large volumes of high‑quality training data [ 11 , 58 ] . Recent works that incorporate PDE constraints into such operator‑learning frameworks, aim to reduce data requirements and enhance generalization capabilities [ 35 , 51 ] . Motivated by the limitations of existing methods, we propose a novel mesh-free framework termed PINN with invariant measure score matching (PINN-IMSM), designed to reconstruct dynamical systems from data without explicit temporal labels. A key step is to reformulate the stationary FP equation in terms of the score function, i.e., the gradient of the log-density of the invariant measure, yielding a score‑based stationary FP equation. PINN‑IMSM first uses denoising score matching [ 26 , 55 ] to learn this score function directly from unlabeled observational data, avoiding explicit density estimation. The learned score is subsequently embedded into a PINN to reconstruct the underlying velocity field by enforcing the physics constraint derived from the score-based FP equation. To overcome the ill-posedness challenge in the standard PINN approach, we further formulate the reconstruction as a PDE‑constrained optimization problem, seeking the minimal‑energy velocity field that satisfies the FP equation. We prove that, under suitable conditions, this PDE-constrained optimization problem admits a unique solution, and that the solution is continuous with respect to the score function. This constrained formulation is solved efficiently via the stochastic augmented Lagrangian method [ 12 ] . Numerical experiments demonstrate that the proposed PINN-IMSM method achieves accurate and stable reconstruction of dynamical systems from observational data, successfully handling problems in dimensions up to five, thereby significantly surpassing the scalability of existing mesh-based and trajectory-based methods. The remainder of this paper is organized as follows. In Section 2 , we introduce background on stochastic differential equations, invariant