Blending data and physics for reduced-order modeling of systems with spatiotemporal chaotic dynamics

Alex Guo, Michael D. Graham · 2025

Read Blending data and physics for reduced-order modeling of systems with spatiotemporal chaotic dynamics by Alex Guo, Michael D. Graham (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-21299.txt.

Introduction

Alex Guo and Michael Graham blend data with physics to model chaotic systems cheaply. Their twenty twenty-five paper builds hybrid reduced-order models. Full simulations of chaotic flows are costly to run repeatedly. Pure data models can drift away from real behaviour over time.

An autoencoder first finds a low-dimensional surface for the dynamics. The known physics model is projected onto that surface. Data then either corrects the physics flow or updates it as prior knowledge. Tests used two classic chaotic equations with rich patterns. Hybrid models beat data-only models in every data setting tried. They even helped when the physics model had wrong settings. Forecasters gain accuracy without paying for full simulations.

Catalog record

CREATORAlex Guo, Michael D. Graham
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE72 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-21299

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Blending data and physics for reduced-order modeling of systems with spatiotemporal chaotic dynamics Alex Guo, Michael D. Graham Abstract While data-driven techniques are powerful tools for reduced-order modeling of systems with chaotic dynamics, great potential remains for leveraging known physics (i.e. a full-order model (FOM)) to improve predictive capability. We develop a hybrid reduced order model (ROM), informed by both data and FOM, for evolving spatiotemporal chaotic dynamics on an invariant manifold whose coordinates are found using an autoencoder. This approach projects the vector field of the FOM onto the invariant manifold; then, this physics-derived vector field is either corrected using dynamic data, or used as a Bayesian prior that is updated with data. In both cases, the neural ordinary differential equation approach is used. We consider simulated data from the Kuramoto–Sivashinsky and complex Ginzburg–Landau equations. Relative to the data-only approach, for scenarios of abundant data, scarce data, and even an incorrect FOM (i.e. erroneous parameter values), the hybrid approach yields substantially improved time-series predictions. I Introduction The ability to efficiently and accurately forecast complex systems is highly sought after in engineering applications. Sometimes we know the physics (i.e. we have an exact “full-order model” (FOM)) of these systems and can perform simulations by discretizing and solving the governing equations. However, directly solving the FOM can be computationally prohibitive for systems exhibiting multiscale, spatiotemporal chaos, especially when many solutions must be found, as is typical for tasks such as design and control. Here, we are interested in developing high-fidelity, computationally efficient reduced-order models (ROMs) of the long-time dynamics of systems with complex spatiotemporal chaotic behavior. In this work, we combine data-driven methods with a physics-based FOM method to develop a hybrid ROM for forecasting spatiotemporally chaotic systems, demonstrating that even an approximate FOM can substantially enhance predictive performance relative to an approach using only data. Perhaps the simplest approach for hybrid data-physics ROMs for systems governed by partial differential equations, is the “proper orthogonal decomposition (POD)-Galerkin” method [ 1 ] . POD, also known as principal component analysis (PCA), uses data to discover an orthogonal basis ordered by variance (energy in the case of fluid flow): I.e. the first basis vector points in the direction of maximal variance in the data set, and so on. In POD-Galerkin, the governing equations are projected onto a subset of the POD basis, yielding evolution equations for the POD amplitudes. This approach has been applied to the Navier-Stokes equations in an effort to develop low-dimensional models of turbulent flows [ 1 , 2 , 3 ] . A significant limitation of POD-Galerkin is that it implicitly takes the data to lie on a linear subspace of the full state space (i.e. a flat manifold), which is not generally a good assumption, and may lead to a very large number of POD modes being required to yield good performance. Nevertheless, while data from a high-dimensional system such as the Navier-Stokes Equations (NSE) may not lie in a linear subspace, because of energy dissipation, it is expected at long times to lie on a finite-dimensional invariant manifold [ 4 , 5 ] . For finding a nonlinear coordinate transformation to an invariant manifold, one can use an undercomplete autoencoder (AE) [ 6 , 7 ] . An AE uses a feedforward neural network to map data from the state space to a low-dimensional latent space, and another neural network for the reverse mapping. AEs have been used to reduce dimension in turbulent flows [ 8 , 9 , 10 ] and other chaotic partial differential equation (PDE) systems [ 11 , 12 ] . For the second step of learning the dynamics on the manifold coordinates, one can use the neural ordinary differential equations (NODEs) [ 13 ] method. Using the time-dependent data, a NODE learns the vector field (RHS) of the dynamical system governing the data as a neural network. The latent space coordinates found using an AE can also be forecasted with recurrent neural networks (RNNs), as demonstrated in [ 14 , 15 ] ); more general approaches for reduced-order, dynamical modeling can be found in [ 16 , 17 , 18 ] . We denote the approach of using a NODE to time-evolve the low-dimensional latent space given by an AE as “data-driven manifold dynamics” (DManD) [ 19 ] . Altogether, DManD is a purely data-driven ROM. DManD has been previously used for reduced-order modeling of several chaotic dynamical systems [ 20 , 21 , 22 , 23 , 24 , 25 , 26 , 27 , 28 , 29 ] . Incorporating symmetries in DManD substantially aids in training efficiency and predictive performance [ 30 , 31 , 32 ] . Linot and Graham [ 33 ] found that with fewer than 20 degrees of freedom, a DManD model of weakly turbulent plane Couette flow quantitatively captured key features of the flow that required 1000 degrees of freedom in a POD-Galerkin approach, despite the DManD approach having no information about the underlying governing equations. The present work illustrates how to augment DManD with a FOM. Dimension reduction aside, a widely used method for combining physics and machine learning for learning solutions to PDEs is physics-informed neural networks (PINNs) [ 34 , 35 ] . PINNs use a physics-based loss term that penalizes the residual of the PDE at collocation points to learn PDE solutions that are physically consistent. While PINNs may also include a supervised loss on the initial and boundary conditions from data measurements, the solution is mostly influenced by the purely physics-based loss — therefore, PINNs are often regarded as ODE or PDE solvers that are not data-driven. Nonetheless, the use of a PINN-like loss term in data-driven frameworks is quite common. One example is in physics-informed deep learning [ 36 ] , where the data-driven loss is placed on points outside of the initial and boundary conditions. In [ 37 , 38 ] , a PINN-like loss term is used with neural operators [ 39 , 40 ] , which are data-driven techniques for learning PDE solution operators. For the most part, PINNs are not designed to produce accurate solutions outside the time horizon of the collocation points used in training, though some work [ 41 ] has been done to address this issue. By contrast, predicting forward in time over an arbitrarily long horizon is the central topic of the present work. Because PINNs are not necessarily data-driven, not reduced-order, and not designed for time-series prediction, we do not consider this approach further. We now arrive at the physics-based method on which our hybrid ROM described later is based. This method is called Manifold Galerkin (MG) [ 12 ] . MG is an accurate FOM-based method that nonlinearly projects the governing equations onto a manifold learned from data in the form of an autoencoder. That is, Manifold Galerkin is similar to POD-Galerkin, just with a nonlinear rather than linear coordinate transformation to a lower-dimensional manifold. Although the MG model provides the vector field in a reduced-dimensional space (which can then be time-integrated for trajectory predictions), it is often more expensive to integrate than the FOM because the vector field must still be evaluated in the original high-dimensional state

Read the complete text