A CFL-type Condition and Theoretical Insights for Discrete-Time Sparse Full-Order Model Inference

Leonidas Gkimisis, Süleyman Yıldız, Peter Benner, Thomas Richter · 2025

Read A CFL-type Condition and Theoretical Insights for Discrete-Time Sparse Full-Order Model Inference by Leonidas Gkimisis, Süleyman Yıldız, Peter Benner, Thomas Richter (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-01244.txt.

Introduction

Leonidas Gkimisis and three co-authors set rules for learning dynamical systems from data safely. Their paper came out in two thousand twenty-five. The method infers a sparse full-order model from snapshots of a system's motion. A least squares fit does the learning, with regularization to keep it tame. The authors probe when the learned model stays stable. Bad data spacing can make it blow up.

For linear advection they derive a sampling condition much like the classic CFL rule. It bounds the ratio of space and time steps in the training data. Simple one-dimensional diffusion and advection cases show the theory at work. Two harder nonlinear cases in two dimensions come next. The results guide how to gather data for model learning. Stability can be planned for, not just hoped for.

Catalog record

CREATORLeonidas Gkimisis, Süleyman Yıldız, Peter Benner, Thomas Richter
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-01244

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A CFL-type Condition and Theoretical Insights for Discrete-Time Sparse Full-Order Model Inference Leonidas Gkimisis, Süleyman Yıldız, Peter Benner, Thomas Richter Abstract In this work, we investigate the data-driven inference of a discrete-time dynamical system via a sparse Full-Order Model (sFOM). We first formulate the involved Least Squares (LS) problem and discuss the need for regularization, indicating a connection between the typically employed l 2 l_{2} regularization and the stability of the inferred discrete-time sFOM. We then provide theoretical insights considering the consistency and stability properties of the inferred numerical schemes that form the sFOM and exemplify them via illustrative, 1D test cases of linear diffusion and linear advection. For linear advection, we analytically derive a “sampling CFL” condition, which dictates a bound for the ratio of spatial and temporal discretization steps in the training data that ensures stability of the inferred sFOM. Finally, we investigate the sFOM inference for two nonlinear problems, namely a 2D Burgers’ test case and the incompressible flow in an oscillating lid-driven cavity, and draw connections between the theoretical findings and the properties of the inferred, nonlinear sFOMs. \novelty sparse FOM inference for dynamical systems in discrete time. Theoretical insights on the analytical solution of the sparse FOM least-squares problem. Established connection between the stability of sparse FOM and the l_{2} regularization of the least-squares problem. 1 Introduction Physics-informed data-driven methods have emerged over the last few decades as a powerful tool for inference of system dynamics in physics and engineering. Leveraging physical knowledge in data-driven modeling enhances successful and robust predictions, while significantly restricting the solution space of the inference task. In this paper we focus on sFOM inference for discrete-time systems and present theoretical findings on consistency and stability, of infered models. We investigate these properties via linear and nonlinear numerical test cases. The availability of high resolution numerical and experimental data due to the significant advancements in hardware and software, in parallel with the recent developments in linear algebra and machine learning methodologies, render data science as a key subject for tasks of system modeling, optimization and control. Data-driven methods have the potential to complement numerical solvers for such applications, resulting in significant time and resource savings. The simultaneous usage of numerical simulations, experimental data and data-driven methods is central for the concept of digital twins [ 11 , 17 , 24 ] . The computational copy of a critical engineering system is continuously updated by the assimilation of numerical or experimental data, thus driving real-time control and design decisions. Such applications motivate the development of data-driven methods for dynamical systems, where the behaviour of the system is predicted using numerical or experimental data. From the multitude of the available data-driven methods for dynamical systems [ 7 ] , we focus on approaches of physics-informed machine learning. These methods incorporate considerations on the underlying physics of dynamical systems and thus enable tailored data-driven solutions [ 19 ] . Developed approaches differ in terms of the assumed data availability and the degree to which system physics are a priori known [ 25 , 29 , 8 , 18 , 33 , 30 , 22 , 31 , 20 , 9 ] . In the research direction of [ 18 , 22 ] , derivation of state-space models is performed from input-output frequency response measurements. Assuming access to state measurements, [ 31 , 25 ] infer reduced-order models (ROMs) based on an a priori known physics-informed model structure, while [ 8 , 30 , 9 ] derive the model structure from candidate analytical functions. In [ 33 , 20 ] , the inference of sparse models on the full-order level is studied through the utilization of a physics-informed model structure. The latter method aims to infer numerical schemes with the use of state training data, which can then be used to construct sparse Full-Order Models (sFOMs) that can predict the system dynamics under different parameter values, initial or boundary conditions from those used during training [ 33 ] . A potential advantage of this approach is the reduced dependence on the span of the training data snapshot matrix, compared to projection-based methods [ 13 ] . In parallel, intrusive projection techniques, such as Proper Orthogonal Decomposition (POD), can be readily used to derive first-learn-then-project non-intrusive ROMs [ 15 , 14 , 28 ] . Nonetheless, inference on the full-order level inevitably introduces issues of stability [ 27 , 33 , 13 ] and entails a significant offline and online computational cost [ 13 ] . In this study, we investigate the properties of sFOM inference for discrete-time systems and provide theoretical findings which highlight its potential and limitations. We first establish the connection between the l_{2} regularization and the stability of the inferred sFOM, following the argumentation in [ 13 ] . We derive a closed-form solution for the non-regularized LS problem and analyze its properties for 1D, linear diffusion. Performing a Taylor approximation of the closed-form solution, we also indicate a link between the training discretization in space and time, and the resulting sFOM stability, which we entitle “sampling CFL” condition. Similar sampling limitations have been discussed for other data-driven methods [ 35 ] , while the trade-off between spatial and temporal discretization was hinted in [ 2 ] for sparse FOM inference. We validate this theoretical finding with numerical results for 1D linear advection. Finally, we test sFOM inference for two nonlinear test cases, namely a 2D Burgers’ example and an oscillating-lid driven cavity example. The properties of the nonlinear sFOMs are extensively discussed, in connection with the presented theoretical findings. The remainder of this paper is organized as follows; In Section 2 , we introduce the sFOM inference problem formulation and present the employed regularization strategies. In Section 3 , we provide theoretical insights on the sFOM inference, which are validated with numerical results on 1D linear advection and diffusion examples. In Section 4 , we showcase the capabilities and limitations of sFOM inference for two 2D nonlinear test cases and in Section 5 , we discuss potential future research directions and make concluding remarks. 2 Adjacency-based Sparsity In this section, we formulate the basic problem linked to sparse FOM inference. The motivation behind this approach lies in the sparse structure of the discretized, differential operators, which is of spatially-localized nature for a wide range of physical systems [ 2 ] . Given a computational mesh and corresponding adjacency information, the sparse structure of the underlying PDEs is a priori known or can be approximated. In a data-driven context, exploiting adjacency-based sparsity allows to locally identify the involved operators [ 33 , 20 , 26 ] , thus enabling inference on the full-order level, via the storage and computation of a sparse FOM (sFOM). 2.1 Problem Formulation We formulate the problem in line with the notation used in [ 32 ] . We focus on PDEs of the form \frac{\partial u}{\partial t}=\mathcal{P}(u,u_{x},u_{y},u_{z},u_{xx},u_{yy},u_{zz}...). (1) where \mathcal{P}(.) is a polynomial operator. We thus assume that \mathcal{P}(.) consists of monomials of u,u_{x},u_{y},u_{z}, u_{xx},u_{yy},u_{zz},\dots . We examine \mathcal{P}(.) after discretizing the continuous PDE ( 1 ) in space with a given numerical scheme that has local support. This results in a system of n coupled ODEs.

Read the complete text