Group-Convolutional Extended Dynamic Mode Decomposition
Hans Harder, Feliks Nüske, Friedrich M. Philipp, Manuel Schaller, Karl Worthmann, Sebastian Peitz · 2024
Read Group-Convolutional Extended Dynamic Mode Decomposition by Hans Harder, Feliks Nüske, Friedrich M. Philipp, Manuel Schaller, Karl Worthmann, Sebastian Peitz (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-00905.txt.
Description
Abstract This paper explores the integration of symmetries into the Koopman-operator framework for the analysis and efficient learning of equivariant dynamical systems using a group-convolutional approach. Approximating the Koopman operator by finite-dimensional surrogates, e.g., via extended dynamic mode decomposition (EDMD), is challenging for high-dimensional systems due to computational constraints.
Catalog record
| CREATOR | Hans Harder, Feliks Nüske, Friedrich M. Philipp, Manuel Schaller, Karl Worthmann, Sebastian Peitz |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 67 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2411-00905
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Group-Convolutional Extended Dynamic Mode Decomposition Hans Harder, Feliks Nüske, Friedrich M. Philipp, Manuel Schaller, Karl Worthmann, Sebastian Peitz Abstract This paper explores the integration of symmetries into the Koopman-operator framework for the analysis and efficient learning of equivariant dynamical systems using a group-convolutional approach. Approximating the Koopman operator by finite-dimensional surrogates, e.g., via extended dynamic mode decomposition (EDMD), is challenging for high-dimensional systems due to computational constraints. To tackle this problem with a particular focus on EDMD, we demonstrate—under suitable equivarance assumptions on the system and the observables—that the optimal EDMD matrix is equivariant. That is, its action on states can be described by group convolutions and the generalized Fourier transform. We show that this structural property has many advantages for equivariant systems, in particular, that it allows for data-efficient learning, fast predictions and fast eigenfunction approximations. We conduct numerical experiments on the Kuramoto–Sivashinsky equation and a λ \lambda - ω \omega spiraling wave system, both nonlinear partial differential equations, providing evidence of the effectiveness of this approach, and highlighting its potential for broader applications in dynamical systems analysis. Journal: Physica D 1 Introduction Dynamical systems are fundamental to the modeling of natural phenomena and engineering systems, which are often modeled by differential equations and describe, among others, mechanical systems, the diffusion of heat in a material, the propagation of sound waves in air, or the flow of fluids in pipes and oceans. These equations are indispensable in fields ranging from physics and engineering to finance and biology, making them key problem-solving tools. Linear systems are particularly appealing due to their well-understood properties and the powerful mathematical techniques available for their analysis, see, e.g., Trefethen and Bau (2022) . For example, one can characterize the behavior of these systems by analyzing their eigenvalues and eigenvectors or derive non-parametric representations using input-output data, see, e.g., Willems et al. (2005) ; Van Waarde et al. (2020) . In case of nonlinear dynamics, the Koopman operator, see Koopman (1931) ; Rowley et al. (2009) , provides a transformation into a linear framework by focusing on the evolution of observables—functions of the system state—rather than the state itself. This linearization can reveal underlying structures and long-term behavior. Still, there are only few systems for which the Koopman operator has a finite-dimensional representation, requiring an approximation by means of, e.g., extended dynamic mode decomposition (EDMD), see, e.g., the survey article Brunton et al. (2022) , the collection Mauroy et al. (2020) and the references therein. EDMD constructs a matrix that can contain too many entries for efficient computations. This can happen when the state dimension is already very large, as is usually the case for discretizations of partial differential equations (PDEs). To address this issue, one can often exploit system-inherent properties like, e.g., symmetries. Accordingly, symmetry-exploiting methods have become more popular in recent years, even beyond the scope of dynamical systems: For example, convolutional neural networks and more generally geometric deep-learning methods Bronstein et al. (2021) are designed to respect task-inherent equivariances. Constructing learning algorithms that respect these equivariances can increase performance and significantly alleviate requirements on training data, see, e.g., Masci et al. (2015) ; Cohen and Welling (2016) ; Bronstein et al. (2017) ; Atz et al. (2021) ; Bronstein et al. (2021) ; Harder et al. (2024) ; Dierkes et al. (2023) . The presence of symmetry can lead to a decomposition of the EDMD matrix into simpler, more tractable components. It appears that hitherto proposed symmetry-based methods can be split into two categories: Some methods enforce block-wise diagonal structures in the EDMD matrix, see Sinha et al. (2020) ; Peitz et al. (2024) , and some methods enforce diagonal structures in Fourier space. Our contribution falls into the latter category and is related to the works of Salova et al. (2019) ; Baddoo et al. (2023) ; Hochrainer and Kar (2024) ; Kutz et al. (2018) . Here, the work of Salova et al. (2019) provides a more general group-theoretic treatment and, among other things, discusses the importance of choosing appropriate symmetry-respecting observables. Another focus is on efficient methods for translation-equivariant dynamical systems, see Baddoo et al. (2023) ; Hochrainer and Kar (2024) (the work of Baddoo et al. (2023) also considers different aspects, but their proposed method for translational equivariance is most relevant for our purposes). In particular, both Baddoo et al. (2023) and Hochrainer and Kar (2024) discuss how the EDMD matrix can be forced to be (block-)diagonal in Fourier space for PDEs. Finally, Kutz et al. (2018) points out the relationship between linearizing transformations such as the Cole-Hopf transform on the one hand and appropriate choices of observables on the other, in conjunction with the Fourier transform. Contributions and organization Our approach extends and generalizes these developments into multiple directions: Firstly, we assume a more general group-theoretic setting. In this regard, we show how one can enforce an equivariant structure in the EDMD matrix and demonstrate that this approach is optimal under suitable assumptions on the system dynamics, the observables and the sampling distribution. Crucially, this approach does not construct the EDMD matrix explicitly, but represents it implicitly by means of a convolution kernel. Making use of the generalized Fourier transform, we can then compute its eigenvalues and eigenvectors, and gain a significant computational advantage. To this end, we provide an introduction to the Koopman operator and its approximation via EDMD ( Section 2 ), followed by a discussion of basic group-theoretic aspects ( Sections 2.1 and 2.3 ). Section 3 contains the main contributions of this work: On the one hand, assuming an appropriate choice of the sampling distribution and the observables, we show that equivariance is inherited by the EDMD matrix and that it can be represented by a group convolution ( Theorem 3.1 ). On the other hand, we show how one can conveniently learn the corresponding convolution kernel in Fourier space using the generalized Fourier transform. And finally, we conduct experiments by means of the two-dimensional Kuramoto–Sivashinsky equation to demonstrate the advantages of our proposed group-convolutional approach in the low-data regime (see Section 3.1 ). Notation We will frequently require sets of the form \mathbb{C}^{\mathcal{I}} , \mathbb{C}^{\mathcal{I}\times\mathcal{J}} , \mathbb{C}^{\mathcal{I}\times\mathcal{J}\times\mathcal{D}} , etc., where \mathcal{I} , \mathcal{J} and \mathcal{D} are finite sets. The intention is to think of the elements in \mathbb{C}^{\mathcal{I}} as vectors instead of functions, similarly we think of elements in \mathbb{C}^{\mathcal{I}\times\mathcal{J}} as matrices. The individual entries of A\in\mathbb{C}^{\mathcal{I}\times\mathcal{J}} are denoted by A_{i,j} for (i,j)\in\mathcal{I}\times\mathcal{J} . Vector-vector or matrix-vector products are defined accordingly. The main advantage is that this simplifies indexing: For example, if \mathcal{J}=\mathcal{J}_{1}\times\mathcal{J}_{2} , we can easily define the matrix-vector product of A\in\mathbb{C}^{\mathcal{I}\times\mathcal{J}} with x\in\mathbb{C}^{\mathcal{J}} by Ax\in\mathbb{C}^{\mathcal{I}} , (Ax)_{i}=\sum_{(j_{1},j_{2})\in\mathcal{J}}A_{i,(j_{1},j_{2})}x_{j_{1},j_{2}} . Throughout this text, we denote random variables in boldface, e.g., \bm{y},\bm{u},\bm{u}^{+} . Given a probability space (\mathcal{Y},\Sigma,P) with \bm{y}\sim P and some measurable function f:\mathcal{Y}\rightarrow\mathbb{R} , the expected value is defined as \mathbb{E}[f(\bm{y})]\coloneqq\int f(y)P(dy) . Code and resources The code for our experiments in Section 3.1 and some supplementary material for Example 2.7 can be found on GitHub, https://github.com/graps1/convolutional-edmd . For the case of Example 2.7 , our codebase contains an implementation that models the system dynamics using a group-convolutional approach. For the experiments on the Kuramoto-Sivashinsky equation in Section 3.1 ,