Kernel Methods for the Approximation of the Eigenfunctions of the Koopman Operator
Jonghyeon Lee, Boumediene Hamzi, Boya Hou, Houman Owhadi, Gabriele Santin, Umesh Vaidya · 2024
Read Kernel Methods for the Approximation of the Eigenfunctions of the Koopman Operator by Jonghyeon Lee, Boumediene Hamzi, Boya Hou, Houman Owhadi, Gabriele Santin, Umesh Vaidya (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-16588.txt.
Introduction
Six researchers offer a new math method in a 2024 paper on the Koopman operator, a tool that treats curved motion as if it were straight. The main shapes of that operator show how a system acts near a resting point. Past ways to find those shapes often gave false results.
The team splits each main shape into a straight part and a curved part. The straight part comes from the system at rest, and the curved part comes from solving an equation with kernel methods. Their way skips the need to build the full operator first. Tests on sample systems show the method works well in practice.
Catalog record
| CREATOR | Jonghyeon Lee, Boumediene Hamzi, Boya Hou, Houman Owhadi, Gabriele Santin, Umesh Vaidya |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-16588
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Kernel Methods for the Approximation of the Eigenfunctions of the Koopman Operator Jonghyeon Lee, Boumediene Hamzi, Boya Hou, Houman Owhadi, Gabriele Santin, Umesh Vaidya Abstract The Koopman operator provides a linear framework to study nonlinear dynamical systems. Its spectra offer valuable insights into system dynamics, but the operator can exhibit both discrete and continuous spectra, complicating direct computations. In this paper, we introduce a kernel-based method to construct the principal eigenfunctions of the Koopman operator without explicitly computing the operator itself. These principal eigenfunctions are associated with the equilibrium dynamics, and their eigenvalues match those of the linearization of the nonlinear system at the equilibrium point. We exploit the structure of the principal eigenfunctions by decomposing them into linear and nonlinear components. The linear part corresponds to the left eigenvector of the system’s linearization at the equilibrium, while the nonlinear part is obtained by solving a partial differential equation (PDE) using kernel methods. Our approach avoids common issues such as spectral pollution and spurious eigenvalues, which can arise in previous methods. We demonstrate the effectiveness of our algorithm through numerical examples. 1 Introduction Time series data, which are ubiquitous in various scientific domains, have driven the development of a wide range of statistical and machine learning forecasting methods [ 1 , 2 , 3 , 4 , 5 , 6 , 7 , 8 , 9 , 10 , 11 , 12 , 13 , 14 , 15 , 16 , 17 , 18 ] . Dynamical systems theory provides tools to understand the underlying rules governing the evolution of time series data. Originating with the work by Koopman [ 19 ] , Koopman operator theory provides a linear lens to study nonlinear dynamical systems. In particular, the Koopman operator maps the nonlinear evolution of finite-dimensional state space to an infinite-dimensional but linear description of functions. Following the seminal work [ 20 ] , there is a surge in interest in using the Koopman operator to study dynamical systems. As a linear operator, the spectral of the Koopman operator is rich in information and plays a significant role in various analysis and synthesis problems. For example, the principal eigenfunctions reveal the state space geometry as the joint zero-level curves characterize the stable and unstable manifolds of the equilibrium points [ 21 , 22 ] . In [ 23 ] , the principal eigenfunctions are used to identify the stability boundary, thereby determining the domain of attraction of an equilibrium point. Furthermore, the solution to the optimal control problem can also be constructed using the principal eigenfunctions of the Koopman operator, per [ 24 , 25 ] . In [ 26 ] , the authors proposed a path-integral formula for the computation of Koopman principal eigenfunctions. Yet in general, the Koopman operator can have both discrete and continuous spectra [ 20 ] , making the computation challenging. In addition, approximating the spectra of an infinite-dimensional operator via a finite-dimensional matrix can suffer from ”spectral pollution” [ 27 ] . In this paper, we aim to develop a numerical method to construct the principal eigenfunction of the Koopman operator directly from data that circumvents these difficulties. Numerical methods such as extended dynamic mode decomposition (EDMD) [ 28 ] aim to approximate the infinite-dimensional Koopman operator via its actions on the finite-dimensional space spaced by a set of pre-selected functions. Recent research has also explored the combination of kernel methods and Koopman operator theory [ 29 , 30 , 31 , 32 , 33 , 34 ] . Building upon the theory of reproducing kernel Hilbert spaces (RKHS) [ 35 ] , kernel-based methods offer considerable advantages in regularization, guaranteed convergence, automatization, and interpretability [ 36 , 37 , 38 , 39 ] , and have notably strengthened the mathematical basis for analyzing dynamical systems [ 3 , 40 , 41 , 42 , 43 , 44 , 45 , 29 , 46 , 47 , 48 , 49 , 50 , 51 , 52 , 53 , 54 , 55 , 56 ] as well as surrogate modeling [ 57 ] . In this paper, we explore the use of kernel methods for the computation of spectral properties of the Koopman operator. The advantage of using kernel methods in this context is that they provide with error estimates that make the method more rigorous. The existing literature on kernel-based Koopman learning, e.g. [ 29 , 33 ] , requires constructing a Koopman operator from data first. The spectra are then computed from the learned Koopman operator. Yet the spurious eigenvalues [ 58 ] can arise due to numerical artifacts, noise, or overfitting in the computation. These spurious eigenvalues do not represent genuine modes of the underlying dynamics and are misleading when analyzing the system’s behavior. To deal with this challenge, we aim to directly learn the spectrum of the Koopman operator without computing the Koopman operator itself by solving a partial differential equation (PDE) in RKHS. Specifically, following [ 26 ] , we associate the principal eigenfunctions of the Koopman operator with an equilibrium point with the corresponding eigenvalues being the same as that of the linearization of the nonlinear system at said equilibrium point. The linear parts of the principal eigenfunction correspond to the eigenvector of local linearization at the origin, while the nonlinear part of the eigenfunction is the solution of PDEs, which can be solved in RKHS. Unlike [ 59 ] that learns eigenfunctions of the Koopman operator in RKHS, the decomposition into linear and nonlinear parts allows us to incorporate knowledge from the linearization of system dynamics, and exploit the possible nonlinear structure of RKHS. The remainder of this paper is organized as follows: In Section 2, we provide background on the Koopman operator and its eigenfunctions. In Section 3, we discuss kernel methods and their application to solving the PDE satisfied by the Koopman eigenfunctions. Section 4 presents error estimates for our method, and in Section 5, we showcase numerical experiments. 2 Preliminaries on the Koopman Operator 2.1 Koopman Operator and its Spectrum In this section, we provide a brief overview of the spectral theory of the Koopman operator. We refer the reader to [ 60 , 61 ] for more details. Consider the dynamical system \displaystyle\dot{x}={f}(x), (1) defined on a state space {\cal Z}\subseteq{\mathbb{R}}^{p} . The vector field {\mathbf{f}} is assumed to be smooth function. Let {\cal F}\subseteq{\cal C}^{0} be the function space of observable \psi:{\cal Z}\to{\mathbb{C}} . We have following definitions for the Koopman operator and its spectrum. Definition 1 (Koopman Operator) . The family of Koopman operators \mathbb{U}_{t}:{\cal F}\to{\cal F} corresponding to ( 1 ) is defined as \displaystyle[\mathbb{U}_{t}\psi](x)=\psi(s_{t}(x)). (2) where s_{t}(x) is the solution of the dynamical system ( 1 ). If in addition \psi is continuously differentiable, then \varphi(x,t):=[{\mathbb{U}}_{t}\psi](x) satisfies a partial differential equation [ 62 ] \displaystyle\frac{\partial\varphi}{\partial t}=\frac{\partial\varphi}{\partial x}f=:{\cal K}_{f}\varphi (3) with the initial condition \varphi(x,0)=\psi(x) . The operator {\cal K}_{\mathbf{f}} is the infinitesimal generator of {\mathbb{U}}_{t} i.e., \displaystyle{\cal K}_{f}\psi=\lim_{t\to 0}\frac{(\mathbb{U}_{t}-I)\psi}{t}. (4) It is easy to check that each {\mathbb{U}}_{t} is a linear operator on the space of functions, {\cal F} . Definition 2 . [Eigenvalues and Eigenfunctions of Koopman] A function \psi_{\lambda}(x) , assumed to be at least {\cal C}^{1}