A Hybrid Framework for Efficient Koopman Operator Learning

Alexander Estornell*, Leonard Jung*, Alenna Spiro*, Mario Sznaier, Michael Everett · 2025

Read A Hybrid Framework for Efficient Koopman Operator Learning by Alexander Estornell*, Leonard Jung*, Alenna Spiro*, Mario Sznaier, Michael Everett (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-18676.txt.

Introduction

Alexander Estornell and co-authors mix solver math with learning to build Koopman operators more cheaply, in work from 2025. Koopman analysis swaps a nonlinear system for a linear operator on observed quantities, which opens the standard linear toolbox. Exact operators are out of reach, and approximations are hard to tune.

Coder-built methods need system details and scale badly. Learning methods hinge on guesses like the size of the observation space. The hybrid uses a convex solver to find the operator's shape first. A learner then fits the maps in and out of that space. The split cuts the unknowns users must preset. The authors frame it as efficiency with fewer knobs to guess.

Catalog record

CREATORAlexander Estornell*, Leonard Jung*, Alenna Spiro*, Mario Sznaier, Michael Everett
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE28 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-18676

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Hybrid Framework for Efficient Koopman Operator Learning Alexander Estornell*, Leonard Jung*, Alenna Spiro*, Mario Sznaier, Michael Everett Abstract Koopman analysis of a general dynamics system provides a linear Koopman operator and an embedded eigenfunction space, enabling the application of standard techniques from linear analysis. However, in practice, deriving exact operators and mappings for the observable space is intractable, and deriving an approximation or expressive subset of these functions is challenging. Programmatic methods often rely on system-specific parameters and may scale poorly in both time and space, while learning-based approaches depend heavily on difficult-to-know hyperparameters, such as the dimension of the observable space. To address the limitations of both methods, we propose a hybrid framework that uses semidefinite programming to find a representation of the linear operator, then learns an approximate mapping into and out of the space that the operator propagates. This approach enables efficient learning of the operator and explicit mappings while reducing the need for specifying the unknown structure ahead of time. Code: https://github.com/neu-autonomy/HybridKoopman I Introduction Within the study of estimation and controls, we often aim to understand or forecast the future behavior of a given system. For linear systems, characterizing attractive or divergent behavior is well understood. In contrast, characterizing the future of trajectories generated by nonlinear systems is difficult due to inherent transient variability. Koopman Theory has emerged as a common perspective in modeling such nonlinear systems [ 1 ] , where the states of a nonlinear system are mapped to an infinite-dimensional space of observables equipped with a linear Koopman operator, allowing for analysis from established linear systems theory. In particular, the leading eigenfunction, eigenvalues, and modes of the observable space produce a system in a space that appears linear. Early numerical methods for determining these spectral properties for linear observables broadly fall under the branch of Dynamic Mode Decomposition [ 2 , 3 , 4 ] . To capture nonlinear dynamics, extended DMD (EDMD) proposes finding a nonlinear mapping and inverse from the state space to the linear observable space [ 5 ] , although finding the mapping is challenging. Thus, learning-based approaches [ 6 , 7 , 8 , 9 , 10 ] use the computational strength of neural networks (NNs) to find the Koopman operator and embeddings into the observable space through training on large amounts of data. In particular, these methods often use the latent space of an autoencoder (AE) as the observable space, meaning that the dimensionality of the observable space becomes a hyperparameter that must be chosen a priori. The dimension of this observable space is an important hyperparameter. Specifically, if chosen too small, the observable space would struggle to capture the most important eigenvalues of the system. If chosen too large, the resulting model may be too computationally expensive to train. These methods also often require prescribing the order of the underlying dynamics, which becomes another important hyperparameter — especially when considering more complicated or chaotic systems. In contrast to learning approaches, the method proposed in [ 11 ] frames finding the mapping as an optimization problem and performs convex relaxations to solve for the observable space embedding via a semi-definite program (SDP). Unfortunately, that approach scales quadratically both in time (with data when solving the SDP) and in space (when embedding the states). These factors limit its applications in real-time use. To bridge the gap between these two approaches and to leverage their unique advantages while alleviating their drawbacks, this paper proposes a hybrid approach to finding embeddings that yield linear representations of nonlinear dynamics. To do this, we develop a two-stage optimization scheme which first uses an SDP to find an approximate observable space and Koopman operator, then applies this knowledge to train an autoencoder to find the mappings into the observable space and refine the operator. As shown in our experiments across several systems, including the chaotic Lorenz oscillator in Section IV , exploiting the information provided by the SDP to design and train the AE leads to a substantial reduction in approximation error and computation time compared a baseline AE approach [ 6 ] . II Background In this section, we provide a brief overview on Koopman theory, autoencoder-based methods, and convex optimization approaches for finding a Koopman operator and observables. II-A Koopman Operator Theory This work focuses on discrete-time dynamical systems of the form: \bm{x}_{i+1}=f(\bm{x}_{i}), (1) where \bm{x}_{i}\in\mathbb{R}^{n} and f is a non-linear function. For any deterministic, discrete-time dynamical system, there exists a Koompman operator, \mathcal{K} , that is able to propagate observable functions forward in time [ 12 ] : \mathcal{K}\circ\psi(\bm{x}_{k})=\psi(\bm{x}_{k+1}), (2) where \psi is some m -dimensional measurement of the state, \bm{x}_{k} . Since \mathcal{K} operates on the Hilbert space of observable functions, it is infinite dimensional. In particular, many methods aim to find eigenfunctions of the Koopman operator, \mathcal{K}\psi(\bm{x}_{i})=\lambda\psi(\bm{x}_{k}), (3) resulting in a linear Koopman operator that can be propagated with the corresponding eigenvalue, \lambda . In addition to linearity, this set of eigenfunctions [\psi_{1},\dots,\psi_{n}] spans an invariant subspace (i.e., applying the Koopman operator to any element of this subspace remains in the subspace). By finding a finite set of eigenfunctions and their corresponding eigenvalues, a finite matrix Koopman can approximate the overall dynamics of the system. Thus, the dimensionality of the embedding m is an important choice when finding the Koopman operator. II-A 1 Koopman Operator for Chaotic Systems For chaotic systems, where there may be unpredictable switching behavior or multiple fixed points, finding an accurate linear embedding is difficult; in fact, for the latter case, a continuous one-to-one linear immersion does not exist [ 13 ] . A common technique is to supplement the current measurement with previous history as memory ; works such as HAVOK [ 14 ] utilized the link between the time-delay Hankel matrix and Koopman operator \displaystyle\left[\begin{array}[]{cccc}\bm{x}_{0}&\bm{x}_{1}&\dots&\bm{x}_{q-1}\\ \bm{x}_{1}&\bm{x}_{2}&\dots&\bm{x}_{q}\\ \vdots&\vdots&\ddots&\vdots\\ \bm{x}_{r-1}&\bm{x}_{r}&\dots&\bm{x}_{r+q-2}\end{array}\right]= \displaystyle\left[\begin{array}[]{cccc}\bm{x}_{0}&\mathcal{K}\bm{x}_{0}&\dots&\mathcal{K}^{q-1}\bm{x}_{0}\\ \mathcal{K}\bm{x}_{0}&\mathcal{K}^{2}\bm{x}_{0}&\dots&\mathcal{K}^{q}\bm{x}_{0}\\ \vdots&\vdots&\ddots&\vdots\\ \mathcal{K}^{r-1}\bm{x}_{0}&\mathcal{K}^{r}\bm{x}_{0}&\dots&\mathcal{K}^{q+r-2}\bm{x}_{0},\end{array}\right] to find a Koopman representation through a singular value decomposition (SVD) of the Hankel matrix. Although this method successfully approximates nonlinear chaotic systems, selecting the order of the linear system and memory size is critical for accurate recreation; selecting order too high results in large models, while too small order may result in poor prediction. II-B Finding linear embeddings through deep learning Leveraging neural networks’ ability to learn from large datasets, [ 6 ] proposes to use an autoencoder to learn both the Koopman operator and an embedding onto its eigenfunctions (observables). The objective is for the encoder, \varphi(\cdot) , to map states, \bm{x}\in\mathbb{R}^{n} , to coordinates, \bm{y}=\varphi(\bm{x})\in\mathbb{R}^{m} , that span the eigenfunctions of the learned Koopman operator, \hat{\mathcal{K}}^{\text{NN}} . The intrinsic coordinates are next passed through an auxiliary network to predict the Koopman operator’s m eigenvalues. A key insight of [ 6 ] is that by allowing the eigenvalues to vary, their architecture can succinctly describe the dynamics of both systems with discrete or continuous spectrum. The network’s ability to learn the Koopman operator and these intrinsic coordinates is due to three loss functions that we outline next. II-B 0a Reconstruction Loss The encoder component learns an embedding into the observable space \bm{y}=\varphi(\bm{x}) , while the decoder learns the inverse back into the state space \bm{x}=\varphi^{-1}(\bm{y}) . Reconstruction accuracy of the system is defined by the following loss:

Read the complete text