Inverted Gaussian Process Optimization for Probabilistic Koopman Operator Discovery

Abhigyan Majumdar, Navid Mojahed, Shima Nazari · 2025

Read Inverted Gaussian Process Optimization for Probabilistic Koopman Operator Discovery by Abhigyan Majumdar, Navid Mojahed, Shima Nazari (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-00304.txt.

Introduction

Abhigyan Majumdar, Navid Mojahed, and Shima Nazari learn line-like stand-ins for curved systems while they keep doubt marks true. The work came out in 2025. Koopman frame work hints at a world-wide line view of a curved system. But first one must pick a word list of traits to watch. That pick is made by guesswork, as a rule.

Their way drops the guesswork. Gauss-style chance fits give a chance-based Koopman model learned straight from data. A flipped search scheme learns the traits and the frame part side by side. It is driven by self-run slope math. Sims show the way grabs rich curved acts from data. It also shrugs off gauge noise in the train set. Its chance spreads tend to hold the true acts.

Catalog record

CREATORAbhigyan Majumdar, Navid Mojahed, Shima Nazari
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-00304

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Inverted Gaussian Process Optimization for Probabilistic Koopman Operator Discovery Abhigyan Majumdar, Navid Mojahed, Shima Nazari Abstract Koopman Operator Theory has opened the doors to data-driven learning of globally linear representations of complex nonlinear systems. However, current methodologies for Koopman Operator discovery struggle with uncertainty quantification and the dependency on a finite dictionary of heuristically chosen observable functions. We leverage Gaussian Process Regression (GPR) to learn a probabilistic Koopman linear model from data, while removing the need for heuristic observable specification. We present inverted Gaussian Process optimization based Koopman operator learning (iGPK), an automatic differentiation-based approach to simultaneously learn the observable-operator combination. Our numerical results show that the iGPK method is able to learn complex nonlinearities from simulation data while being resilient to measurement noise in the training data, and consistently encapsulating the ground truth in the predictive distribution. \jmlrpages \coltauthor Department of Mechanical & Aerospace Engineering, University of California Davis † † proceedings: : keywords System identification, Gaussian Processes, Koopman Operator Theory 1 Introduction Koopman Operator Theory presents an elegant approach to obtaining globally linear descriptions of nonlinear dynamical systems in infinite-dimensional function spaces ( Koopman, 1931 ) . The spectral reformulation proposed by Mezić (2005) provided a foundation for data-driven modal decompositions and reinvigorated interest in Koopman Operators in the controls and learning fields. Koopman Operator theory allows for the deployment of rigorous linear system analysis and linear control techniques to nonlinear systems ( Mezić, 2021 ) . Further, such globally valid linear models allow for computationally efficient real-time Model Predictive Control (MPC) ( Korda and Mezić, 2018 ) . Although analytical approaches to Koopman Operator discovery exist ( Asada, 2023 ; Mauroy and Mezic, 2024 ) , data-driven approaches have become more wide-spread and well studied. The Extended Dynamic Mode Decomposition (eDMD) algorithm ( Williams et al., 2015 ) and its several variants ( Abolmasoumi et al., 2022 ; Colbrook, 2023 ) are the most popular methods for obtaining finite approximations of the Koopman Operator from a finite dataset of snapshot pairs ( Brunton et al., 2021 ) . However, the eDMD family of methods rely on the user choosing a rich set of observable functions, whose collective expressiveness determines the ability of the algorithm to find a good linear fit for the available dataset. This has led to research into learning the observables, defining the lifted function space, directly from data. In that regard, universal function approximators like Deep Neural Networks (DNNs) ( Lusch et al., 2018 ; Pan and Duraisamy, 2020 ; Mallen et al., 2021 ; Nozawa et al., 2024 ) and Gaussian Processes (GPs) ( Lian and Jones, 2020 ; Zanini and Chiuso, 2021 ; Bevanda et al., 2024 ; Bevanda et al., 2025 ) have garnered a lot of interest. Neural network based Koopman models have also been integrated within MPC frameworks, bringing the representation power of DNNs to linear-model-based real-time optimal control ( Xiao et al., 2020 ; Cisneros et al., 2020 ; Yu et al., 2022 ; Zhang et al., 2024 ; Abtahi et al., 2025 ) . Not only do deep Koopman models need more training data, they, similar to eDMD approaches, also struggle to provide uncertainty estimates ( Frion et al., 2024 ) , which are important for safety critical applications, considering that finite-dimensional Koopman predictors are inherently an approximation of the infinite-dimensional linear dynamics. Predictive uncertainty estimates could allow for model-based controllers to quantify and handle the plant-model mismatch explicitly, and reject measurement noise, leading to a better balance between safety and performance ( Mesbah, 2016 ; Cairano, 2017 ) . In that regard, blending Gaussian Process Regression (GPR) ( Rasmussen and Williams, 2008 ) with Koopman Operator theory holds the promise of uncertainty quantification and non-parametric learning ( Masuda et al., 2019 ; Tsolovikos et al., 2024 ) . The linear nature of the Koopman Operator also addresses the computational challenge of multi-step prediction faced by classical GPR approaches to dynamical system modeling ( Wang et al., 2005 ; Yogarajah, 2021 ) . The Gaussian Process Koopman (GPK) model identification problem has been broken down into a two-stage process - operator identification using traditional subspace methods and then GPR to learn the mapping from the original to the lifted space ( Lian and Jones, 2019 ; Lian and Jones, 2020 ) . Loya et al. (2023) extended this approach to multi-trajectory data records by leveraging multi-trajectory subspace identification algorithm from Holcomb and Bitmead (2017) , demonstrating substantial improvements (see Section 6.1 and Fig. 3 from Loya et al. (2023) ). The separation of operator and observable discovery into two distinct and independent stages exposes the subspace GP methods (SSID-GPK) to noise sensitivity and sub-optimal solutions, which is discussed more in Section 3. Figure 1 : Conceptual Comparison of Deterministic vs Probabilistic GP-based Koopman modeling approaches While current data-driven Koopman approaches have advanced linear approximation capabilities and easy integration with optimal control, they still have shortcomings such as dependence on manually selecting observable functions, struggle with uncertainty quantification and robustness to noise. To overcome these issues, we propose Inverted Gaussian Process optimization for probabilistic Koopman (iGPK) operator modeling. We simultaneously learn the observables and the Koopman Operator by inverting the standard GPR workflow. The GP training targets are assumed to be virtual targets that act as decision variables in an optimization problem. The notable contributions of this work are 1. The proposed approach simultaneously learns the lifting space and the Koopman operator by leveraging automatic differentiation and gradient based optimization 2. The proposed method encapsulates the ground truth within predictive uncertainty bounds 3. The proposed framework is able to handle observation noise in the training data We first provide mathematical background for the Koopman operator theory with the eDMD formulation, Gaussian Process Regression (GPR), and the probabilistic GP-Koopman model, as depicted in Fig. 1 . Then, we outline the optimization problem formulation and solution scheme for observable-operator co-discovery. Finally, we present the results of our numerical simulations to compare the predictive performance with other models in the literature, focusing on nonlinear deterministic autonomous systems with observation noise. 2 Preliminaries 2.1 The Koopman Operator This section provides a short description of the Koopman Operator with regards to discrete time dynamical systems. For an expansive understanding of the underlying theory and different implementations, readers should refer to Mezić (2005) ; Mezić (2021) ; Brunton et al. (2016) ; Brunton et al. (2021) . For the general discrete-time deterministic nonlinear autonomous dynamical system described as x_{k+1}=f\left(x_{k}\right),\ \forall\ x_{k}\in\mathbb{X}\subset\mathbb{R}^{n_{x}},\ f:\mathbb{X}\to\mathbb{X} (1) where, x_{k} is the n_{x} -dimensional state vector at time-step k , and f:\mathbb{X}\to\mathbb{X} is a deterministic nonlinear self-map, the Koopman Operator ( Koopman, 1931 ) , \mathcal{K} , is defined as an infinite-dimensional linear operator on the Hilbert space spanned by the infinite collection of observable functions, \Phi , such that \Phi\circ f(x_{k})=\Phi(x_{k+1})=\mathcal{K}\Phi(x_{k}) (2) where, \Phi(x) lifts the original system states to a higher dimension and is defined as a collection of individual observable functions \phi_{i}(x):\mathbb{R}^{n_{x}}\to\mathbb{R} . When we have access to snapshots of data from experiments, i.e., (x_{k+1}|x_{k})_{k=1}^{N} , which may or may not be corrupted with observation noise, we can obtain data-driven finite-dimensional approximations of the Koopman Operator. In the Extended Dynamic Mode Decomposition algorithm (eDMD, ( Williams

Read the complete text