Towards Efficient and Stable Ocean State Forecasting: A Continuous-Time Koopman Approach

Rares Grozavescu, Pengyu Zhang, Mark Girolami, Etienne Meunier · 2026

Read Towards Efficient and Stable Ocean State Forecasting: A Continuous-Time Koopman Approach by Rares Grozavescu, Pengyu Zhang, Mark Girolami, Etienne Meunier (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-05560.txt.

Introduction

Grozavescu and team look into the Continuous-Time Koopman Autoencoder as a light stand-in for long-horizon ocean forecast in a quasi-geostrophic system. A latent space ruled by a linear differential equation gives structured, easy to read change and forecast, same at any detail. Across 2083-day rollouts, error growth stays bounded and large stats steady, unlike Transformer base models with gradual error growth and energy drift. Fine shapes partly fade, but bulk spectra, enstrophy, and autocorrelation stay steady, with answers many times faster than the math solver.

Catalog record

CREATORRares Grozavescu, Pengyu Zhang, Mark Girolami, Etienne Meunier
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21066
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.05560

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Towards Efficient and Stable Ocean State Forecasting: A Continuous-Time Koopman Approach Rares Grozavescu, Pengyu Zhang, Mark Girolami, Etienne Meunier Abstract We investigate the Continuous-Time Koopman Autoencoder (CT-KAE) as a lightweight surrogate model for long-horizon ocean state forecasting in a two-layer quasi-geostrophic (QG) system. By projecting nonlinear dynamics into a latent space governed by a linear ordinary differential equation, the model enforces structured and interpretable temporal evolution while enabling temporally resolution-invariant forecasting via a matrix exponential formulation. Across 2083-day rollouts, CT-KAE exhibits bounded error growth and stable large-scale statistics, in contrast to autoregressive Transformer baselines which exhibit gradual error amplification and energy drift over long rollouts. While fine-scale turbulent structures are partially dissipated, bulk energy spectra, enstrophy evolution, and autocorrelation structure remain consistent over long horizons. The model achieves orders-of-magnitude faster inference compared to the numerical solver, suggesting that continuous-time Koopman surrogates offer a promising backbone for efficient and stable physical–machine learning climate models. 1 Introduction Ocean forecasting underpins understanding of Earth’s climate, yet high-fidelity Global Climate Models (GCMs) ( 15 ; 13 ) are computationally expensive, limiting large ensemble simulations. Recent data-driven surrogates based on large autoregressive architectures ( 17 ; 10 ; 2 ; 19 ) have shown strong short-term predictive skill but often suffer from instability over long rollout horizons. We explore a complementary physics-structured alternative based on Koopman Theory ( 9 ) . Specifically, we apply the Continuous-Time Koopman Autoencoder (CT-KAE) ( 7 ) to a two-layer quasi-geostrophic (QG) model. By evolving the latent representation via a linear Ordinary Differential Equation (ODE), the model enforces explicit operator structure while enabling temporally resolution-invariant forecasting through a matrix exponential formulation. Rather than maximizing short-term pixel-wise accuracy, we prioritize long-horizon dynamical consistency: bounded error growth and preservation of bulk statistical invariants. The central question we address is whether explicit linear structure in latent space improves stability without sacrificing computational efficiency. 2 The Quasi-Geostrophic Model The Quasi-Geostrophic (QG) model have been used extensively in oceanography for modelling midlatitude oceanic circulation ( 16 ; 14 ) . 2.1 Governing Equations and Physics We utilize a two-layer version of the QG model where the prognostic variable is potential vorticity, q_{m} , for layers m\in\{1,2\} . The governing equations relate q_{m} to the streamfunction \psi_{m} : q_{1}=\nabla^{2}\psi_{1}+F_{1}(\psi_{2}-\psi_{1}),\quad\quad q_{2}=\nabla^{2}\psi_{2}+F_{2}(\psi_{1}-\psi_{2}), (1) where F_{1}=k_{d}^{2}/(1+\delta) , F_{2}=\delta F_{1} , and k_{d}^{2}=(f_{0}^{2}/g^{\prime})(H_{1}+H_{2})/(H_{1}H_{2}) . Here, H_{m} is the layer depth, and f_{0} is the Coriolis frequency. The fluid velocity is related to \psi_{m} via \mathbf{u}_{m}=(u_{m},v_{m})=(-\partial_{y}\psi_{m},\partial_{x}\psi_{m}) . The temporal evolution of the system is governed by: \partial_{t}q_{m}+\mathbf{J}(\psi_{m},q_{m})+\beta\partial_{x}\psi_{m}+\partial_{y}Q_{m}\partial_{x}\psi_{m}+U_{m}\partial_{x}q_{m}=\mathcal{D}_{m} (2) where \mathbf{J}(A,B)=\partial_{x}A\partial_{y}B-\partial_{y}A\partial_{x}B is the horizontal Jacobian, Q_{m} is background potential vorticity, and U_{m} is the background zonal mean flow velocity. The term \mathcal{D}_{m} represents small-scale dissipation, with the lower layer additionally incorporating Ekman bottom drag such that \mathcal{D}_{2}=-r_{ek}\nabla^{2}\psi_{2}+\text{ssd} . 2.2 Related Work on QG and Machine Learning Machine learning approaches to QG dynamics broadly fall into two categories: subgrid-scale (SGS) parameterization and full state forecasting. SGS Parameterization. Prior work has focused on learning closure terms representing unresolved processes. CNN-based approaches ( 3 ) and stability-aware refinements ( 6 ; 20 ) have demonstrated promising results for coarse-resolution modeling. Full State Forecasting. Deep learning models including CNNs, GANs, Transformers, and reduced-order hybrids have been applied to turbulent flow prediction ( 5 ; 11 ; 8 ; 4 ; 1 ) . More recently, diffusion-based approaches such as the Thermalizer ( 18 ) have targeted long-horizon stability. In contrast, our approach enforces explicit linear structure and conduct temporal evolution in latent space, promoting stability while reducing inference cost to a matrix–vector multiplication. 3 Methodology The CT-KAE projects high-dimensional QG states into a latent space governed by a linear continuous-time dynamical system before decoding back to the physical domain. The architecture consists of a dual-stream encoder, a latent ODE module, and a decoder (Figure 1 ). Figure 1: CT-KAE architecture. High-dimensional QG states x_{t} are encoded into a latent representation z_{t} using a dual-stream encoder that incorporates both present and historical information. The latent state evolves according to a linear continuous-time ODE \dot{z}=\mathbf{K}z , enabling resolution-invariant temporal querying via the matrix exponential. The decoder reconstructs physical fields from latent space. Encoder and Decoder. Let x_{t}\in\mathbb{R}^{H\times W\times C} denote the ocean state at time t , comprising channels for streamfunction \psi and potential vorticity q . CNN-based encoders are used, with a present encoder \mathcal{E}_{\text{pres}} and a history encoder \mathcal{E}_{\text{hist}} which take in x_{t} and x_{t-1} respectively, producing latent variable z_{t}=\frac{1}{2}(\mathcal{E_{\text{pres}}}(x_{t})+\mathcal{E_{\text{hist}}}(x_{t-1})) . The decoder \mathcal{D} reconstructs the physical state, \hat{x}_{t}=\mathcal{D}(z_{t}) . Continuous-Time Latent Dynamics. In contrast to discrete-time KAEs ( 12 ) , which propagate the latent state via a fixed-step mapping ( z_{t+1}=\mathbf{K}z_{t} ), the CT-KAE governs the latent evolution through a linear ODE: \frac{dz}{dt}=\mathbf{K}z, (3) where a fourth-order Runge-Kutta (RK4) scheme is employed for numerical integration. The state at any future time t+\tau can also be computed via the matrix exponential: z(t+\tau)=\exp(\mathbf{K}\tau)z(t). (4) This approach allows the model to be queried at arbitrary time. We empirically evaluate this resolution-invariant capability in Section 5 . Baseline: ViT (AR). We compare against a pure autoregressive Vision Transformer with 12 encoder layers (128-dim embeddings, 8 heads) operating on 8\times 8 patches. The model performs stepwise rollouts by recursively feeding predicted frames as input. Training uses AdamW (LR 2\times 10^{-4} , batch size 32) with the same data split as CT-KAE. While effective at short-term prediction, the autoregressive nature of ViT leads to compounding errors over long horizons, as illustrated in Section 5 . This provides a strong baseline for assessing the long-term stability benefits of the CT-KAE’s continuous-time latent dynamics. Training. During training, models are optimized using short rollouts of 10 steps. Long-horizon behavior is therefore entirely emergent and not explicitly optimized during training. This setup allows us to evaluate whether stability arises from architectural structure rather than training heuristics. 4 Dataset We generate data from a two-layer QG model following ( 18 ) . The flow is driven by a background zonal mean flow ( U_{1}=0.025 m/s, U_{2}=0 m/s) with physical parameters \beta=1.5\times 10^{-11}\text{ m}^{-1}\text{s}^{-1} and linear bottom drag r_{ek}=5.787\times 10^{-7}\text{ s}^{-1} . Ground truth simulations are generated with a 3600 s integration step , then downsampled to 64\times 64 and subsampled every 5 steps for an effective resolution \Delta t=5h . The system is integrated for 40,000 days to reach a stationary turbulent regime. We train on short 10-step trajectory segments and evaluate on unseen initial conditions using 2083-day ( \approx 10,000 steps) rollouts without reinitialization. All fields are normalized by the training-set mean and standard deviation prior to model ingestion. 5 Results Because the QG system is chaotic, deterministic trajectory alignment becomes ill-posed at multi-year lead times. We therefore evaluate CT-KAE along two axes: (i) forecasting fidelity, from short-term accuracy to long-horizon invariants, and (ii) operational advantages, namely computational efficiency and temporal resolution invariance. 5.1 Long-Horizon Emulation and Physical Invariants We compare long-term reconstruction accuracy using RMSE (Table 1 ). CT-KAE achieves slightly lower error than the autoregressive ViT baseline (0.938 \pm 0.031 vs. 0.993 \pm 0.033), indicating that latent linear structure does not compromise predictive fidelity. At 2083-day lead times, anomaly correlation (ACC) is near zero for both models (Table 1 ). This is expected: the decorrelation time scale of the QG system (

Read the complete text