Leveraging Scale Separation and Stochastic Closure for Data-Driven Prediction of Chaotic Dynamics
Ismaël Zighed, Nicolas Thome, Patrick Gallinari, Taraneh Sayadi, [0.5em] Institut Jean le Rond d’Alembert, Sorbonne Université, Paris, France · 2025
Read Leveraging Scale Separation and Stochastic Closure for Data-Driven Prediction of Chaotic Dynamics by Ismaël Zighed, Nicolas Thome, Patrick Gallinari, Taraneh Sayadi, [0.5em] Institut Jean le Rond d’Alembert, Sorbonne Université, Paris, France (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-24583.txt.
Introduction
Ismaël Zighed leads a team of four authors on predicting turbulent flow. Turbulence is chaotic flow with swirls at many sizes at once. Full simulation of turbulence costs far too much for real cases. Data-driven models learn flow patterns but drift as errors pile up. Step-by-step prediction, called autoregression, makes that drift worse.
The team split the task by scale, large versus small. A VAE plus Transformer learns the large, filtered motion. VAE means a neural model that squeezes data into a latent code. Gaussian process regression then rebuilds fine detail from that code. Tests use Kolmogorov flow, a standard chaotic test case. The method beat VAE and diffusion baselines on key statistics. It also gave sound, adaptive confidence bands for its forecasts.
Catalog record
| CREATOR | Ismaël Zighed, Nicolas Thome, Patrick Gallinari, Taraneh Sayadi, [0.5em] Institut Jean le Rond d’Alembert, Sorbonne Université, Paris, France |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-24583
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Leveraging Scale Separation and Stochastic Closure for Data-Driven Prediction of Chaotic Dynamics Ismaël Zighed, Nicolas Thome, Patrick Gallinari, Taraneh Sayadi, [0.5em] Institut Jean le Rond d’Alembert, Sorbonne Université, Paris, France Abstract Simulating turbulent fluid flows is a computationally prohibitive task, as it requires the resolution of fine-scale structures and the capture of complex nonlinear interactions across multiple scales. This is particularly the case in direct numerical simulation (DNS) applied to real-world turbulent applications. Consequently, extensive research has focused on analysing turbulent flows from a data-driven perspective. However, due to the complex and chaotic nature of these systems, traditional models often become unstable as they accumulate errors through autoregression, severely degrading even short-term predictions. To overcome these limitations, we propose a purely stochastic approach that separately addresses the evolution of large-scale coherent structures and the closure of high-fidelity statistical data. To this end, the dynamics of the filtered data (i.e. coherent motion) are learnt using an autoregressive model. This combines a VAE and Transformer architecture. The VAE projection is probabilistic, ensuring consistency between the model’s stochasticity and the flow’s statistical properties. The mean realisation of stochastically sampled trajectories from our model shows relative L 1 L_{1} and L 2 L_{2} distances of 6% and 10%, respectively, with test set. Moreover, our framework enables the construction of meaningful confidence intervals, achieving a Prediction Interval Coverage Probability (PICP) of 80% with minimal interval width. To recover high-fidelity velocity fields from the filtered latent space, Gaussian Process (GP) regression is employed. This strategy has been tested in the context of a Kolmogorov flow exhibiting chaotic behaviour analogous to real-world turbulence. We compare the performance of our model with state-of-the-art probabilistic baselines, including a VAE and a diffusion model. We demonstrate that our Gaussian process-based closure outperforms these baselines in capturing first and second moment statistics in this particular test bed, providing robust and adaptive confidence intervals. When using L 1 L_{1} and L 2 L_{2} norms to evaluate the first moment, our GP surpasses its closest competitor by 49% and 48%, respectively. For second-moment statistics, assessed via the Continuous ranked Probability Score (CRPS), the GP outperforms both baselines by nearly 100%. Keywords: Reduced Order Modelling, Dynamical systems, Turbulence, Probabilistic modelling, Stochastic modelling, Data-driven closure for turbulence modelling 1 Introduction When modelling turbulence, the deterministic toolbox encounters two notable challenges. The first relates to the chaotic and unpredictable nature of the dynamical system, which exhibits erratic trajectories seemingly devoid of recurrent patterns and is highly sensitive to initial conditions. As Lorenz famously put it, “The present determines the future, but the approximate present does not approximately determine the future”. The second hurdle arises from the problem’s complex, multi-scale nature. The various scales involved pose difficulties for both DNS, due to the need for excessive constraint on the resolution to account for all the scales, and for machine learning models, which struggle to represent their inherent complexity. From a reduced-order modelling perspective (with ML strategies being a subcategory of this), we believe that decomposing the task into two consecutive subtasks will overcome both of the aforementioned hurdles. The “first task" would be to derive the dynamics from low-pass filtered data, focusing on the evolution of large structures that contribute significantly to the total kinetic energy. This approach is commonly taken in the fluid mechanics community by relying on Large Eddy Simulations (LES) (see, for example, ( Deardorff 1970 ) ) as opposed to Direct Numerical Simulation (DNS). However, as with LES, the question of closure remains. In the “second task" , therefore, once the trajectories have been reconstructed in the filtered space, we hypothesise the existence of a time-independent and stochastic mapping from that space to the full-resolution domain. The first task involves constructing an autoregressive and predictive Reduced-Order Model (ROM). The Reduced Order Model (ROM) framework has demonstrated promising capabilities across a wide range of dynamical systems, including chaotic ones ( Toni et al. 2014 ) . For instance, Proper Orthogonal Decomposition (POD) enables the projection of a system’s states onto lower-dimensional spaces, which are spanned by the system’s space-time coherent structures referred to as "modes." As an analytically derived technique, POD uncovers interpretable modes and has been widely adopted as a powerful baseline for dimensionality reduction in physics and turbulence modelling ( Schmid 2021 ) . In the nonlinear dynamics community, there has been growing interest in Koopman theory, which supports the existence of linear dynamics even for strongly non-linear systems through the infinite-dimensional Koopman operator ( Brunton et al. 2022 ) . Many works and algorithms focus on finding tractable, finite-dimensional approximations of this operator, that capture the essential dynamics. Among these, Dynamic Mode Decomposition (DMD) is one of the most prominent examples ( Schmid 2010 ) . Another powerful approach involves identifying the slowest invariant manifold spanned by the eigenspace of the linearized system near a fixed point and extending it through the system’s nonlinearities. This method, known as Spectral Submanifolds (SSMs), reveals low-dimensional, non-linear structures that allow for model reduction and simplification of the dynamics ( Haller and Ponsioen 2016 ) . Alternatively, these low-dimensional structures can also be identified using machine learning (ML), thereby relaxing the linear or orthogonality constraints inherent to POD. These ROM approaches can generally be divided into two main categories: Intrusive, which are tailored to the Navier–Stokes equations via for example Galerkin projection ( Menier et al. 2023 ) , and non-intrusive, which are purely data-driven ( Menier et al. 2025 ; Özalp et al. 2025 ; Gupta et al. 2023 ; Simpson et al. 2024 ) . Some non-intrusive approaches even operate in a mesh-independent fashion ( Serrano et al. 2023 ) . Recent advances in embedded memory architectures, particularly attention mechanisms and transformers ( Vaswani et al. 2017 ) for time-series applications, have considerably reshaped this landscape ( Shokar et al. 2024 ; Solera-Rico et al. 2024 ; Ismaël et al. 2025 ) . Regardless of the strategy employed, ROMs typically rely on some form of dimensionality reduction, such as proper orthogonal decomposition (POD), autoencoders or other compression techniques. This is based on the assumption that the system’s dynamics evolve on a low-dimensional manifold in phase space ( Haller and Ponsioen 2016 ; Buza et al. 2021 ) . Remarkably, this assumption often holds for chaotic systems ( Liu et al. 2024 ) , with the infamous Lorenz butterfly serving as a paradigmatic example of such low-dimensional underlying structure. However identifying the attractor is not straightforward, and many attempts have shown that, due to inherent turbulence, the resulting models tends to diverge from the true trajectory used in forecast mode ( Liu et al. 2024 ; Ozalp et al. 2025 ) . Therefore, in this paper, we take a stochastic approach to overcome this challenge. To this end, we use a probabilistic reduction strategy involving an encode-process-decode architecture with a transformer in the latent space and a VAE to generate stochasticity. This enables us to learn the time evolution of the system in the filtered space (i.e. large-scale dynamics) and generate a stochastic ensemble of trajectories whose statistical properties closely resemble those of the filtered flow. A second probabilistic model is then employed to close the dynamics for smaller eddies, generating new samples that