Latent-space variational data assimilation in two-dimensional turbulence
Andrew Cleary \aff 1, Qi Wang \aff 1,2, Tamer A. Zaki \aff 1 · 2025
Read Latent-space variational data assimilation in two-dimensional turbulence by Andrew Cleary \aff 1, Qi Wang \aff 1,2, Tamer A. Zaki \aff 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-15470.txt.
Introduction
Andrew Cleary, Qi Wang, and Tamer Zaki propose estimating turbulent flow from sparse readings by working in a learned latent space in a 2025 paper. Data assimilation fills in a full flow field from limited measures, but doing it in the full state space often adds false small scale motion.
Their method optimizes the starting field in a low dimensional latent space learned by autoencoders, rather than in the full space. For coarse measures of two dimensional Kolmogorov flow, it cuts relative error by two orders of magnitude over standard assimilation. Small scales come out more faithful, and the method stays robust when measures are noisy.
Catalog record
| CREATOR | Andrew Cleary \aff 1, Qi Wang \aff 1,2, Tamer A. Zaki \aff 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-15470
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Latent-space variational data assimilation in two-dimensional turbulence Andrew Cleary \aff 1, Qi Wang \aff 1,2, Tamer A. Zaki \aff 1 Abstract Starting from limited measurements of a turbulent flow, data assimilation (DA) attempts to estimate all the spatio-temporal scales of motion. Success is dependent on whether the system is observable from the measurements, or how much of the initial turbulent field is encoded in the available measurements. Adjoint-variational DA minimises the discrepancy between the true and estimated measurements by optimising the initial velocity or vorticity field (the ‘state space’). Here we propose to instead optimise in a lower-dimensional latent space which is learned by implicit rank minimising autoencoders. Assimilating in latent space, rather than state space, redefines the observability of the measurements and identifies the physically meaningful perturbation directions which matter most for accurate prediction of the flow evolution. When observing coarse-grained measurements of two-dimensional Kolmogorov flow at moderate Reynolds numbers, the proposed latent-space DA approach estimates the full turbulent state with a relative error improvement of two orders of magnitude over the standard state-space DA approach. The small scales of the estimated turbulent field are predicted more faithfully with latent-space DA, greatly reducing erroneous small-scale velocities typically introduced by state-space DA. These findings demonstrate that the observability of the system from available data can be greatly improved when turbulent measurements are assimilated in the right space, or coordinates. \lefttitle Andrew Cleary, Qi Wang and Tamer A. Zaki \righttitle Journal of Fluid Mechanics \corresau Tamer A. Zaki, 1 Introduction Assimilating experimental data into numerical simulations improves the fidelity of the simulations and enables nonintrusive access to all the scales of the estimated flow. However, the estimation of turbulence from limited measurements is a difficult ill-posed problem ( 17 ) . Turbulence presents challenges such as the chaotic nature of the forward and dual problems, the non-uniqueness of solutions consistent with the measurements, and the introduction of erroneous small-scale velocities that decay over the solution trajectory. Conventional data assimilation utilizes the measurements to navigate the state-space representation of turbulence, and to directly estimate the velocity or vorticity field that justifies the measurements. However, the state-space representation of turbulence is not necessarily suitable for this task. In this work, we propose to first map from the measurements to a pre-designed latent space, from which the full turbulent field can be subsequently decoded. We show that the accuracy of the estimated turbulent field can be significantly improved over a broad range of scales by interpreting the turbulent measurements in this latent space, when compared to the estimation using the state-space coordinates. The term latent space refers to a low-dimensional and interpretable representation of the turbulent field, whether by familiar modal decompositions ( 12 ) , or by non-linear autoencoder transformations ( 1 ) . Physical insights of complex dynamical systems can be gleaned from these low-dimensional latent spaces ( 8 ) . Rank-minimising autoencoders have successfully learned parsimonious representations of chaotic systems such as the Lorenz system, the Kuramoto-Sivashinsky equation and the lambda-omega reaction-diffusion system ( 18 ) . The latent spaces of such autoencoders have yielded insights on the nature of bursting events and the dynamical relevance of unstable periodic orbits in forced two-dimensional (2D) turbulence ( 3 ) . In the context of turbulence estimation, data-driven methods have been used to directly super-resolve limited instantaneous observations to the full flow state ( 7 , e.g.) . Another super-resolution study considered a time-history of scarce measurements and inferred the pressure field of forced isotropic turbulent flow ( 16 ) . Machine-learning and classical DA methods to estimate turbulence have been pursued mostly separately, with a few exceptions including the following examples: 5 compared the estimation of wall turbulence using physics-informed neural networks and adjoint-variational techniques. 11 modified the training of super-resolution networks to incorporate a time-forward Navier-Stokes evolution in the output, and a comparison to future data. Most recently, ( 15 ) used the output of this super-resolution network as an initial guess to adjoint-variational DA. While this last effort has interfaced the data-driven methods and adjoint-variational DA, the two techniques were not fully integrated. In the present work, we integrate the two turbulence estimation strategies. We exploit a learned space that is discovered using data-driven methods and the physics constraints of adjoint-variational DA, to significantly enhance the observability of turbulence systems and their estimation across a wider range of scales. In § 2 , we outline the flow configuration studied and summarise the standard variational DA procedure. In § 3 , we present the proposed latent-space DA procedure. In § 4 , we compare and interpret the improved performance of latent-space DA. We conclude in § 5 . 2 State-space data assimilation We consider Kolmogorov flow, which is monochromatically forced 2D turbulence on a square and doubly periodic domain ( 2 ) . The out-of-plane vorticity \omega=\partial_{x}v-\partial_{y}u defines the flow state in state space and evolves according to \partial_{t}\omega+\bm{u}\cdot\bm{\nabla}{\omega}=\frac{1}{\Rey}\nabla^{2}\omega-k_{f}\cos{k_{f}y}, (1) where \bm{u}=(u,v) is the velocity. In this non-dimensionalisation, the length scale 1/k^{*}=L^{*}/2\pi is the inverse of the fundamental wavenumber (asterisk denotes dimensional quantities). The time scale is 1/\sqrt{k^{*}\chi^{*}} , where \chi^{*} is the amplitude of the forcing in the momentum equation. The Reynolds number is therefore \Rey\coloneq\sqrt{\chi^{*}/k^{*3}}/\nu , where \nu is the kinematic viscosity. The forcing wavenumber is set to k_{f}=4 . Kolmogorov flow approaches an asymptotic regime beyond Re\approx 50 ( 4 ) , and therefore we consider Re=\{40,100,400\} in this work. The vorticity-velocity Navier-Stokes equations ( 1 ) are solved using the pseudospectral version of the JAX-CFD solver ( 10 ) , allowing for the efficient computation of gradients of the time-forward map of ( 1 ) using automatic differentiation. The computational grid is set to N_{x}\times N_{y}=128^{2} for Re=\{40,100\} and 512^{2} for Re=400 . Figure 1: Schematic of latent-space data assimilation. The latent representation \eta is mapped to state space \omega by the decoder \mathcal{F}_{\mathcal{D}} , where the adjoint field \omega^{\dagger} is computed. The grey arrow closes the standard, state-space ‘loop’. In latent-space assimilation, the latent state is updated by the transformed adjoint field \eta^{\dagger} . Sensor resolution is indicated by the lattice of black dots in the lower left corner of \omega . Our objective is to estimate the flow state \omega^{*}_{0} which, when evolved using the Navier-Stokes equations ( 1 ), reproduces available measurements m_{n}^{R}=\mathcal{M}(\omega^{R}_{n})\in\mathbb{R}^{d_{m}} from a reference solution \omega^{R} at discrete times t_{n}=n\Delta t over the time horizon t_{n}\in[0,T] for n=0,\dots,N . The problem is formulated as a variational minimisation of a cost function of the discrepancy between the estimated and true measurements, \mathcal{J}(\omega_{0})=\frac{1}{2}\sum_{n=0}^{N}\left\|\mathcal{M}(\omega_{n})-m^{R}_{n}\right\|^{2}, (2) subject to the constraint that \omega_{n}=f^{t_{n}}(\omega_{0}) is the time-forward map of ( 1 ) from initial condition \omega_{0} . The required gradient of ( 2 ) with respect to \omega_{0} can be computed using the discrete adjoint ( 13 ) or automatic differentiation ( 6 ) . The measurement operator \mathcal{M} is defined to be the coarse-graining operation \mathcal{M}:\mathbb{R}^{N_{x}\times N_{y}}\to\mathbb{R}^{N_{x}/M\times N_{y}/M} which samples the high-resolution data at every M^{\text{th}} gridpoint in both x - and y -directions. The temporal coarsening \Delta t=M\delta t is set by the same coarsening factor, where \delta t is the time-step of the numerical simulation. At Re=\{40,100\} , coarsening is set to M=16 and to