Accelerating an ensemble of variational data assimilations with randomized preconditioning
Ieva Daužickaitė, Selime Gürol, Mayeul Destouches, Loïk Berre, Anthony T. Weaver · 2026
Read Accelerating an ensemble of variational data assimilations with randomized preconditioning by Ieva Daužickaitė, Selime Gürol, Mayeul Destouches, Loïk Berre, Anthony T. Weaver (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-23571.txt.
Introduction
Daužickaitė and colleagues speed up ensembles of variational data assimilations, which solve linear systems iteratively. The process accelerates with a limited-memory preconditioner built from leading Hessian eigenpairs, but randomized low-rank methods need a good sketching matrix to find those pairs. The authors exploit ensemble structure itself, building the sketch from differences of right-hand sides of the linear systems. Idealized tests on the Lorenz-96 model show the resulting preconditioner speeds every ensemble member, even when built from the control member alone.
Catalog record
| CREATOR | Ieva Daužickaitė, Selime Gürol, Mayeul Destouches, Loïk Berre, Anthony T. Weaver |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63830 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.23571
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Accelerating an ensemble of variational data assimilations with randomized preconditioning Ieva Daužickaitė, Selime Gürol, Mayeul Destouches, Loïk Berre, Anthony T. Weaver Abstract Ensembles of variational data assimilations (EDA) require solving systems of linear equations with iterative methods. The solution process can be accelerated using a limited memory preconditioner constructed with approximations of the leading eigenpairs of the Hessian matrix. Randomized methods for low-rank matrix approximations provide a feasible approach for computing these eigenpairs. These methods use a random sketching matrix to obtain a low-rank representation of the Hessian matrix, which is then used for computing the eigendecomposition. The sketching matrix highly influences the quality of the approximation. In this paper, we show how the structure of the EDA can be exploited to construct a suitable sketching matrix, i.e., using the differences of the right-hand sides of the linear systems of equations. Idealised numerical experiments with the Lorenz-96 model show that the resulting preconditioner is able to accelerate the EDA solution process for all ensemble members, even if constructed from the control member only. \papertype Research Article \corraddress Ieva Daužickaitė, CERFACS, 42 Av. Gaspard Coriolis, 31100 Toulouse, France. \corremail [email protected] \fundinginfo This project has received financial support from the French national programme LEFE (Les Enveloppes Fluides et l’Environnement). keywords ensemble of data assimilations, randomized SVD, randomized EVD, Nyström approximation, limited memory preconditioners, 4DVar 1 Introduction In numerical weather prediction, data assimilation (DA) combines observations of the meteorological state with a previous short-term forecast (background) while accounting for their respective uncertainties. The resulting state is used to initialize the next forecast. Ensemble approaches to data assimilation can provide multiple initial states for an ensemble forecast and can be also used to estimate flow-dependent error covariances (e.g., 28 , 33 , 7 ). We focus on a specific ensemble approach, namely, an ensemble of data assimilations (EDA), which is used at some operational centres, including Météo-France and the European Centre for Medium-Range Weather Forecasts (ECMWF). The EDA consists of solving perturbed variational DA problems, which are constructed using perturbed inputs (observations and background); see, for example, [ 1 ] , [ 2 ] and [ 6 ] . Running an EDA is made computationally feasible by using approximations, for example, considering a limited number of ensemble members and integrating the model at lower resolution than that of the deterministic forecast model. The nonlinear variational DA problems are generally solved using the incremental approach [ 9 ] , which is a variant of the Gauss-Newton method [ 24 , 40 ] . Each iteration of this approach involves minimising a quadratic cost function obtained by linearising the nonlinear operators. In the EDA setting, it is common to use only one iteration of this incremental approach to control the computational cost [ 6 , e.g.,] . In this ensemble setting, this iteration requires minimising a quadratic cost function corresponding to a control unperturbed member and an ensemble of quadratic cost functions defined with the perturbed inputs. The minimisations are performed in parallel, via iterative solution of the associated systems of linear equations. The EDA structure can be exploited to accelerate the minimization. For instance, [ 12 ] use an iterative method for minimizing the quadratic cost functions and show how the recurrences of the solver can be used to construct an initial guess of the solution for related minimizations with closely related Hessian matrices. This approach can also be used to generate a preconditioner for all the ensemble problems, however it implies that part of the ensemble problems must be solved in sequence rather than in parallel, which may not always be possible in an operational setting. [ 38 , 39 ] consider using block Krylov subspace methods to solve all the linear systems simultaneously. This approach considerably reduces the required wall-clock time when operating in observation space, that is, solving the dual problem, due to the reduced cost of orthogonalization and communication compared to the primal approach. However, block Krylov subspace methods rely on the assumption that all the linear systems are formulated using the same Hessian matrix, which only holds when the same linearisation state is used for every ensemble member. In this paper, we focus on preconditioning as a mean to accelerate the minimisations of the EDA. Limited memory preconditioners (LMPs) are used operationally for the incremental strong-constraint four-dimensional variational problem (4D-Var) [ 51 ] . The LMP variant constructed with approximate eigenpairs, called the spectral LMP, was originally proposed by [ 17 ] . In an operational context, each iteration of the incremental approach (called outer iterations hereafter to avoid confusion with the inner iterations of an iterative Krylov subspace method) can provide at negligible extra cost such approximate eigenpairs of the Hessian matrix; this is done using recurrences of the iterative solver used to solve the linear system. These approximate eigenpairs can then be used for the subsequent outer iterations, starting from the second one. However, this is not applicable in an EDA setting with a single outer iteration. In this case, a feasible strategy for constructing a spectral LMP is to employ randomized methods to build a low-rank matrix approximation (for example, [ 27 ] and [ 36 ] ). These methods can be considered as random dimension reduction techniques, where a large matrix is approximated by a significantly smaller matrix, called the sketch. The sketch is obtained by computing a matrix-matrix product of the large matrix and a random sketching matrix. The sketch can be used to obtain an approximate solution (sketch-and-solve approach) or to construct a preconditioner for an iterative method (sketch-and-precondition approach). Randomized methods have been explored to accelerate the solution of systems of linear equations in variational DA when multiple outer iterations of the incremental approach are performed to solve a single DA problem. [ 5 ] and [ 4 ] propose and analyse iterative methods that are based on the sketch-and-solve approach and are designed to replace the deterministic iterative solver for 4D-Var. These methods are highly parallelizable and can reduce the minimization wall-clock time at a price of increased energy consumption when enough computational cores are available. However, the quality of the obtained solution is highly sensitive to the distribution of the eigenvalues of the Hessian matrix of the quadratic cost function. The sketch-and-precondition approach for variational DA using spectral LMPs has been studied with toy dynamical models by [ 10 ] , [ 41 ] , and [ 48 ] . [ 10 ] show that spectral LMPs constructed using randomized eigendecomposition methods can accelerate the solution of an incremental weak-constraint 4D-Var problem. [ 41 ] proposes randomized algorithms for computing a generalized eigendecomposition to construct spectral LMPs when solving the incremental problem, using a variant of the preconditioned conjugate gradient method proposed by [ 11 ] that incorporates the spectral LMP preconditioner [ 26 ] . [ 41 ] also investigates the use of randomized algorithms for the dual problem, and illustrate their effectiveness for the incremental strong-constraint 4D-Var problem. [ 48 ] investigate an adaptive approach to constructing randomized spectral LMPs for the incremental strong-constraint 4D-Var problem, although the number of required sequential matrix-vector products may be not feasible in an operational setting. In this paper, we investigate how the