Adaptive Nonlinear Data Assimilation through P-Spline Triangular Measure Transport
Berent Å. S. Lunde, [2mm] Department of InformaticsUniversity of BergenBergen, Norway, Maximilian Ramgraber · 2026
Read Adaptive Nonlinear Data Assimilation through P-Spline Triangular Measure Transport by Berent Å. S. Lunde, [2mm] Department of InformaticsUniversity of BergenBergen, Norway, Maximilian Ramgraber (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-19058.txt.
Introduction
Lunde and Ramgraber adapt nonlinear data assimilation to pick its own level of complexity. Linear methods are too crude for skewed data, while full nonlinear ones cost too much. Their transport method maps data in a flexible triangular form. Too much freedom overfits, and too little misses structure. Their algorithm uses spline bases and a score that tracks complexity as a smooth dial. Gradient steps then tune the map with no hand-set knobs. Tests include a large groundwater model with skewed, nonlinear behavior.
Catalog record
| CREATOR | Berent Å. S. Lunde, [2mm] Department of InformaticsUniversity of BergenBergen, Norway, Maximilian Ramgraber |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46116 |
| LICENSE | http://creativecommons.org/licenses/by-sa/4.0/ |
| RIGHTS | CC BY SA |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.19058
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Adaptive Nonlinear Data Assimilation through P-Spline Triangular Measure Transport Berent Å. S. Lunde, [2mm] Department of InformaticsUniversity of BergenBergen, Norway, Maximilian Ramgraber Abstract Non-Gaussian statistics are a challenge for data assimilation. Linear methods oversimplify the problem, yet fully nonlinear methods are often too expensive to use in practice. The best solution usually lies between these extremes. Triangular measure transport offers a flexible framework for nonlinear data assimilation. Its success, however, depends on how the map is parametrized. Too much flexibility leads to overfitting; too little misses important structure. To address this balance, we develop an adaptation algorithm that selects a parsimonious parametrization automatically. Our method uses P-spline basis functions and an information criterion as a continuous measure of model complexity. This formulation enables gradient descent and allows efficient, fine-scale adaptation in high-dimensional settings. The resulting algorithm requires no hyperparameter tuning. It adjusts the transport map to the appropriate level of complexity based on the system statistics and ensemble size. We demonstrate its performance in nonlinear, non-Gaussian problems, including a high-dimensional distributed groundwater model. Keywords Data assimilation \cdot Triangular measure transport \cdot Information criterion \cdot P-Splines 1 Introduction Ensemble data assimilation is an important tool for statistical inference in high-dimensional dynamical systems. It combines model predictions with observations to estimate uncertain states and parameters, and it is widely used in geoscience, engineering, and environmental modeling ( 6 ; 13 , e.g., ) . In many applications, forward models are nonlinear and prior distributions are non-Gaussian. Consequently, posterior distributions may exhibit skewness, multimodality, and nonlinear dependence structure. Classical ensemble methods, including ensemble filters and smoothers ( 12 ; 11 ) and iterative ensemble smoothers ( 10 ; 32 ) , usually rely on linear updates and repeated forward model evaluations. While effective in near linear-Gaussian settings, these methods do not in general produce reliable posterior samples and may require multiple sequential simulations of the forward model. Triangular transport maps provide a promising framework for nonlinear sampling-based inference ( 28 ) . A triangular transport map constructs a bijection between a target distribution of interest and a simple user-defined reference measure. Once learned, it enables target density evaluations, unconditional sampling, and conditional sampling without additional forward model runs. In nonlinear settings, transport maps can characterize complex posterior structure while retaining computational tractability. The success of triangular transport depends critically on controlling map complexity. Overly restrictive maps reproduce the limitations of linear–Gaussian approximations and fail to capture non-Gaussian structure. By contrast, overly nonlinear updates may overfit to sampling noise and incur unfavourable bias-variance tradeoffs. This challenge has motivated the development of adaptation strategies balancing approximation accuracy and statistical stability. Existing adaptation approaches are based on greedy selection over discrete model classes or structurally constrained Bayesian formulations. Greedy strategies such as 3 incrementally expand the function space and refit the map at each stage, which can become computationally expensive in high dimensions. Bayesian structural approaches such as 16 introduce sparsity and scalability (in particular for settings like random fields) through prior assumptions on the map, but restrict the functional form of the transformation. In this work, we develop a continuous complexity adaptation framework for triangular transport maps. We parametrise map components within a family of functions indexed by a smoothness parameter and formulate complexity selection as the optimisation of this smoothing parameter over an information criterion. The resulting adaptation objective admits efficient gradient-based exploration of the smoothing parameter, enabling practical application in high-dimensional ensemble settings. The remainder of the paper is organised as follows. Section 2 reviews sampling-based inference and ensemble data assimilation with triangular transport maps. Section 3 introduces the proposed gradient-based adaptation framework. Section 4 presents numerical examples, including a distributed groundwater flow model. Section 5 concludes. 2 Sampling based inference through triangular transport The following section introduces transport of measure using triangular transport maps in the context of sampling based Bayesian inference and ensemble data assimilation ( 28 ) . For a general introduction and overview of the capabilities of triangular transport, we refer to 24 . 2.1 Change of measure Let x\in\mathbb{R}^{d} be a continuous random variable with density \pi(x) , which we refer to as the target density . We assume that \pi is not available in closed form, but that we have access to independent samples \{x^{(i)}\}_{i=1}^{n} drawn from \pi . Let S:\mathbb{R}^{d}\rightarrow\mathbb{R}^{d} be a continuously differentiable and invertible map. The map S transforms x into a new random variable \displaystyle z=S(x), (1) which we require to follow a prescribed reference density \eta(z) . Throughout this work, we take \eta to be the multivariate standard Gaussian, which is a product measure with independent components and admits efficient sampling. Because S is invertible, it induces a change of measure between \pi and \eta . Specifically, the change-of-variables formula gives \displaystyle\pi(x) \displaystyle=\eta\!\left(S(x)\right)\left|\det\nabla S(x)\right|, (2) \displaystyle\eta(z) \displaystyle=\pi\!\left(S^{-1}(z)\right)\left|\det\nabla S^{-1}(z)\right|. (3) If S exactly transports \pi to \eta , then the pushforward of \pi under S equals \eta , which we denote by \displaystyle S_{\#}\pi=\eta. (4) Conversely, the inverse map S^{-1} pulls \eta back to \pi , denoted via S^{\#}\eta=\pi In practice, we construct an approximation S from a finite ensemble. The induced density, S^{\#}\eta , then serves as an approximation to the unknown target density \pi . We refer this as the pullback density induced by S , while the density of S(x) defines the corresponding pushforward density . When S approximates the exact transport, these induced densities approximate p and \eta , respectively. Our objective is therefore to construct a map S that transports the ensemble distribution as closely as possible to the reference measure. Once such a map is available, the change-of-measure relationship provides approximate density evaluation of the target and enables sampling from the induced pullback distribution via the inverse map. 2.2 Triangular maps The change-of-measure formulation does not uniquely determine the transport map S . To obtain a structured/modular(?) and computationally tractable representation, we adopt a triangular construction known as the Knothe-Rosenblatt rearrangement ( 25 ) . The map S is (lower) triangular if \displaystyle S(x)=\begin{bmatrix}[l]S_{1}(x_{1})\\ S_{2}(x_{1},x_{2})\\ \vdots\\ S_{d}(x_{1},\ldots,x_{p})\end{bmatrix}, (5) so that each component S_{j}:\mathbb{R}^{j}\mapsto\mathbb{R} depends only on the first j variables. If each S_{j} is strictly increasing in its last argument x_{j} , the map is bijective and continuously invertible. The Jacobian of a triangular map is lower triangular, and its determinant simplifies to \displaystyle\det\nabla S(x)=\prod_{j=1}^{d}\frac{\partial S_{j}(x_{1},\ldots,x_{j})}{\partial x_{j}}. (6) Thus the log-determinant reduces to a sum of one-dimensional (well behaved log) derivatives, which is essential for scalable learning and inference. Because we choose the reference \eta to be the multivariate standard Gaussian, its components are independent. Sparsity in the triangular map therefore corresponds directly to conditional independence structure in the target distribution. This relationship enables high-dimensional problems to be decomposed into a sequence of low-dimensional transformations ( 29 ) , which is particularly advantageous in ensemble data assimilation ( 19 ) . This relationship also places an importance on the ordering of x , as this matters for conditional independence (and thus the sparsity of S_{j} ). 2.3 Sampling the conditional and ensemble data assimilation A key advantage of triangular transport maps is that they enable efficient conditional sampling when the reference measure is a product of marginal distributions. Partition the state as x=(x_{a},x_{b}) , where x_{a}^{*} is