A Dynamic Subspace Approach for Low-rank Approximation of Large-scale Nonlinear Systems
Jack DeChant and Rudy Geelen, Shane A. McQuarrie, Johann Guilleminot · 2026
Read A Dynamic Subspace Approach for Low-rank Approximation of Large-scale Nonlinear Systems by Jack DeChant and Rudy Geelen, Shane A. McQuarrie, Johann Guilleminot (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-26025.txt.
Introduction
DeChant, Geelen, McQuarrie and Guilleminot approximate huge nonlinear systems with a moving basis. A fixed low-dimensional basis must swell in rank to track shifting physics, a snag called the Kolmogorov barrier. The authors trace the basis along a geodesic path on the Grassmannian manifold, a space of subspaces. Splitting shape drift from state change keeps rank low. Costs stay independent of full state size, and tests on transport flow and a turbulent wake bear the method out.
Catalog record
| CREATOR | Jack DeChant and Rudy Geelen, Shane A. McQuarrie, Johann Guilleminot |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42230 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.26025
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Dynamic Subspace Approach for Low-rank Approximation of Large-scale Nonlinear Systems Jack DeChant and Rudy Geelen, Shane A. McQuarrie, Johann Guilleminot Abstract We present a dynamic subspace approach for efficiently approximating large-scale systems by learning time-continuous trajectories on the Grassmannian manifold. By parameterizing a low-dimensional basis as a geodesic path, the method allows for adaptive tracking of evolving physics. Our approach decouples the geometric drift of the subspace from the intrinsic state evolution. This avoids the typical rank inflation required by static low-dimensional approximation methods to maintain accuracy, effectively breaking the Kolmogorov barrier in transport-dominated phenomena. To ensure scalability for high-dimensional data, the optimization is performed in a reduced feature space, rendering the computational cost independent of the large original state dimension. Numerical results for a 1D transport equation and a large-scale turbulent airfoil wake demonstrate that this dynamic subspace approach achieves higher accuracy than static linear approximations at equivalent ranks, positioning it as a robust and scalable method for the low-rank modeling of complex, non-stationary dynamical systems. 1 Nomenclature t = Time variable \tau = Normalized time variable N = Dimension of the full-order state vector K = Number of training snapshots r = Reduced state dimension n_{f} = Number of feature modes used for scalable optimization \mathbf{q}(t) = State vector, \mathbf{q}(t)\in\mathbb{R}^{N} \bar{\mathbf{q}} = Reference state, \bar{\mathbf{q}}\in\mathbb{R}^{N} \hat{\mathbf{q}}(t) = Generalized coefficient vector, \hat{\mathbf{q}}(t)\in\mathbb{R}^{r} \mathbf{V}(\tau) = Time-varying basis matrix on the Grassmannian, \mathbf{V}(\tau)\in\mathbb{R}^{N\times r} \boldsymbol{\Gamma} = Initial “velocity” matrix (tangent vector), \boldsymbol{\Gamma}\in\mathbb{R}^{n\times r} \theta_{1},\theta_{2},\ldots,\theta_{r} = Principal angles, \theta_{i}\in\mathbb{R} \boldsymbol{\Theta} = Diagonal matrix of principal angles, \boldsymbol{\Theta}=\operatorname{diag}(\theta_{1},\theta_{2},\ldots,\theta_{r})\in\mathbb{R}^{r\times r} \mathbf{V}_{1},\mathbf{V}_{2} = Orthogonal rotation matrices in full state space, \mathbf{V}_{i}\in\mathbb{R}^{N\times r} \boldsymbol{\Omega} = Joint full rotation matrix, \boldsymbol{\Omega}=[~\mathbf{V}_{1}~~\mathbf{V}_{2}~]\in\mathbb{R}^{N\times 2r} \tilde{\mathbf{V}} = Matrix of feature modes (leading left singular vectors), \tilde{\mathbf{V}}\in\mathbb{R}^{N\times n_{f}} \mathbf{T}_{1},\mathbf{T}_{2} = Orthogonal rotation matrices in feature space, \mathbf{T}_{i}\in\mathbb{R}^{n_{f}\times r} \mathbf{T} = Joint feature rotation matrix, \mathbf{T}=[~\mathbf{T}_{1}~~\mathbf{T}_{2}~]\in\operatorname{St}(n_{f},2r) \mathbf{Q} = Snapshot matrix of observed states, \mathbf{Q}\in\mathbb{R}^{N\times K} \mathbf{Y} = Feature space representation of the snapshots, \mathbf{Y}\in\mathbb{R}^{n_{f}\times K} \mathbf{I}_{a} = a\times a identity matrix \mathbf{C} = Cosines of the principal angles at K time instances, \mathbf{C}\in\mathbb{R}^{K\times r} \mathbf{S} = Sines of the principal angles at K time instances, \mathbf{S}\in\mathbb{R}^{K\times r} \odot = Hadamard (elementwise) product \|\cdot\|_{F} = Frobenius norm \operatorname{St}(m,n) = Stiefel manifold of m\times n matrices with orthonormal columns \mathcal{M} = Product manifold \operatorname{St}(n_{f},2r)\times\mathbb{R}^{r} , the search space for the optimization problem \mathcal{G}(r,n) = Grassmannian manifold of r -dimensional subspaces in \mathbb{R}^{n} \mathcal{T}_{\mathcal{V}}\mathcal{G}(r,n) = The tangent space of the Grassmannian manifold at the subspace \mathcal{V}\in\mathcal{G}(r,n) 2 Introduction Effective low-dimensional approximation is a key component of many applications in data compression, machine learning, and model reduction [ benner2015pmorsurvey ] . Common low-dimensional approximation methodologies, ranging from classical Proper Orthogonal Decomposition (POD) [ sirovich1987turbulence , berkooz1993proper ] to modern neural autoencoders [ lee2020model ] , typically seek a stationary approximation space or latent coordinate system. However, such static representations are often inadequate for capturing transient, transport-dominated phenomena in which physical modes or coherent structures drift over time. To address this lack of temporal adaptability and the resulting geometric misalignment, we propose a mathematical framework that replaces fixed projection paradigms with dynamic subspaces. By utilizing time-continuous trajectories on the Grassmannian manifold, we reframe dimensionality reduction as a differential-geometric task, which allows the approximation space to evolve alongside the high-dimensional state being described. This approach disambiguates the geometric drift of the subspace from the intrinsic evolution of the low-dimensional coordinates, ensuring the approximation remains synchronized with the instantaneous physics and providing a robust, scalable framework for low-dimensional modeling of complex systems that exceed the capabilities of stationary approximation spaces. Static low-dimensional approximation methods involve a fundamental tradeoff between accuracy and interpretability. Linear or affine approximations such as POD, balanced truncation [ gugercin2004balancedtruncation , gosea2022datadrivenbt ] , and the reduced basis method [ hesthaven2022reduced ] build a linear subspace to capture the dominant behavior of the trajectory being approximated. Linear methods are highly interpretable, tend to be computationally straightforward, and are well suited for applications such as projection-based model reduction; on the other hand, many nonlinear systems cannot be well represented in a linear subspace unless the dimensionality of that subspace is large, diminishing any efficiency gains provided by the approximation. This limitation is known as the Kolmogorov barrier in the literature [ peherstorfer2022breaking ] . Nonlinear approximation methods can overcome this fundamental expressivity limitation, and thereby mitigate the Kolmogorov barrier, at the expense of some interpretability and/or computational efficiency. See, for instance, [ barnett2022quadratic , geelen2023operator , geelen2024learning , schwerdtner2024greedyquad ] for quadratic approximations, [ scholkopf1997kernel , diaz2025kernelmanifold ] for kernel-based methods, [ lee2020model , fries2022lasdi ] for model reduction applications with neural autoencoders, and [ peherstorfer2022breaking ] for a note on the Kolmogorov barrier as it relates to nonlinear model reduction. These and related machine learning techniques offer improved data compression but rely fundamentally on fixed embeddings that do not adapt to the state as time evolves. In this work, we consider time-continuous subspace approximation methods, which represent the evolving state as linear combinations of basis functions that evolve with time. The motivation behind this structure is that nonlinear processes can often be approximated well in linear subspaces locally in time , even when approximations in a single, global reduced space are inefficient [ hesthaven2026nonlinearmodelreductiontransportdominated ] . Time-continuous linear approximation therefore addresses the limitations of static linear approximation methods while remaining highly interpretable. There are several existing strategies across many application domains for introducing time dependence into low-dimensional approximations. Early foundations for this idea can be found in the work on finite element methods with moving nodes [ miller1981moving ] , which represents one of the first Galerkin frameworks where both the coefficients and the basis functions are permitted to vary simultaneously in time. In the signal processing community, there exists a rich history of dynamic subspace tracking methods designed to follow non-stationary data streams in real time [ yang1995projection ] . Other perspectives are provided by dynamic low-rank approximations which parametrize the solution as a low-rank matrix and evolve its factors over time [ koch2007dynamical ] . These approaches rely on the Dirac–Frenkel variational principle to project full dynamics onto the tangent space of a fixed-rank matrix manifold. This concept is closely related to the dynamic orthogonal decomposition developed for reduced-order modeling of stochastic differential systems, where the low-rank structure is extracted directly from the governing operators to capture complex transient or stochastic behavior [ sapsis2009dynamically , babaee2016minimization , patil2020real , ramezanian2021fly ] . In the model reduction community, one prominent approach focuses on mimicking transport dynamics to evolve the reduced space by utilizing techniques such as optimal transport [ iollo2014advection ] , approximated Lax pairs [ gerbeau2014approximated ] , or characteristic-based transport [ rim2023manifold ] . Alternatively, time-dependent modes can be evolved through instantaneous residual minimization [ black2020projection ] or by periodically reverting to the full model to generate new snapshots [ rapun2010reduced ] . Another perspective is to perform efficient low-rank updates to the reduced-order model and the approximation space in a way that integrates real-time information, such as full-order model residuals or incomplete state fields, without a complete reconstruction of the reduced model. This is exemplified by the work of Peherstorfer and Willcox for linear and nonlinear problems [ peherstorfer2015dynamic , peherstorfer2015online