Efficient streaming dynamic mode decomposition

Aditya Kale, Marcos Netto, Xinyang Zhou · 2025

Read Efficient streaming dynamic mode decomposition by Aditya Kale, Marcos Netto, Xinyang Zhou (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-03770.txt.

Introduction

Aditya Kale, Marcos Netto, and Xinyang Zhou streamline a streaming method that learns how systems move, in a 2025 paper. Dynamic mode decomposition pulls simple motion patterns out of data as it arrives. The streaming version must update on the fly without storing everything. The classic setup keeps redundant bases, which wastes work and memory.

Their reformulation keeps just one orthonormal basis for the whole update. That change cuts computing and storage needs by a constant factor. Tests on standard example systems show the leaner method keeps the same accuracy as the older one. The gain matters for live monitoring tasks, where data never stop and budgets for computing stay tight. The paper offers a drop-in improvement rather than a new theory.

Catalog record

CREATORAditya Kale, Marcos Netto, Xinyang Zhou
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-03770

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Efficient streaming dynamic mode decomposition Aditya Kale, Marcos Netto, Xinyang Zhou Abstract We propose a reformulation of the streaming dynamic mode decomposition method that requires maintaining a single orthonormal basis, thereby reducing computational redundancy. The proposed efficient streaming dynamic mode decomposition method results in a constant-factor reduction in computational complexity and memory storage requirements. Numerical experiments on representative canonical dynamical systems show that the enhanced computational efficiency does not compromise the accuracy of the proposed method. I Introduction Dynamic mode decomposition (DMD) has been widely used to reveal the discrete spectrum inherent in complex dynamical systems [ 1 ] . Applications range from epidemiology [ 2 ] and neuroscience [ 3 ] to power and energy systems [ 4 ] and control [ 5 ] , showcasing its prominence. Over the years, various algorithms have been proposed to enhance or extend the original DMD method [ 6 ] , some of which are referenced here. For a more comprehensive review, interested readers are directed to [ 7 ] . The original DMD method [ 6 ] and most of its variations have been developed for batch processing —that is, in plain terms, to collect data first and then analyze it. Conversely, DMD methods tailored to stream processing —in which case data streams are sequentially analyzed as they arrive, one snapshot at a time—have been relatively less explored. Unlike batch-processing DMD algorithms that require access to the full dataset upfront, stream-processing algorithms must output results continuously as new data becomes available. This shift in computing paradigm, from batch processing to real-time insights in data [ 8 ] , requires a reformulation of the batch algorithm. The streaming dynamic mode decomposition (sDMD) method [ 9 ] offers such reformulation, introducing fundamental structural changes to support stream processing. The subsequent application of sDMD to characterize and distill the dynamics of a wind farm [ 10 ] exemplifies its potential for real-time analysis of energy systems and beyond. A few select works build upon the original sDMD [ 9 ] method, which, like its batch-processing counterpart algorithm [ 6 ] , invokes a standard least-squares solution [ 11 ] . A straightforward modification that replaces a least-squares solution with a total least-squares [ 12 ] solution enhances the sDMD performance in extracting interpretable information from noisy data, as demonstrated in [ 13 ] using experimental time-resolved particle image velocimetry measurements. Leveraging incremental singular value decomposition [ 14 ] —a method for updating a matrix’s prior singular value decomposition as new data arrives, rather than computing it from scratch each time—represents another advancement in sDMD. Recall that the original DMD [ 6 ] and sDMD [ 9 ] both utilize singular value decomposition as part of their algorithm. Not only does the incremental singular value decomposition fit naturally within the stream processing paradigm, but it also lends itself to sparsification [ 15 ] after the incremental process, as demonstrated in [ 16 ] . Yet another advancement to the class of stream-processing DMD methods [ 17 , 18 ] leverages the matrix inversion lemma , also known as the Sherman-Morrison-Woodbury formula or Woodbury matrix identity, to compute the inverse of a rank- n update to a matrix whose inverse has previously been calculated. This development enabled the introduction of a weighting scheme to emphasize recent data and a windowed approach, effectively adapting the algorithm to evolving system dynamics [ 17 ] . Building upon [ 16 ] and [ 17 ] , the work in [ 19 ] combines incremental singular value decomposition with the use of the matrix inversion lemma, thereby extending its applicability to dynamical systems with control inputs. A formulation tailored explicitly to low-rank datasets also exists [ 20 ] , designed for applications where the number of snapshots is less than the number of state variables. In this letter, we are particularly interested in improving the computational efficiency of sDMD. We observe that the core functionality of sDMD is based on expanding and rotating two separate orthonormal bases corresponding to the column spaces of the same underlying dynamical system—an approach that introduces redundancy. Motivated by this insight, the primary contribution of this work is to demonstrate that maintaining only a single orthonormal basis is sufficient to characterize the system dynamics accurately. This modification eliminates the need for dual basis updates, resulting in a constant-factor reduction in computational complexity compared to sDMD. We refer to the proposed method as efficient streaming dynamic mode decomposition (esDMD), as in computer science, efficient computation refers to designing algorithms and systems that perform calculations with minimal time and memory usage. This letter proceeds as follows. Section II briefly introduces the derivation of the linear operators underlying DMD [ 6 ] and sDMD [ 9 ] . Section III presents our main contribution, detailing modifications to the sDMD formulation. Section IV compares the proposed esDMD with sDMD and benchmarks these methods against the batch-processing DMD, using canonical systems as testbeds. Section V concludes this letter and outlines potential directions for future research. I-A Notation Lowercase (uppercase) boldface letters, e.g., \bm{x} ( \bm{X} ), denote vectors (matrices). Vector and matrix slicing follow Python notation; for instance, \bm{X}[:i,\,:j] refers to the submatrix of \bm{X} consisting of its first i rows and first j columns. \bm{X}^{\top} , \bm{X}^{+} , \left\lVert\mathbf{X}\right\rVert_{F} , \mathrm{cols}(\bm{X}) , and \mathrm{span}(\bm{X}) denote, respectively, the transpose, the Moore-Penrose pseudoinverse, the Frobenius norm, the number of columns, and the column space of \bm{X} . \bm{I} is an identity matrix of appropriate dimensions, dictated by the context in which it is used. The symbol \equiv denotes equivalence. The \ell^{2} -norm of a vector \bm{x} is \left\lVert\bm{x}\right\rVert . A vector \bm{x}^{\parallel} is the projection of \bm{x} onto some orthonormal basis. II Preliminaries II-A Batch-processing dynamic mode decomposition (DMD) Let an autonomous dynamical system evolving on a finite, n -dimensional manifold \mathbb{X} be: \bm{x}_{i}=\bm{f}(\bm{x}_{i-1}),\;\quad\text{for discrete time }i\in\mathbb{Z}, (1) where \bm{f}:\mathbb{X}\to\mathbb{X}\subset\mathbb{R}^{n} is a nonlinear, vector-valued map. A set of states \{\bm{x}_{i}\}_{i=1}^{k} , k\geq n , evolving according to ( 1 ) can be used to build the following data matrices: \bm{X}_{k}=\begin{bmatrix}\bm{x}_{1}&\dots&\bm{x}_{k}\end{bmatrix},\quad\bm{Y}_{k}=\begin{bmatrix}\bm{y}_{1}&\dots&\bm{y}_{k}\end{bmatrix}, (2) where \bm{y}_{i}=\bm{x}_{i+1} and every tuple (\bm{x}_{i},\bm{y}_{i}) is called a snapshot pair. The batch-processing DMD computes a linear operator \bm{A}_{k}\in\mathbb{R}^{n\times n} that minimizes, for all snapshot pairs, the cost \displaystyle J=\sum_{i=1}^{k}\left\lVert\bm{y}_{i}-\bm{A}_{k}\,\bm{x}_{i}\right\rVert^{2}=\left\lVert\bm{Y}_{k}-\bm{A}_{k}\,\bm{X}_{k}\right\rVert_{F}^{2}. (3) If the tuples (\bm{x}_{i},\bm{y}_{i}) in ( 2 ) follow a Gaussian distribution, \bm{A}_{k}=\bm{Y}_{k}\,\bm{X}_{k}^{+} (4) is the optimal (maximum likelihood) solution to ( 3 ) [ 11 ] . II-B Projected, lower-dimensional operator Let \bm{X}_{k}=\bm{U}_{x}\,\bm{\Sigma}_{x}\,\bm{V}_{x}^{\top} be the singular value decomposition of \bm{X}_{k}\in\mathbb{R}^{n\times k} ; and for an integer r<n , let \bm{Q}_{\bm{X}_{k}}\in\mathbb{R}^{n\times r} be an orthonormal basis for the column space of \bm{X}_{k} obtained by retaining the first r columns of \bm{U}_{x} . By projecting the operator \bm{A}_{k} ( 4 ) onto this basis as \displaystyle\tilde{\bm{A}}_{k} \displaystyle=\bm{Q}_{\bm{X}_{k}}^{\top}\bm{A}_{k}\,\bm{Q}_{\bm{X}_{k}}=\bm{Q}_{\bm{X}_{k}}^{\top}\,\bm{Y}_{k}\,\bm{X}_{k}^{+}\bm{Q}_{\bm{X}_{k}}, (5) the eigenvalues and eigenvectors of \bm{A}_{k}\in\mathbb{R}^{n\times n} can be computed from those of a much smaller matrix \tilde{\bm{A}}_{k}\in\mathbb{R}^{r\times r} . Note that the amount of storage required to compute \tilde{\bm{A}}_{k} increases as the number of snapshot pairs, k , grows. II-C Streaming dynamic mode decomposition (sDMD) The batch-processing DMD can be reformulated to handle streaming data, where snapshot pairs (\bm{x}_{i},\bm{y}_{i}) are acquired incrementally, one at a time [ 9 ] . Two

Read the complete text