A Modified Bisecting K-Means for Approximating Transfer Operators: Application to the Lorenz Equations
Andre N. Souza, Simone Silvestri · 2024
Read A Modified Bisecting K-Means for Approximating Transfer Operators: Application to the Lorenz Equations by Andre N. Souza, Simone Silvestri (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-03734.txt.
Introduction
Andre Souza and Simone Silvestri examine how well a data-driven method captures the long-term statistics of the Lorenz system, the three-variable model of chaos. Their approach builds a stand-in for the transfer operator, which tracks how clouds of states spread and settle over time. The dictionary of basis functions is over a million pieces, built from data clusters by a modified splitting routine.
By varying the dictionary size and time step, the authors test how the stand-in reproduces the system's resting distribution, its Koopman eigenfunctions, and the memory of its fluctuations over time. The clustering scheme defines piecewise constant basis functions and scales efficiently to bigger systems. The study speaks to weather and climate modeling, where operators summarize how ensembles evolve without following every trajectory. Getting the dictionary and timescale right, they show, decides whether the summary matches the chaotic behavior.
Catalog record
| CREATOR | Andre N. Souza, Simone Silvestri |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-03734
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Modified Bisecting K-Means for Approximating Transfer Operators: Application to the Lorenz Equations Thanks: Submitted to the editors DATE. Andre N. Souza, Simone Silvestri Abstract We investigate the convergence behavior of the extended dynamic mode decomposition for constructing a discretization of the continuity equation associated with the Lorenz equations using a nonlinear dictionary of over 1,000,000 terms. The primary objective is to analyze the resulting operator by varying the number of terms in the dictionary and the timescale. We examine what happens when the number of terms of the nonlinear dictionary is varied with respect to its ability to represent the invariant measure, Koopman eigenfunctions, and temporal autocorrelations. The dictionary comprises piecewise constant functions through a modified bisecting k-means algorithm and can efficiently scale to higher-dimensional systems. keywords Fokker-Planck Equation, Continuity Equation, Lorenz Equations Funding. This work acknowledges support by Schmidt Sciences, LLC, through the Bringing Computation to the Climate Challenge, an MIT Climate Grand Challenge Project. AMS 68Q25, 68R10, 68U05 1 Introduction In the absence of deterministic predictability, we are often relegated to making statistical statements about the system in question. The lack of predictability can arise due to the intrinsic stochasticity of an underlying equation, the lack of information on precise initial conditions, uncertainty in model parameters, or the non-existence of fundamental guiding physical principles to formulate an evolution equation. In addition to the necessity of a probabilistic perspective in the former cases, switching to a probabilistic perspective offers insight into known deterministic equations with precisely known initial conditions, especially in chaotic and ergodic dynamics. Our work focuses on applying a modified bisecting k-means algorithm to test the limits of the extended dynamic mode decomposition in representing spectral properties of a chaotic dynamical system. We test our methodology on the Lorenz equations [ 25 ] and pose several conceptual questions: 1. What does it mean to approximate the Koopman eigenfunctions of a chaotic dynamical system in the absence of noise? 2. To what extent does increasing the number of terms of a nonlinear dictionary “help”? 3. At what timescale(s) should a Koopman operator be constructed? Concretely, there is an associated Liouville / Fokker-Planck equation to every dynamical system that describes the evolution of a probability density in state space. We construct a data-driven discretization of this equation by leveraging the time series of its dynamical evolution through an extended dynamic mode decomposition. We use a nonlinear dictionary of piecewise constant functions with over 1,000,000 terms to construct a discretization of the Fokker-Planck operator (or, equivalently, the Koopman operator). Instead of focusing on the dynamics of an evolution equation, we focus on the statistics. When the evolution equation is given by a set of n ordinary differential equations, this amounts to an evolution of an n -dimensional partial differential equation. As such, there are many standard methods that can be employed for discretizing a partial differential equation in a low number ( \leq 4 ) of dimensions; however, we wish to employ an extended dynamic mode decomposition to extract a discretization from the dynamics of a time series such as [ 39 , 8 , 11 ] . Traditional methods are applicable for the stochastic Lorenz equations, [ 1 ] , but modern methods [ 32 , 30 , 23 , 15 , 12 ] with rigorous convergence guarantees [ 13 , 7 , 5 , 33 ] are more akin to what will be performed here. Deep learning methods to learn optimal nonlinear dictionaries for observables are also beginning to make progress, see [ 6 ] and [ 3 ] . What we present here is an efficient method for constructing Koopman operators, [ 28 , 14 , 40 , 29 , 12 ] . As noted in [ 34 , 35 ] , using a piecewise constant basis for the nonlinear dictionary allows for computational expedience, which we further accelerate by applying a modified bisecting k-means algorithm. The only limitation of the algorithm is the availability of sufficient data. Other efficient methods have been constructed in the past, see [ 10 , 9 , 21 ] , but have been limited to structured assumptions that are not present in this work. All computations performed in the present work was performed a single cpu core. Our methodology can be applied to any dynamical system; see [ 34 , 35 ] for an example involving the Lorenz equations and the compressible Euler equations on the sphere, but we focus on the Lorenz equations to directly address challenges associated with the representation of Koopman operators in a simplified setting. Preliminary versions of the algorithm here was implemented already for higher-dimensional dynamical (128+ dimensional) systems in [ 16 ] . Past studies of the Lorenz equation in the statistical setting include [ 2 ] where a direct discretization of the Fokker-Planck operator of the stochastic Lorenz equations was implemented. We modify the “bisecting k-means” clustering algorithm, see [ 37 ] , and apply it to constructing a discretization the continuity equation associated with the Lorenz equations. The k-means algorithm, initially introduced in [ 26 ] , has been extended and adapted in various ways, including dynamic modeling for hierarchical clustering [ 22 , 19 ] . The primary difference with our method is that a splitting criterion is introduced, and a cluster is only split if an additional auxiliary condition is met. The result of our chosen criteria is that the partitions have nearly uniform entropy. Thus, unlike k-means, the number of clusters is not specified apriori but rather a fixed probability, p , which empirically yields k\approx 1.5/p clusters for the calculations here. At the end of applying the method, one has an appropriate “classifier” for a given dynamical system state, from whence the construction of the Perron-Frobenius Operator (or its generator) follows, see [ 34 ] . We investigate the effect of data sampling frequency and varying the number of clusters (cells) in a partition. We assess the operator’s convergence in terms of its ability to represent the invariant measure, Koopman eigenfunctions, and the spectra, drawing on the spectral properties of dynamical systems as discussed by [ 27 ] . This paper is organized as follows: Section 2 describes the algorithm, Section 3 covers the application of the algorithm to the Lorenz equations, and Section 4 concludes with future directions. 2 Algorithm We first review the bisecting k-means algorithm as succinctly stated in [ 37 ] : 1. Choose a cluster to split 2. Find two sub-clusters using the basic k-means algorithm (bisect) 3. Repeat step 2 for N times and take the split that produces the clustering with the highest overall similarity 4. Repeat 1, 2, 3 until the desired number of clusters is reached. We make two modifications to this algorithm in order to construct a “classifier” for new data 1. Introduce a splitting criteria to stop applying k-means to a cell. 2. Apply the algorithm to a subset of the full dataset. Thus, the modified algorithm is 1. Determine whether or not a cluster should be split according to a chosen criteria 2. Find sub-clusters using the basic k-means algorithm 3. Repeat steps 1 and 2 until there are no more clusters to split All computations