Rigorously Characterizing Dynamics with Machine Learning
Marcio Gameiro 1 , Brittany Gelb 1 , and Konstantin Mischaikow 1 · 2025
Read Rigorously Characterizing Dynamics with Machine Learning by Marcio Gameiro 1 , Brittany Gelb 1 , and Konstantin Mischaikow 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-17302.txt.
Introduction
Marcio Gameiro, Brittany Gelb, and Konstantin Mischaikow addressed a foundational question in twenty twenty-five: what about a dynamical system can be computed from data? Dynamics at the level of invariant sets, the theory's central objects, is known to be not computable in general. The authors recall a coarser description built from order theory and algebraic topology. They prove this characterization can be identified from approximations. That opens a path for machine learning to characterize dynamics with rigor rather than mere fit.
Catalog record
| CREATOR | Marcio Gameiro 1 , Brittany Gelb 1 , and Konstantin Mischaikow 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 81 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-17302
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Rigorously Characterizing Dynamics with Machine Learning Marcio Gameiro 1 , Brittany Gelb 1 , and Konstantin Mischaikow 1 Abstract . The identification of dynamics from time series data is a problem of general interest. It is well established that dynamics on the level of invariant sets, the primary objects of interest in the classical theory of dynamical systems, is not computable. We recall a coarser characterization of dynamics based on order theory and algebraic topology and prove that this characterization can be identified using approximations that can be realized by feedforward neural networks. 1. Introduction The goal of this paper is to present a framework that using machine learning allows for the rigorous characterization of the nonlinear dynamics generated by iterates of a continuous function f defined on a compact subset X of {\mathbb{R}}^{d} . To focus the discussion we present three theorems and discuss their relevance. The first theorem is a classical result from machine learning, the universal approximation theorem [ 16 , 22 ] . Theorem 1.1 . Consider a compact set X\subset{\mathbb{R}}^{d} and assume that f\colon X\to X . Given \rho>0 there exists a fully-connected feedforward neural network G\colon{\mathbb{R}}^{d}\to{\mathbb{R}}^{d} such that \sup_{x\in X}\|f(x)-G(x)\|<\rho . The premise of this paper relies on the existence of the function G from Theorem 1.1 . To simplify the analysis we add the restriction that the activation functions are non-constant and piecewise linear (the results of [ 22 ] guarantee that Theorem 1.1 still apply), which allows us to work with approximating functions of the following form. Theorem 1.2 (Grigsby and Lindsey [ 12 ] ) . Let G\colon{\mathbb{R}}^{d}\to{\mathbb{R}}^{d} be a fully-connected feedforward neural network with piecewise linear activation. Then G is affine-linear on the cells of a realization of {\mathbb{R}}^{d} as a polyhedral complex {\mathcal{P}} . Our strategy is to use G to characterize the dynamics of f . The classical theory of dynamical systems focuses on understanding the existence and structure of invariant sets , i.e., sets of the form S\subset X such that f(S)=S . This leads to a rich mathematical theory but, as we argue below, a theory that is too rich from the perspective of deducing dynamics from data. With regard to the goals of this paper, the fundamental question is: is there a \rho such that G (satisfying the conditions of Theorem 1.1 ) generates the same dynamics as f ? In the classical setting this is equivalent to asking: can we guarantee that f and G are conjugate , i.e., does there exist a homeomorphism h\colon X\to X such that f\circ h=h\circ G? The work of [ 9 ] proves that in general this is not possible via computations. More precisely, regarding their work the authors state “This can be interpreted as saying that there is no method or protocol that involves a countable amount of information and countable number of steps that reliably distinguishes between nonisomorphic ergodic measure preserving transformations. We view this as a rigorous way of saying that the classification problem for ergodic measure preserving transformations is intractable.” An alternative approach is to focus on individual invariant sets. However, as shown by the following example, even this is challenging. Example 1.3 . A trivial example that demonstrates the challenge of identifying invariant sets based on approximations is as follows. Consider f_{\theta}\colon{\mathbb{R}}\to{\mathbb{R}} defined by f_{\theta}(x)=\begin{cases}0&\text{if $x\leq 1/2$}\\ 2x-1&\text{if $1/2\leq x\leq(\theta+1)/2$}\\ \theta&\text{if $x\geq(\theta+1)/2$}\end{cases} and shown in Figure 1 . Observe that if \theta<1 , then f_{\theta} has one fixed point, x=0 ; if \theta>1 , then f_{\theta} has three fixed points, x=0 , x=1 , and x=\theta ; and f_{1} has two fixed points, x=0 and x=1 . x y y=x \frac{1}{2} 1 \theta y=f_{\theta}(x) ((a)) x y y=x \frac{1}{2} 1 1 y=f_{1}(x) ((b)) x y y=x \frac{1}{2} 1 \theta 1 \theta y=f_{\theta}(x) ((c)) Figure 1. (a) The function f_{\theta} for \theta<1 that has a fixed point at 0 . (b) The function f_{1} that has fixed points at 0 and 1 . (c) The function f_{\theta} for \theta>1 that has fixed points at 0 , 1 , and \theta . Returning to the goal of this paper, we are allowed to assume that the map we want to learn the dynamics of is f_{1}\colon{\mathbb{R}}\to{\mathbb{R}} , but we are not allowed to assume that we know the functional form of f_{1} . We are also allowed to assume that we have a finite (but arbitrarily large) set of data \left\{{(x_{k},f_{1}(x_{k}))\mid x_{k}\in[-2,2]}\right\} that can be used to train G\colon{\mathbb{R}}\to{\mathbb{R}} , and that as a result of this training, \sup_{x\in[-2,2]}|f_{1}(x)-G(x)|<\rho . Observe that even for arbitrarily small \rho>0 , we cannot guarantee that G has exactly two fixed points, and therefore we cannot guarantee that we can learn the number of fixed points of f_{1} from G . While Example 1.3 may appear to be too trivial to be of interest, it is indicative of a more serious challenge. Consider a continuous parameterized family of maps f\colon X\times[0,1]^{n}\to X , where for each \lambda\in[0,1]^{n} , f_{\lambda}:=f(\cdot,\lambda) . A parameter value \lambda_{0} is a bifurcation point if for any neighborhood U of \lambda_{0} there exists \lambda\in U such that f_{\lambda} is not conjugate to f_{\lambda_{0}} . In particular, \theta=1 is a bifurcation point in Example 1.3 . As is shown in [ 33 , 34 ] if d\geq 2 (recall that X\subset{\mathbb{R}}^{d} ), then there are parameterized families of maps for which the bifurcation points contain a Cantor set of positive measure. As a consequence, in general it is not possible to identify the dynamics of f via an approximation provided by Theorem 1.1 . We avoid the above mentioned challenges by employing a coarser framework for dynamics that we believe to be sufficiently refined for many applications. Since we do not expect that the typical reader is familiar with this framework and its associated machinery, a significant portion of this paper is spent introducing the necessary definitions and concepts. In particular, in Section 2 we provide precise definitions of the terms used in the following theorem, which is our main result. Theorem 1.4 . Let X\subset{\mathbb{R}}^{d} be a finite union of closed, bounded, convex d -dimensional polytopes. Let f be a continuous function such that f(X)\subset\mathop{\mathrm{int}}\nolimits(X) where \mathop{\mathrm{int}}\nolimits denotes interior. Let ({\mathsf{MR}},\leq_{{\mathsf{MR}}_{f}}) be a Morse representation of f . For each Morse set M\in{\mathsf{MR}} , let {\mathsf{Con}}_{*}(M) denote the homology Conley index of M under the dynamics induced by f . Let G\colon{\mathbb{R}}^{d}\to{\mathbb{R}}^{d} be a fully-connected feedforward neural network with piecewise linear activation such that \sup_{x\in X}\|f(x)-G(x)\|<\rho . If \rho>0 is sufficiently small, then using G we can (i) Compute a Morse graph ({\mathsf{MG}},\leq_{\mathsf{MG}}) for which there exists a poset epimorphism, \nu\colon{\mathsf{MG}}\to{\mathsf{MR}}, and (ii) Use \nu to determine \mathop{\mathrm{Con}_{*}}\nolimits(M) for each M\in{\mathsf{MR}} . An imprecise statement of Theorem 1.4 is as follows. Choose a Morse representation {\mathsf{MR}} (see Definition 2.4 ) for the function f . In general f has many (possibly countably infinitely many) Morse representations, thus the choice of {\mathsf{MR}} can be interpreted as a choice of resolution of the dynamics of f that is of interest. The theorem implies that we can employ a neural network G to (i) Organize the global dynamics of f in terms of its gradient-like behavior, and (ii)