Watch your neighbors: Training statistically accurate chaotic systems with local phase space information

Joon-Hyuk Ko, Andrus Giraldo, Deok-Sun Lee · 2026

Read Watch your neighbors: Training statistically accurate chaotic systems with local phase space information by Joon-Hyuk Ko, Andrus Giraldo, Deok-Sun Lee (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-14405.txt.

Introduction

Ko, Giraldo and Lee propose a method for training chaotic-system surrogates good both locally and statistically. Long-term chaos cannot be predicted exactly, since small errors grow exponentially. A good stand-in must match local expansion and contraction rates plus long-term stats. Their method covers a chaotic attractor with local patches, tracking how patches expand and contract. Training lowers the maximum mean discrepancy between patch spreads under model and true dynamics. Tests show much better Jacobian scores while staying strong against leading stats learners.

Catalog record

CREATORJoon-Hyuk Ko, Andrus Giraldo, Deok-Sun Lee
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55563
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.14405

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Watch your neighbors: Training statistically accurate chaotic systems with local phase space information Joon-Hyuk Ko, Andrus Giraldo, Deok-Sun Lee Abstract Chaotic systems pose fundamental challenges for data-driven dynamics discovery, as small modeling errors lead to exponentially growing trajectory discrepancies. Since exact long-term prediction is unattainable, it is natural to ask what a good surrogate model for chaotic dynamics is. Prior work has largely focused either on reproducing the Jacobian of the underlying dynamics, which governs local expansion and contraction rates, or on training surrogate models that reproduce the ground-truth dynamics’ long-term statistical behavior. In this work, we propose a new framework that aims to bridge these two paradigms by training surrogate dynamics models with accurate Jacobians and long-term statistical properties. Our method constructs a local covering of a chaotic attractor in phase space and analyzes the expansion and contraction of these coverings under the dynamics. The surrogate model is trained by minimizing the maximum mean discrepancy between the pushforward distributions of the coverings under the surrogate and ground-truth dynamics. Experiments show that our method significantly improves Jacobian accuracy while remaining competitive with state-of-the-art statistically accurate dynamics learning methods. Our code is fully available at https://anonymous.4open.science/r/neighborwatch . 1 Introduction Modeling dynamical systems and generating accurate forecasts are central problems across the sciences. When governing equations are unavailable or intractable, data-driven discovery offers an alternative by training surrogate models from trajectory data. Typically, model parameters are learned by minimizing discrepancies between observed and predicted trajectories, yielding “black-box” models that can match or even outperform approximate theoretical descriptions ( 47 ; 8 ; 41 ; 56 ) . Chaotic systems pose unique challenges for data-driven dynamics as the trajectories of these systems are extremely sensitive to variations in the initial condition and model parameters. As such, unavoidable errors or noise in trajectory measurements or model parameters result in trajectory predictions that err exponentially in time, rendering long-term exact trajectory predictions fundamentally impossible. While one can alternatively optimize models based on their short-term predictions alone, models trained this way are myopic, quickly outputting unrealistic or diverging solutions when rolled out into the future ( 36 ; 28 ; 48 ; 34 ) . This incompatibility between trajectory-based optimization and chaotic dynamics necessitates a reevaluation of what constitutes a good surrogate model for chaos. Recent works in the machine learning community have focused on training models that are "statistically accurate", meaning that even though the long-time model trajectory predictions cannot match that of the ground truth, expectation values computed along these trajectories must agree ( 30 ; 45 ; 48 ) . The validity of such methods stems from the fact that many chaotic systems possess physical measures that are invariant with respect to their dynamics and are ergodic inside their chaotic attractor. Therefore, long-time trajectory statistics are invariant, global properties of these chaotic dynamics, serving as well-defined targets for the dynamics discovery task. An alternate line of thought can be found in the dynamical systems literature, where the goal was to train surrogate models that can accurately reproduce the Jacobian of the ground-truth dynamical equations ( 2 ; 42 ; 40 ; 18 ) . This was largely motivated by the fact that Jacobians provide information about contracting and repelling dynamics of the phase space, which in turn give rise to the key characteristics of chaos, including the sensitivity to initial trajectory perturbations ( 22 ) . From an alternative standpoint, the recent work of Eisen et al. ( 17 ) has also highlighted the importance of learning accurate Jacobians for chaotic systems, for its pivotal role in identifying interacting subdomains in complex systems such as the brain. In this work, we aim to bridge the two schools of thought by developing a training method that yields surrogate models for chaotic systems with accurate Jacobians and long-term statistical properties. Our work succeeds that of Park et al. ( 44 ) , where the connection between conditioning models with Jacobian information and their capability to reproduce accurate long-term statistical behaviors was also explored. However, their method relied on an oracle supplying the value of the ground-truth Jacobians, making it unsuitable for real-world applications. Contributions We propose a novel framework to train Neural ODEs on chaotic data that are statistically accurate and properly capture the local expansion and contraction of the chaotic attractor. We achieve this by focusing on how local sets evolve in time and developing a specialized loss function that regularizes training with this information. By explicitly accounting for noise during algorithm development, our experiments show that the method yields greatly improved Jacobians, even for noisy data, while retaining statistical accuracy. This setting also better reflects realistic applications, where measurements are corrupted by observational noise and the ground-truth dynamics are unavailable, thereby demonstrating the robustness and practical versatility of our approach. 2 Background We consider dynamical systems of the form \displaystyle\frac{d\bm{u}}{dt}=f(\bm{u}(t)), (1) where \bm{u}(t)\in\mathbb{R}^{d} is the time-dependent state vector, and f:\mathbb{R}^{d}\rightarrow\mathbb{R}^{d} is a sufficiently smooth function. Eq. 1 encompasses a wide variety of systems, including autonomous ordinary differential equations (ODEs), non-autonomous ODEs, 1 1 1 By introducing an augmented state vector \bm{v}=[t,\bm{u}]^{\intercal} ( 51 ) . and spatial discretization of partial differential equations (PDEs). Associated with Eq. 1 is the time- T map \phi_{T}:\mathbb{R}^{d}\rightarrow\mathbb{R}^{d} , defined by \phi_{T}(\bm{u}_{0}) as the state of the system obtained by evolving the initial condition \bm{u}_{0} for time T ( 26 ) . That is, for any solution \bm{u}(t) with \bm{u}(0)=\bm{u}_{0}\in\mathbb{R}^{d} of Eq. 1 , \phi_{T}(\bm{u}_{0}) is effectively \phi_{T}(\bm{u}_{0}):=\bm{u}(T)=\bm{u}_{0}+\int_{0}^{T}f\left(\bm{u}(t)\right)dt. Since f is smooth, then \phi_{T} is a diffeomorphism. Notice also that under this notation, the time- nT map, for n\in\mathbb{N} satisfies \phi_{nT}=\phi_{T}\circ...\circ\phi_{T}=\phi^{n}_{T}; that is, it is n -fold composition of the time- T map. We are primarily interested in dissipative systems with a compact attracting invariant set \mathcal{A}\subset\mathbb{R}^{d} . Within this class, we focus on chaotic attractors, for which the dynamics on \mathcal{A} exhibit sensitivity to initial conditions and aperiodic behavior; see 3 for a more formal introduction. In particular, we consider chaotic attractors that support a physical measure \mu ( 55 ) . Any time T -map is measurable under \mu , and \mu is invariant under any time- T map, i.e., \mu(\phi^{-1}_{T}(B))=\mu(B),\quad\text{for all }T>0\text{ and all Borel sets }B\subset\mathbb{R}^{d}. Furthermore, there exists a positive Lebesgue measure set V\subset\mathbb{R}^{d} such that for any continuous function g:\mathbb{R}^{d}\rightarrow\mathbb{R} , \lim_{n\rightarrow\infty}\frac{1}{n}\sum^{n-1}_{i=0}g(\phi^{i}_{T}(x))=\int_{\mathcal{A}}gd\mu for every x\in V. Since the support of \mu is \mathcal{A} , it follows that \mu(\mathcal{A})=1 and \mu(\mathbb{R}^{d}\setminus\mathcal{A})=0 . Associated with \mu and the map \phi_{T} is the pushforward measure (\phi_{T})_{\#}\mu , defined on the Borel \sigma -algebra of \mathbb{R}^{d} by (\phi_{T})_{\#}\mu(B)=\mu\big(\phi_{T}^{-1}(B)\big), for all Borel sets B\subset\mathbb{R}^{d} . The pushforward (\phi_{T})_{\#}\mu is again a measure. Moreover, since \mu is invariant under \phi_{T} , it follows that (\phi_{T})_{\#}\mu=\mu . Consequently, for every n\in\mathbb{N} , we have (\phi_{nT})_{\#}\mu=(\phi_{T}^{n})_{\#}\mu=\mu ; that is, the \mu is invariant under all iterates of the time- T map. 3 Learning accurate surrogate dynamics models for chaos In this work, we focus on the problem of training surrogate dynamics models for chaotic systems using trajectory measurements on the chaotic attractor. One powerful framework for learning continuous-time dynamical systems is the neural ordinary differential equation (Neural ODE) ( 10 ; 31 ) , where a neural network f_{\bm{\theta}}:\mathbb{R}^{d}\rightarrow\mathbb{R}^{d} with

Read the complete text