HypER: Hyperbolic Echo State Networks for Capturing Stretch-and-Fold Dynamics in Chaotic Flows

Pradeep Singh, Sutirtha Ghosh, Ashutosh Kumar, Hrishit B P, Balasubramanian Raman · 2025

Read HypER: Hyperbolic Echo State Networks for Capturing Stretch-and-Fold Dynamics in Chaotic Flows by Pradeep Singh, Sutirtha Ghosh, Ashutosh Kumar, Hrishit B P, Balasubramanian Raman (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-18196.txt.

Introduction

Pradeep Singh and his co-authors introduced a new kind of prediction network in 2025 for systems whose behavior changes fast and never repeats. Such chaotic systems are hard to forecast because tiny errors grow fast. Older echo state networks place their units in flat space, which fits the stretching and folding of chaos poorly.

Their design, called HypER, places the units inside a curved ball where links fade with distance. Only the final output layer needs training, which keeps the method simple. Tests on three classic chaotic systems and on real data, such as heart-rate records and sunspot counts, beat older designs over thirty runs each. The team also proves a lower bound on how fast its states drift apart.

Catalog record

CREATORPradeep Singh, Sutirtha Ghosh, Ashutosh Kumar, Hrishit B P, Balasubramanian Raman
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-18196

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

HypER: Hyperbolic Echo State Networks for Capturing Stretch-and-Fold Dynamics in Chaotic Flows Pradeep Singh, Sutirtha Ghosh, Ashutosh Kumar, Hrishit B P, Balasubramanian Raman Abstract Forecasting chaotic dynamics beyond a few Lyapunov times is difficult because infinitesimal errors grow exponentially. Existing Echo State Networks (ESNs) mitigate this growth but employ reservoirs whose Euclidean geometry is mismatched to the stretch–and–fold structure of chaos. We introduce the Hyperbolic Embedding Reservoir ( HypER ), an ESN whose neurons are sampled in the Poincaré ball and whose connections decay exponentially with hyperbolic distance. This negative‑curvature construction embeds an exponential metric directly into the latent space, aligning the reservoir’s local expansion–contraction spectrum with the system’s Lyapunov directions while preserving standard ESN features such as sparsity, leaky integration and spectral‑radius control. Training is limited to a Tikhonov-regularised read-out. On the chaotic Lorenz-63 and Rössler systems, and the hyperchaotic Chen–Ueta attractor, HypER consistently lengthens the mean valid-prediction horizon beyond Euclidean and graph-structured ESN baselines, with statistically significant gains confirmed over 30 independent runs; parallel results on real-world benchmarks—including heart-rate variability from the Santa Fe and MIT-BIH datasets, and international sunspot numbers—corroborate its advantage. We further establish a lower bound on the rate of state divergence for HypER, mirroring Lyapunov growth. In the interest of reproducibility, we release our implementation at github.com/deepdyn/HypER and provide a full technical appendix (proofs, ablations, hyperparameters) in the arXiv preprint at DOI: 10.48550/arXiv:XXXX.XXXXX . † † paperid: 8277 1 Introduction Neural circuits in the brain are often conceptualized as high-dimensional dynamical systems that can host attractor states—regions in phase space where network activity converges or persists over time—and these attractors underlie vital processes such as working memory, decision-making, and robust perception [ Hopfield(1982) , Seung(1996) ] . Electrophysiological and calcium‑imaging evidence further indicates that many cortical microcircuits operate near the edge of chaos, where trajectories explore a rich repertoire of quasi‑stable states yet remain exquisitely sensitive to perturbations [ Buonomano and Mauk(1994) , Mante et al.(2013)Mante, Sussillo, Shenoy, and Newsome ] . Capturing such behaviour is notoriously difficult because any modelling or measurement error is amplified exponentially: if two initial conditions differ by \|\delta x_{0}\| , their separation grows on average as \|\delta x_{t}\|\!\approx\!\|\delta x_{0}\|\exp(\lambda_{\max}t) wherever the largest Lyapunov exponent (LLE) \lambda_{\max} is positive. Beyond a few Lyapunov times accurate prediction becomes impossible unless the model itself encodes the local “stretch–and–fold” geometry that underlies chaotic divergence. From a theoretical standpoint, capturing these highly sensitive, self-organizing phenomena calls for a modeling framework that can explicitly reflect the underlying geometry of exponential separation. Reservoir computing (RC), and especially Echo State Networks (ESNs), has emerged as a promising data‑driven framework for chaos forecasting because it replaces costly recurrent training with a fixed nonlinear reservoir and a linear read‑out [ Jaeger(2001) ] . ESNs can learn short‑term structure and even replicate Lyapunov spectra of benchmark systems, yet the typical prediction horizon remains limited to roughly 5-8 Lyapunov times [ Fan et al.(2020)Fan, Jiang, Zhang, Wang, and Lai , Jaurigue(2024) ] . A plausible reason is geometric: conventional reservoirs are embedded in flat Euclidean space or simple random graphs and therefore lack an explicit inductive bias for the exponential expansion and contraction intrinsic to chaotic flows. (a) Standard ESN (b) Proposed HypER Figure 1: Two‑dimensional PCA projections of high-dimensional reservoir states ( no read-out training applied ) for (a) a standard ESN and (b) the proposed HypER, when both networks are driven by the Lorenz system. Hyperbolic spaces with constant negative curvature are characterized by metric properties that mirror exponential growth: distances and volumes expand exponentially with radius, unlike Euclidean spaces where growth is polynomial [ Zhang et al.(2023)Zhang, Rich, Lee, and Sharpee ] . Intuitively, a small change in coordinates on a hyperbolic manifold can produce a large change in geodesic distance, akin to how a small state perturbation in a chaotic system leads to a large future divergence. This makes hyperbolic geometry a natural substrate to model the local instabilities of chaos. Yet, most sequential models, bound to flat Euclidean latents, struggle to reproduce this exponential pull—begging a sharper question: Does wiring a reservoir in hyperbolic space unlock a longer glimpse into chaotic futures? We contend that a negatively curved latent space supplies exactly that bias. In the Poincaré ball model, hyperbolic sampling preserves the natural volume element, so nodes near the boundary correspond to rapidly diverging directions while central nodes capture contracting modes. Empirical tests on the Lorenz–63, Rössler, and Chen-Ueta attractors show that a modest‑sized HypER consistently extends the valid‑prediction window and slows error growth relative to Euclidean and graph‑structured baselines. These results position hyperbolic geometry as a principled lever for long‑range prediction in both neuroscience and nonlinear‑dynamics applications. Summary of Key Contributions. We present HypER , the first reservoir computer whose neurons are embedded in the Poincaré ball and whose recurrent weights decay exponentially with hyperbolic distance. This curvature-aware wiring installs an inductive bias missing from Euclidean or graph-structured ESNs and, supported by a state-divergence theorem, translates into substantially longer and more stable forecasts. Empirically, HypER not only extends the prediction horizon on canonical Lorenz-63, Rössler, Chen-Ueta, and Chua attractors, but also delivers strong multi-step accuracy on real-world chaotic benchmarks—including the Santa Fe Dataset B, MIT-BIH, and international sunspot numbers. 2 Background and Related Works Chaotic Dynamics and the Limits of Predictability. A deterministic dynamical system is specified by a flow \psi_{t}:\mathcal{M}\!\to\!\mathcal{M} on a smooth manifold \mathcal{M} ; the state \mathbf{x}_{t}=\psi_{t}(\mathbf{x}_{0}) evolves according to \dot{\mathbf{x}}=F(\mathbf{x}) in continuous time or \mathbf{x}_{k+1}=G(\mathbf{x}_{k}) in discrete time [ Katok and Hasselblatt(1995) ] . With initial conditions \mathbf{x}_{0},\mathbf{y}_{0} , nearby trajectories satisfy \|\psi_{t}(\mathbf{x}_{0})-\psi_{t}(\mathbf{y}_{0})\|\simeq\|\mathbf{x}_{0}-\mathbf{y}_{0}\|\exp(\lambda_{\max}t) , so they diverge when the largest Lyapunov exponent \lambda_{\max}>0 (the classical signature of chaos) and converge exponentially when \lambda_{\max}<0 [ Eckmann and Ruelle(1985) ] . The amplification continues until nonlinear folding confines the motion to a strange attractor , whose fractal geometry can be visualised through Poincaré sections or return maps—classical examples are the double‑scroll Lorenz set and the horseshoe‑like Rössler map [ Lorenz(1963) , Rössler(1976) ] . Because the forecast error grows by a factor of e roughly every 1/\lambda_{\max} time units, even perfect models face a finite predictability horizon (about two weeks for mid‑latitude weather [ Palmer(2006) ] ). Any learning system aimed at long‑range forecasting must therefore encode, rather than merely fit, the local stretch–and–fold geometry that drives error growth. Reservoir Computing for Chaotic Time Series. ESNs and their real‑time spiking analogue, the Liquid State Machine, sidestep the difficulties of full recurrent training by fixing the recurrent weights of a large, sparsely connected “reservoir” and learning only a linear read‑out [ Jaeger(2001) , Maass et al.(2002)Maass, Natschläger, and Markram ] . When the spectral radius \rho(\mathbf{W})\!<\!1 , the Echo-State Property (ESP) guarantees that all influences of arbitrary initialisation vanish, leaving a fading-memory encoding of recent inputs. But long-horizon chaos prediction pushes the reservoir to the opposite regime: one must drive \rho(\mathbf{W}) towards unity to sustain the internal dynamics, at which point ESP becomes fragile and the model either explodes or collapses. Traditionally tuned closed-loop ESNs achieve only 5\!-\!8 Lyapunov times before divergence on Lorenz-63, Kuramoto–Sivashinsky and climate benchmarks [ Fan et al.(2020)Fan, Jiang, Zhang, Wang, and Lai , Jaurigue(2024) , Pathak et al.(2018b)Pathak, Wikner, Fussell, Chandra, Hunt, Girvan, and Ott ] .

Read the complete text