Centrality-Based Pruning for Efficient Echo State Networks
Sudip Laudari · 2026
Read Centrality-Based Pruning for Efficient Echo State Networks by Sudip Laudari (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-20684.txt.
Introduction
Laudari trims echo state networks by pruning nodes that matter least in the reservoir graph. Echo state networks predict time series with a fixed random reservoir. Many reservoir nodes add cost but little signal. This method views the reservoir as a weighted directed graph. Centrality scores rank each node's structural worth. Low ranked nodes get cut before training the readout. On Mackey-Glass and power load data, the pruned networks stayed accurate. Some runs even improved while using far fewer nodes.
Catalog record
| CREATOR | Sudip Laudari |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24521 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.20684
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Centrality-Based Pruning for Efficient Echo State Networks Sudip Laudari Abstract Echo State Networks (ESNs) are a reservoir computing framework widely used for nonlinear time-series prediction. However, despite their effectiveness, the randomly initialized reservoir often contains redundant nodes, leading to unnecessary computational overhead and reduced efficiency. In this work, we propose a graph centrality-based pruning approach that interprets the reservoir as a weighted directed graph and removes structurally less important nodes using centrality measures. Experiments on Mackey-Glass time-series prediction and electric load forecasting demonstrate that the proposed method can significantly reduce reservoir size while maintaining, and in some cases improving, prediction accuracy, while preserving the essential reservoir dynamics. † † affiliationnotice: Preprint 1 Introduction Echo State Networks (ESNs), introduced by Jaeger ( Jaeger 2001 ; Jaeger 2007 ) , are a reservoir computing framework designed for modeling nonlinear temporal dynamics. More broadly, reservoir computing provides an efficient alternative to training recurrent neural networks, as it avoids costly optimization of recurrent connections while still achieving strong performance in time-series forecasting and chaotic systems ( Lukoševičius et al. 2012 ) . A key idea behind ESNs is to use a fixed, randomly initialized recurrent network, known as the reservoir ( Maass et al. 2002 ) , to transform input signals into high-dimensional dynamic representations. In this setting, only the output layer is trained, which simplifies the learning process and reduces computational cost, while still capturing complex temporal dependencies ( Jaeger 2001 ) . Due to these advantages, ESNs have been widely applied to tasks such as chaotic time-series prediction, energy load forecasting, signal processing, and control systems ( Jaeger & Haas 2004 ; Bianchi et al. 2016 ; Pathak et al. 2018 ) . They are particularly effective for modeling systems with nonlinear and long-term temporal behavior. However, despite their efficiency, ESNs rely on randomly constructed reservoirs, which often contain redundant or weakly contributing nodes ( Rodan & Tino 2010 ) . This can lead to unnecessary complexity and increased computational cost without a corresponding improvement in predictive performance ( Gallicchio et al. 2018 ) . As a result, several studies have explored reservoir optimization through sparsification, structural adaptation, and topology design ( Bala et al. 2018 ; Scardapane et al. 2014 ; Liu et al. 2022 ) . At the same time, neural networks can be viewed as graph-structured systems, where neurons correspond to nodes and connections correspond to edges ( Battaglia et al. 2018 ) . This perspective allows the use of tools from graph theory to better understand network structure and information flow ( Estrada 2012 ) . In particular, centrality measures provide a principled way to quantify the relative importance of nodes in such graph-structured representations, and have been explored in the context of pruning and influence estimation in neural networks ( Li et al. 2019 ; Ayoub et al. 2022 ; Fan et al. 2019 ; Freeman 1978 ; Valente et al. 2008 ) . Motivated by these insights, we explore a centrality-based approach for pruning ESN reservoirs. Specifically, we model the reservoir as a weighted directed graph and use centrality measures to identify structurally less important nodes. These nodes are then removed to obtain a more compact reservoir while aiming to preserve the essential dynamics of the system. We investigate this approach on both synthetic and real-world time-series tasks, including Mackey-Glass prediction and electric load forecasting. 2 Related Work Echo State Networks (ESNs) and reservoir computing have been extensively studied for nonlinear time-series modeling, with applications in chaotic systems, energy forecasting, and signal processing ( Jaeger & Haas 2004 ; Lukoševičius et al. 2012 ; Bianchi et al. 2016 ; Pathak et al. 2018 ) . Recent work has highlighted that reservoir structure, including connectivity patterns and weight distributions, plays a crucial role in determining prediction accuracy and stability, motivating research on systematic reservoir design and optimization ( Liu et al. 2022 ; Gonbadi et al. 2025 ; Sima et al. 2025 ) . Several studies focus on improving ESN efficiency through reservoir optimization and pruning. Early work proposed minimal and deterministic reservoirs to reduce redundancy while preserving dynamical richness ( Rodan & Tino 2010 ; Ozturk et al. 2007 ; Chen et al. 2016 ) . More recent approaches introduce pruning and adaptive selection mechanisms to identify and remove less informative reservoir nodes. For example, Broad ESNs with pruning remove redundant nodes while maintaining or improving performance on air quality and power load datasets ( Liu et al. 2022 ) , while multi-reservoir ESNs with top-down pruning strategies design sparse and structured reservoirs to improve both accuracy and training efficiency ( Wang et al. 2024 ) . Other approaches employ correlation analysis, partial-correlation-based pruning, and adaptive selection strategies to retain only the most informative reservoir units ( Sima et al. 2025 ; Huang et al. 2023 ; Liu et al. 2022 ) . In parallel, input-driven and data-dependent reservoir design has gained attention. Input-aware optimization methods suggest that reservoir topology and weight scaling should be adapted to the statistical properties of the input rather than chosen randomly ( Gonbadi et al. 2025 ) . Similarly, reservoir state selection methods based on particle swarm optimization and Bayesian optimization demonstrate that selecting salient states can significantly improve forecasting performance ( Sima et al. 2025 ) . These works complement earlier studies on deep, modular, and physically inspired reservoirs, which emphasize the importance of structured architectures for capturing multiscale temporal dynamics ( Gallicchio et al. 2017 ; Sun et al. 2022 ; Nakajima & Fischer 2021 ; Tanaka et al. 2019 ) . Neural networks can also be analyzed as graph-structured systems, where neurons correspond to nodes and connections correspond to edges ( Battaglia et al. 2018 ; Estrada 2012 ) . This perspective enables the use of graph theory and centrality measures to analyze node importance and information flow ( Freeman 1978 ; Estrada & Rodriguez-Velazquez 2005 ; Newman 2018 ) . In deep learning, centrality-based pruning methods model neural networks as graphs and use measures such as eigenvector centrality to rank and remove less important neurons, resulting in more compact models with competitive performance ( Li et al. 2019 ; Fan et al. 2019 ; Chowdhury et al. 2025 ) . However, most existing centrality-based pruning approaches focus on feedforward or convolutional architectures. The application of graph centrality to ESN reservoirs, which are governed by recurrent dynamics, remains limited. Building on prior work in ESN pruning and reservoir optimization ( Rodan & Tino 2010 ; Scardapane et al. 2014 ; Bala et al. 2018 ; Liu et al. 2022 ; Wang et al. 2024 ) , we propose a centrality-based pruning approach that models the ESN reservoir as a weighted directed graph and removes structurally less important nodes while preserving its essential temporal dynamics. 3 ESN Architecture An Echo State Network consists of three main components: an input layer, a recurrent reservoir, and an output layer. The input layer maps external signals into the reservoir through fixed input weights, while the reservoir is a randomly connected recurrent network that transforms inputs into high-dimensional dynamic representations. The output layer then produces predictions based on these reservoir states using trainable readout weights. Figure 1 : Echo State Network (ESN)