Evaluation of Bio-Inspired Models under Different Learning Settings For Energy Efficiency in Network Traffic Prediction.
Theodoros Tsiolakis, Nikolaos Pavlidis, Vasileios Perifanis, Pavlos Efraimidis · 2024
Read Evaluation of Bio-Inspired Models under Different Learning Settings For Energy Efficiency in Network Traffic Prediction. by Theodoros Tsiolakis, Nikolaos Pavlidis, Vasileios Perifanis, Pavlos Efraimidis (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-17565.txt.
Introduction
Theodoros Tsiolakis and three co-authors compare brain-inspired models to forecast mobile network traffic. Carriers need traffic forecasts to assign resources, but the energy cost of machine learning is often ignored. Two designs of this kind are tested: spiking neural networks and echo state networks, a form of reservoir computing.
Both ran in central and federated setups on data from three Barcelona locations, against standard networks. The brain-inspired models saved significant energy while matching standard accuracy. Federated versions let the analysis extend to systems where data stays at the edge. The trade-offs between accuracy and energy are mapped across settings.
Catalog record
| CREATOR | Theodoros Tsiolakis, Nikolaos Pavlidis, Vasileios Perifanis, Pavlos Efraimidis |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-17565
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Evaluation of Bio-Inspired Models under Different Learning Settings For Energy Efficiency in Network Traffic Prediction. Theodoros Tsiolakis, Nikolaos Pavlidis, Vasileios Perifanis, Pavlos Efraimidis Abstract Cellular traffic forecasting is a critical task that enables network operators to efficiently allocate resources and address anomalies in rapidly evolving environments. The exponential growth of data collected from base stations poses significant challenges to processing and analysis. While machine learning (ML) algorithms have emerged as powerful tools for handling these large datasets and providing accurate predictions, their environmental impact, particularly in terms of energy consumption, is often overlooked in favor of their predictive capabilities. This study investigates the potential of two bio-inspired models: Spiking Neural Networks (SNNs) and Reservoir Computing through Echo State Networks (ESNs) for cellular traffic forecasting. The evaluation focuses on both their predictive performance and energy efficiency. These models are implemented in both centralized and federated settings to analyze their effectiveness and energy consumption in decentralized systems. Additionally, we compare bio-inspired models with traditional architectures, such as Convolutional Neural Networks (CNNs) and Multi-Layer Perceptrons (MLPs), to provide a comprehensive evaluation. Using data collected from three diverse locations in Barcelona, Spain, we examine the trade-offs between predictive accuracy and energy demands across these approaches. The results indicate that bio-inspired models, such as SNNs and ESNs, can achieve significant energy savings while maintaining predictive accuracy comparable to traditional architectures. Furthermore, federated implementations were tested to evaluate their energy efficiency in decentralized settings compared to centralized systems, particularly in combination with bio-inspired models. These findings offer valuable insights into the potential of bio-inspired models for sustainable and privacy-preserving cellular traffic forecasting. \catchline 002005 keywords bio-inspired models, sustainable machine learning, power consumption, spiking neural networks; reservoir computing; federated learning. 1 Introduction Accurately predicting network traffic and load is essential for improving network management and ensuring efficient operation for telecommunication providers. Reliable forecasting enables proactive resource allocation, effective capacity planning, and improved service quality, especially in high-demand scenarios. The primary challenge lies in maintaining robust connectivity for all devices while avoiding unnecessary resource wastage. Machine learning (ML) algorithms have become indispensable tools for addressing this challenge, offering capabilities such as real-time decision-making, anomaly detection, failure prediction, and dynamic spectrum management. These features make ML a critical component for creating smarter, more sustainable telecommunication networks [ 1 , 2 ] . This study is motivated by the rapid growth of data generated by telecommunication systems, which is driven by the increasing use of connected devices. The large amounts of data involved require sophisticated predictive models that need significant computational resources to process. As a result, the training of these models often consumes substantial amounts of energy, time, and storage, creating challenges for both efficiency and sustainability. This underscores the need for approaches that balance strong predictive performance with reduced energy usage. This consideration is particularly important in the context of federated learning, where models are trained on edge devices with limited computational and energy resources. In such scenarios, it is critical to identify models that can be effectively trained under constrained conditions. Furthermore, the availability of models with low power and computational requirements is essential for ensuring service continuity during emergencies—such as power outages or infrastructure disruptions—where maintaining operation at reduced capacity is vital. In this work, we focus on identifying and analyzing the trade-offs between predictive performance and power consumption across different model architectures and deployment settings. In this study, we explore the use of bioinspired SNNs and Reservoir Computing (RC) with Echo State Networks (ESNs) for cellular traffic forecasting. We examine several types of Leaky Integrate-and-Fire (LIF) neurons in SNNs, including Lapicque, Leaky, RLeaky, Synaptic, and Alpha neurons [ 3 ] , as well as ESNs [ 4 ] . These models are compared with traditional machine learning methods, such as Multi-Layer Perceptrons (MLPs) and Convolutional Neural Networks (CNNs). Both centralized and federated learning settings are used in the evaluation to account for modern distributed computation approaches. Federated learning, in particular, reduces the need for centralized data storage, offering a more energy-efficient way to train models and we aim to evaluate the trade-offs between predictive accuracy and energy efficiency. To achieve this, we use a Sustainability Index that combines key metrics like power consumption, prediction error, and a size parameter to provide a comprehensive evaluation of model efficiency. To the best of our knowledge, this is the first study to compare the energy consumption of bio-inspired and traditional models for cellular traffic forecasting, evaluated across both centralized and federated learning settings. We further explore the power efficiency of federated learning, which was initially introduced to enhance privacy in machine learning. Recent studies [ 5 ] indicate that federated learning can also reduce power consumption, offering a dual benefit of improved privacy and energy efficiency. This makes it a promising framework for sustainable and privacy-preserving machine learning. The results aim to guide researchers and practitioners toward developing machine learning models that balance high performance with lower energy use. The rest of the paper is structured as follows: Section 2 reviews related work on Spiking Neural Networks (SNNs), Reservoir Computing (RC), and Federated Learning. Section 3 describes the dataset and research problem, along with the models and evaluation methods. Section 4 explains the experimental setup and methodology. Section 5 presents the results and analysis. Section 6 discusses the findings, challenges, and future directions. Finally, Section 7 concludes by summarizing the key outcomes and contributions of the study. 2 Related Work 2.1 Traffic Prediction Recent advancements in cellular traffic forecasting have demonstrated the effectiveness of machine learning and federated learning approaches in managing 5G base stations. Perifanis et al. (2023) [ 6 ] introduced a federated learning framework for traffic prediction in 5G base stations, highlighting the model’s ability to preserve data privacy while enabling distributed training across multiple stations. Their work emphasized the importance of efficient time-series forecasting to optimize resource allocation and reduce energy consumption in large-scale cellular networks. Building on this foundation, Pavlidis et al. (2024) [ 7 ] extended the concept by applying federated models to predict traffic across a larger number of base stations, while also investigating the impact of fine tuning several experimental parameters. They demonstrated how federated learning could improve forecasting accuracy and reduce unnecessary communication overheads. Zhao et al. (2023) proposed the FL-DeepAR framework, which uses deep autoregressive networks for federated traffic prediction. This approach addressed statistical heterogeneity and incorporated advanced gradient-based aggregation techniques, achieving superior prediction performance on real-world datasets [ 8 ] . Similarly, Guesmi et al. (2024) [ 9 ] proposed advanced predictive modeling techniques to enhance traffic forecasting in emerging cellular networks. Their research leveraged a combination of deep learning and federated learning algorithms to address the challenges of time-series forecasting in dynamic and heterogeneous environments, further reinforcing the potential of distributed machine learning in telecommunications. Gao et al. (2024) developed FedCE, a communication-efficient federated learning framework that reduced communication overhead while improving prediction accuracy using gradient compression and adaptive aggregation strategies. The results highlighted significant improvements in prediction accuracy with optimized resource utilization [ 10 ] . Additionally, Lee et al. (2024) proposed a personalized federated learning approach for mobile traffic prediction, which utilized layer-wise aggregation and adaptive layer freezing to improve prediction accuracy and communication