LightSNN: Lightweight Architecture Search for Sparse and Accurate Spiking Neural Networks
Yesmine Abdennadher ∗ , Giovanni Perin †,∗ , Riccardo Mazzieri ∗ , Jacopo Pegoraro ∗ , and Michele Rossi ∗ · 2025
Read LightSNN: Lightweight Architecture Search for Sparse and Accurate Spiking Neural Networks by Yesmine Abdennadher ∗ , Giovanni Perin †,∗ , Riccardo Mazzieri ∗ , Jacopo Pegoraro ∗ , and Michele Rossi ∗ (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-21846.txt.
Introduction
Yesmine Abdennadher and co-authors present a 2025 paper on searching for lean spiking neural network designs. Spiking networks mimic brain pulses, saving energy and suiting edge devices. Most designs copy ordinary network shapes, which fit spikes poorly and lose accuracy. Architecture search can find better shapes automatically. LightSNN is a fast search method built for spiking networks. It favors sparse designs that stay accurate.
The search grows from a cell-based framework with backward connections. Edge computing researchers get a tool tuned to the hardware reality of neuromorphic chips. Energy per inference decides what can run on a sensor or a drone. Hand-me-down architectures waste that budget; a dedicated search spends it wisely. Sparse winners also map naturally onto event-driven chips. The work joins a push to make spiking networks practical rather than merely elegant.
Catalog record
| CREATOR | Yesmine Abdennadher ∗ , Giovanni Perin †,∗ , Riccardo Mazzieri ∗ , Jacopo Pegoraro ∗ , and Michele Rossi ∗ |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 23 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-21846
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
LightSNN: Lightweight Architecture Search for Sparse and Accurate Spiking Neural Networks Thanks: This work has been supported by the EU H2020 MSCA ITN project Greenedge (grant no. 953775), by the EU through the Horizon Europe/JU SNS project ROBUST-6G (grant no. 101139068), and by the EU under the Italian National Recovery and Resilience Plan (NRRP) of NextGenerationEU, partnership on “Telecommunications of the Future” (PE0000001 - program “RESTART”). Yesmine Abdennadher ∗ , Giovanni Perin †,∗ , Riccardo Mazzieri ∗ , Jacopo Pegoraro ∗ , and Michele Rossi ∗ Abstract Spiking Neural Networks (SNNs) are highly regarded for their energy efficiency, inherent activation sparsity, and suitability for real-time processing in edge devices. However, most current SNN methods adopt architectures resembling traditional artificial neural networks (ANNs), leading to suboptimal performance when applied to SNNs. While SNNs excel in energy efficiency, they have been associated with lower accuracy levels than traditional ANNs when utilizing conventional architectures. In response, in this work we present LightSNN, a rapid and efficient Neural Network Architecture Search (NAS) technique specifically tailored for SNNs that autonomously leverages the most suitable architecture, striking a good balance between accuracy and efficiency by enforcing sparsity. Based on the spiking NAS network (SNASNet) framework, a cell-based search space including backward connections is utilized to build our training-free pruning-based NAS mechanism. Our technique assesses diverse spike activation patterns across different data samples using a sparsity-aware Hamming distance fitness evaluation. Thorough experiments are conducted on both static (CIFAR10 and CIFAR100) and neuromorphic datasets (DVS128-Gesture). Our LightSNN model achieves state-of-the-art results on CIFAR10 and CIFAR100, improves performance on DVS128Gesture by 4.49%, and significantly reduces search time most notably offering a 98 × 98\times speedup over SNASNet and running 30% faster than the best existing method on DVS128Gesture. Code is available on Github at: https://github.com/YesmineAbdennadher/LightSNN . I Introduction After the development of perceptrons and artificial neural networks (ANNs) [ 1 ] , spiking neural networks (SNNs) [ 2 ] [ 3 ] emerge as the third generation of neural networks. SNNs mimic the behavior of biological neurons through discrete and time-dependent signals known as spikes . This makes them suitable for temporal (1D) and spatiotemporal (3D) data processing, offering better efficiency and reduced energy consumption compared to conventional neural networks. Because of the event-driven and low-power nature of SNNs, they have attracted major attention in the fields of edge computing, wearable devices, and signal processing at the physical layer of wireless systems. In fact, SNNs are eminently suitable for use in battery-powered or resource-limited devices due to their low energy consumption and real-time adaptation capabilities. Thanks to their amenability to on-chip implementation [ 4 ] [ 5 ] and low-latency handling of signals, they bear the promise to suit those applications where efficiency and speed are of the essence, such as wireless communications [ 6 ] [ 7 ] and biomedical signal processing [ 8 ] [ 9 ] , among others. Previous work has focused on developing learning algorithms and training protocols; for example, based on spike-timing-dependent plasticity (STDP) or event-driven methods, etc. [ 10 , 11 , 12 , 13 , 14 , 15 , 16 ] . However, minor attention has so far been paid to architectural designs, preventing SNNs from fully leveraging their characteristics. Consequently, SNNs are still behind ANNs in terms of scalability to deep network models and performance (especially accuracy). To address these performance gaps and strike a balance in the trade-off between accuracy and energy efficiency, novel architectural designs are to be explored. Figure 1 : High-level diagram of the proposed NAS framework. Neural architecture search (NAS) [ 17 ] has propelled AI forward by automatically exploring the design space to identify high-performance architectures, minimizing manual tuning and producing highly efficient models. In the past few years, NAS has found very effective neural network architectures that have succeeded in several tasks, including image segmentation [ 18 , 19 , 20 , 21 ] , object detection [ 22 , 23 , 24 , 25 ] , and other challenging domains such as speech [ 26 ] and image recognition [ 27 , 28 ] . With NAS, a systematic search for optimal architectural designs is performed. In doing so, the event-driven nature of SNNs can be exploited, and the need for manual experimentation can be substantially reduced. Through a methodical assessment of various network topologies, NAS can identify configurations that effectively balance energy efficiency and accuracy, by tailoring the search strategy to the specific dynamics of SNNs. NAS techniques have recently been investigated for SNNs. However, previous works ignored the effectiveness (e.g., computation cost) of the search methods used. For example, the techniques presented in [ 29 ] and [ 30 ] involve training a supernet prior to the actual search stage which can be very expensive in terms of both GPU hours and memory usage, while [ 31 ] uses a computationally demanding performance predictor, which requires prior training on a small subset of potential architectures. During this initial training phase, performance indicators such as early accuracy are collected are used to train a regression model. Afterwards, the trained predictor infers how unseen architectures might perform without needing to train these all the way. The approach in [ 32 ] shows good accuracy performance, but its main drawback is that this comes at the cost of a high number of floating-point operations (FLOPS), which goes against our efficiency requirement. SNASNet [ 33 ] is the first algorithm to use a training-free NAS technique for SNNs, thus enabling a more efficient search phase. SpikeNas, the recently proposed optimizations technique of [ 34 ] modify the original SNASNet framework to further reduce the search space, while at the same time coping with memory constraints. To the best of our knowledge, this is to date the most effective algorithm in terms of search time, accuracy and sparsity of the found network models. Our solution will achieve notable improvements, especially in dynamic datasets. To devise our proposed technique, LightSNN, we first analyze SNASNet and highlight its limitations. Next, we delve into our enhancements, outlining how we modified the framework to get around its shortcomings and obtaining improved results. In Fig. 1 , we show an overview of the general phases that drive the proposed NAS algorithm. The main objectives of our design are as follows: • Improving model accuracy. By effectively searching across the entire search space, to evaluate the importance of each operation, we achieve new state-of-the-art accuracies on static datasets, and a substantial 4.94 % accuracy improvement on an event-based dataset. • Reducing network complexity. The search space has been reduced by eliminating those benchmark operations that lead to a minor improvement in the network task performance. • Enforcing sparsity in the final architecture. Using various operations, such as zeroize and max-pooling, allowed us to reduce the sparsity of the final model that is outputted by our NAS algorithm. The paper is organized as follows. Section II briefly reviews the baseline frameworks and methods that were considered as a starting point for the design of LightSNN, our newly proposed NAS algorithm. LightSNN is presented in Section III alongside its design principles. The results for the new NAS framework are reported in Section IV