All in one timestep: Enhancing Sparsity and Energy efficiency in Multi-level Spiking Neural Networks
Andrea Castagnetti, Alain Pegatoquet, Benoît Miramond · 2025
Read All in one timestep: Enhancing Sparsity and Energy efficiency in Multi-level Spiking Neural Networks by Andrea Castagnetti, Alain Pegatoquet, Benoît Miramond (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-24637.txt.
Introduction
Andrea Castagnetti, Alain Pegatoquet, and Benoit Miramond work on spike based nets, a brain like model that sends short pulses. Such nets can save power, but plain on off spikes lose a lot of detail. Their fix lets one neuron send spikes at more than one level.
With more levels, the net keeps more detail while still firing in just one time step. On image tasks, their nets cut energy use by two to three times next to plain spike nets. On brain style data, they cut wait time to a single step. Scores stayed close to full nets that use real number weights.
Catalog record
| CREATOR | Andrea Castagnetti, Alain Pegatoquet, Benoît Miramond |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-24637
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
All in one timestep: Enhancing Sparsity and Energy efficiency in Multi-level Spiking Neural Networks Andrea Castagnetti, Alain Pegatoquet, Benoît Miramond Abstract Spiking Neural Networks (SNNs) are one of the most promising bio-inspired neural networks models and have drawn increasing attention in recent years. The event-driven communication mechanism of SNNs allows for sparse and theoretically low-power operations on dedicated neuromorphic hardware. However, the binary nature of instantaneous spikes also leads to considerable information loss in SNNs, resulting in accuracy degradation. To address this issue, we propose a multi-level spiking neuron model able to provide both low-quantization error and minimal inference latency while approaching the performance of full precision Artificial Neural Networks (ANNs). Experimental results with popular network architectures and datasets, show that multi-level spiking neurons provide better information compression, allowing therefore a reduction in latency without performance loss. When compared to binary SNNs on image classification scenarios, multi-level SNNs indeed allow reducing by 2 to 3 times the energy consumption depending on the number of quantization intervals. On neuromorphic data, our approach allows us to drastically reduce the inference latency to 1 timestep, which corresponds to a compression factor of 10 compared to previously published results. At the architectural level, we propose a new residual architecture that we call Sparse-ResNet. Through a careful analysis of the spikes propagation in residual connections we highlight a spike avalanche effect, that affects most spiking residual architectures. Using our Sparse-ResNet architecture, we can provide state-of-the-art accuracy results in image classification while reducing by more than 20% the network activity compared to the previous spiking ResNets. Keywords Spiking Neural Networks \cdot multi-level spikes \cdot low-power artificial intelligence 1 Introduction Spiking Neural Networks (SNNs) are considered as the the third generation of Artificial Neural Networks (ANNs). SNNs focus on the encoding and the processing of the information using binary and asynchronous signals known as spikes. This computing paradigm, inspired by the messaging mechanism used by biological neurons, is thought to be amongst the sources of the energy efficiency of the brain. However, the binary nature of spikes also leads to considerable information loss, i.e. quantization errors, causing performance degradation compared to ANNs using floating-point operations. SNNs quantization error can be reduced by increasing the number of timesteps, therefore the latency over the network. However, with a longer conversion time, more spikes are generated, thus increasing the energy consumption as well. Several techniques have been proposed to minimize both the quantization error and the latency of SNNs. These approaches can be either applied to the ANN-to-SNN conversion or directly during the SNN training using the surrogate gradient (SG) method. In Li et al. 2022 and Rathi and Roy 2021 the authors adopt an ANN-to-SNN conversion scheme where the firing threshold of the spiking neurons is optimized after conversion to better match the distribution of the membrane potential. In Castagnetti et al. 2023a a SNN is trained using SG and the Adaptive Integrate-and-Fire (ATIF) neuron. This ATIF neuron has been proposed as an alternative to the original Integrate and Fire (IF) neuron, the firing threshold ( V_{th} ) being a learnable parameter rather than an empirical hyper-parameter. In Guo et al. 2022a , the authors also use SG to train the SNN, but introduce a distribution loss to shift the membrane potential distribution into the conversion range of the spiking neurons. With these approaches, requiring only few timesteps, it is possible to get SNNs with almost no accuracy loss when compared to the equivalent ANNs. As an example, a SNN trained on 4 timesteps can achieve an accuracy only 1% below the equivalent non-quantized, i.e. Floating Point (FP), ANNs on CIFAR-10 Li et al. 2022 . To further decrease the latency, recent approaches propose to go beyond binary spikes and introduce multi-level spiking neurons. This mechanism expands the output of spiking neurons from a single bit to multiple bits, thus increasing the information that can be transmitted at each timestep. In Xiao et al. 2024 for instance, it has been shown that using a 4-level spiking neuron and one timestep, the same level of accuracy of a well optimized binary SNNs trained on 4 timesteps Li et al. 2022 can be achieved. Most of the previous works only focus on the SNN latency. However, it has been shown Lemaire et al. 2023 ; Dampfhoffer et al. 2023 that besides the latency, another important parameter that has to be optimized to improve the energy efficiency is the sparsity of the network, in other words the number of spikes, either binary or multi-level, generated during the inference. In this work we propose to enhance the sparsity of SNN from two points of view. First at the neuronal level, where we introduce a multi-level spiking neuron model that can seamlessly deal with both time and the spike value to reduce the quantization error. Then at the architectural level, where a novel spiking ResNet architecture is proposed. Through a careful analysis of the spike propagation in the residual layers of the architecture we highlight an effect that we call spike avalanche . Events coming from the direct and residual paths sum up and create peaks of activity that can potentially decrease the sparsity of the SNN. Finally we compare binary and multi-level SNNs from the energy-efficiency point of view. Our analysis based on the metric proposed in Lemaire et al. 2023 , is intended to be independent from low-level implementation choices. Moreover, our energy estimation takes into account not only the synaptic operations but also all the memory accesses that take place in an event-driven execution scenario on a neuromorphic hardware accelerator. We therefore provide energy estimation results that are closer to what could be reasonably obtained on a real hardware implementation. This approach is essential to avoid overestimating the energy gains. The main contributions of our work are listed below: • We propose a multi-level model of an IF spiking neuron compatible with SNN direct training using SG. • We train SNNs on different image classification problems and characterize the corresponding spiking activity. We provide state-of-the-art accuracy results on CIFAR-10/100 image datasets, using only 1 timestep while reducing the energy consumption by a factor of 3 compared to an equivalent ANN. • On neuromorphic data we provide a new state of the art latency/accuracy results for the CIFAR-10-DVS dataset. Here we approach the previously published best accuracies, which are obtained with 10 or more timesteps, while compressing the latency to 1 timestep. • We introduce Sparse-ResNet, a new spiking residual architecture. Our experimental results show that Sparse-ResNet can achieve accuracy equivalent to the state of the art SEW-ResNet Fang et al. 2021a while reducing the spiking activity by more than 20% on the CIFAR-10 dataset. 2 Related Works 2.1 SNN training Training large SNNs models on modern complex datasets has been the subject of an increasing number of studies in the recent years. Two methods are typically used to obtain an efficient SNN: ANN-SNN conversion or direct training with surrogate gradients. The ANN-SNN conversion method is based on the idea that firing rates of spiking neurons should match the activations of analog, i.e. Floating Points, neurons. Earlier works proposed to directly convert from FP ANN models to SNNs. Diehl et al. 2015