Integer Binary-Range Alignment Neuron for Spiking Neural Networks
Binghao Ye, Wenjuan Li, Dong Wang, Man Yao, Bing Li, Weiming Hu, Dong Liang, Kun Shang · 2025
Read Integer Binary-Range Alignment Neuron for Spiking Neural Networks by Binghao Ye, Wenjuan Li, Dong Wang, Man Yao, Bing Li, Weiming Hu, Dong Liang, Kun Shang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-05679.txt.
Introduction
Binghao Ye and co-authors give spiking neurons a wider voice by letting them fire integer values during training. Their 2025 paper addresses the main weakness of spiking networks: binary spikes carry little information per step, so accuracy trails ordinary networks despite far lower energy use. Their neuron design expands what one spike event can say.
At inference, the integer activity converts back to binary spikes spread over virtual extra steps, keeping the event-driven style. A range alignment step fixes neurons that never reach their high values. On a standard image benchmark the method set a new best for its architecture, and on object detection it also led. Accuracy matched or beat the ordinary network twin, with several-fold energy savings.
Catalog record
| CREATOR | Binghao Ye, Wenjuan Li, Dong Wang, Man Yao, Bing Li, Weiming Hu, Dong Liang, Kun Shang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-05679
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Integer Binary-Range Alignment Neuron for Spiking Neural Networks Binghao Ye, Wenjuan Li, Dong Wang, Man Yao, Bing Li, Weiming Hu, Dong Liang, Kun Shang Abstract Spiking Neural Networks (SNNs) are noted for their brain-like computation and energy efficiency, but their performance lags behind Artificial Neural Networks (ANNs) in tasks like image classification and object detection due to the limited representational capacity. To address this, we propose a novel spiking neuron, Integer Binary-Range Alignment Leaky Integrate-and-Fire to exponentially expand the information expression capacity of spiking neurons with only a slight energy increase. This is achieved through Integer Binary Leaky Integrate-and-Fire and range alignment strategy. The Integer Binary Leaky Integrate-and-Fire allows integer value activation during training and maintains spike-driven dynamics with binary conversion expands virtual timesteps during inference. The range alignment strategy is designed to solve the spike activation limitation problem where neurons fail to activate high integer values. Experiments show our method outperforms previous SNNs, achieving 74.19% accuracy on ImageNet and 66.2% mAP@50 and 49.1% mAP@50:95 on COCO, surpassing previous bests with the same architecture by + 3.45% and + 1.6% and + 1.8% , respectively. Notably, our SNNs match or exceed ANNs’ performance with the same architecture, and the energy efficiency is improved by 6.3 × {\times} . 1 Introduction Artificial Neural Networks (ANNs) have gained prominence across various domains, including image recognition, object detection, and natural language processing, due to their remarkable capabilities [ 42 , 36 , 39 ] . Nevertheless, their dependence on numerous multiply-accumulate operations (MACs) results in high energy consumption, presenting a substantial obstacle to widespread adoption, especially in resource-constrained environments such as edge computing. Conversely, Spiking Neural Networks (SNNs) offer an energy-efficient alternative by mimicking biological neural systems. A spiking neuron fires only when its membrane potential exceeds a threshold, producing 0/1 activation values: 1 (spike) or 0 (silence). This enables computational processes based on sparse accumulate operations (ACs), significantly reducing energy consumption on neuromorphic chips. Unfortunately, the firing mechanism of SNNs often restricts the representational capacity of neurons, leading to significant flaws in both spatial representation and temporal dynamics [ 46 ] , which results in performance lags compared to ANNs in tasks like image classification and object detection. To address this, researchers have made numerous efforts. Real Spike [ 10 ] introduces a learnable coefficient to assign real values to the {0, 1} spike feature maps generated by spiking neurons. However, this method merely post-processes the spiking neuron outputs, akin to applying a non-shared convolution kernel, without fundamentally increasing information expression capacity. Ternary spikes [ 14 ] extend spiking neuron emissions to \{-\alpha,0,\alpha\} , slightly enhancing the information expression capacity of the neuron but only marginally. The I-LIF [ 30 ] neuron model extends the firing values of spiking neurons to any positive integer; however, its inference mode imposes a constraint on the maximum positive integer that a neuron can fire. These methods fail to fully address the issue of expression capability in neurons, causing SNNs to continue lagging behind ANNs in performance. In this work, we propose the Integer Binary-Range Alignment Leaky Integrate-and-Fire (IBRA-LIF) neuron for SNNs. IBRA-LIF extends the traditional spike encoding {0, 1} to a theoretically unlimited range, enabling more information expression. Importantly, the novel design comes with only a slight increase in energy consumption, ensuring the SNN models retain their characteristic energy efficiency. Specifically, as depicted in Fig. 1 , IBRA-LIF comprises an Integer Binary Leaky Integrate-and-Fire (IB-LIF) neuron and a range alignment (RA) strategy. IB-LIF enhances I-LIF by employing binary encoding, which addresses the limitations of I-LIF during inference. RA introduces a scaling factor N to adjust the output range of spiking neurons, ensuring that the input and theoretical output ranges are properly aligned. Although RA introduces additional MACs, we implement a simple linear transformation to convert these MACs into ACs, and further reduce energy consumption through a re-parameterization technique, which preserves the key advantage of low energy consumption in SNNs. Additionally, we explore other possible strategies for spike activation limitation and demonstrate that our proposed RA strategy is optimal. We summarize our contributions as follows: - IB-LIF: By leveraging integer binary encoding, we propose the IB-LIF spiking neuron, which achieves an exponential increase in theoretical information expression capacity while maintaining low energy consumption. - Range alignment: We introduce a range alignment strategy that effectively alleviates the spike activation limitation problem caused by expanding the maximum value of spike emissions. Furthermore, during inference, the MACs introduced by range alignment are transformed into ACs through a simple linear transformation, while using a re-parameterization technique, preserving the low energy consumption characteristic of SNNs. - Performance: Our proposed method demonstrates outstanding performance in image classification and object detection tasks, achieving results on par with, or even surpassing, ANNs. Concretely, when using direct training SNN method, on ImageNet, it achieved 74.19\% accuracy, surpassing the prior state-of-the-art(SOTA) SNN by 3.45\% . On COCO, it achieved 66.2\% mAP@50 and 49.1\% mAP@50:95, improving by 1.6\% and 1.8\% over the prior SOTA SNN with the same architecture. Moreover, we achieve performance that matches or exceeds ANN in the same architecture, with 6.3 \times energy efficiency. Importantly, we have also achieved near-lossless ANN-to-SNN conversion. - Versatility. It is evident that our proposed IBRA-LIF can be extensively applied across various fields. Its achievement of SOTA performance in image classification and object detection tasks heralds its potential value in numerous other domains. Figure 1 : a) demonstrates the differences between IB-LIF during the training and inference phases. We implement binary conversion during the inference phase. b) illustrates the differences in activation value expressions before and after range alignment. The theoretical value range for activation values encompasses 64 distinct expressions, however, before range alignment, only 7 expressions are actually represented. After applying range alignment, the complete range of activation values can be fully expressed. c) shows the overall workflow of N = 10 IBRA-LIF during different phases. During training, IBRA-LIF emits finer activation values to reduce information loss. During inference, IBRA-LIF converts the N-fold activation values to binary spikes and performs ACs with the re-parameterized convolution. 2 Related Work 2.1 The Learning Algorithms of SNNs To achieve high-performance deep SNNs, two main learning strategies are currently employed: the ANN-to-SNN (A2S) conversion methods [ 3 , 37 , 17 , 38 , 26 ] and the direct training (DT) methods [ 13 , 32 , 43 ] . A2S is to replace the activation functions in a pre-trained ANN with spiking neurons, aiming to approximate the activation values of ANN by using the average firing rates of SNN. However, the converted SNN typically requires a large number of timesteps to achieve accuracy comparable to that of the original ANN [ 15 ] , while neglecting the temporal dynamics of SNNs. DT employs surrogate gradient techniques to address the non-differentiability of spiking neurons, enabling the application of backpropagation. It effectively leverages the temporal dynamics of SNNs and allows for flexible architecture design, but training with multiple timesteps requires a significant amount of computational resources [ 46 ] . Our method achieves nearly lossless A2S with a small number of timesteps, and SOTA performance can still be achieved in DT with a small training timesteps. 2.2 Information Loss and Expression in SNNs