Hybrid Temporal-8-Bit Spike Coding for Spiking Neural Network Surrogate Training
2025
Read Hybrid Temporal-8-Bit Spike Coding for Spiking Neural Network Surrogate Training (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-03879.txt.
Introduction
Spiking neural networks mimic the brain's event-driven signalling and sip energy on specialised hardware, yet they still trail ordinary networks on vision tasks. Luu Trong Nhan and colleagues propose a new way to encode images as spikes in a 2025 neural computation preprint. Their scheme blends the timing of spikes with bit-plane information, which slices pixel values by their binary digits.
Earlier hybrid schemes merged bit-planes with rate coding, where information sits in how often spikes fire. This work instead fuses bit-plane decomposition with temporal coding, where timing itself carries the message. The coding is designed for surrogate gradient training, the standard workaround for teaching spiking networks. Across several vision benchmarks, the method matched or beat established spike-coding techniques. The authors describe it as the first hybrid temporal-bit scheme built specifically for surrogate training of spiking networks.
Catalog record
| YEAR | 2025 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-03879
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Hybrid Temporal-8-Bit Spike Coding for Spiking Neural Network Surrogate Training Abstract \field D \authorlist \authorentry Nhan T. Luuma1 \MembershipNumber \authorentry Duong T. Luuna2 \MembershipNumber \authorentry Nam Pham Ngocna3 \MembershipNumber \authorentry Thang Truong Congma4 \MembershipNumber \affiliate [a1]This author is with College of Information and Communication Technology, Can Tho University, Vietnam and College of Engineering and Computer Science, VinUniversity, Hanoi, Vietnam ([email protected]). \affiliate [a2]This author is with Center of Digital Transformation and Communication, Can Tho University, Vietnam ([email protected]). \affiliate [a3]This author is with College of Engineering and Computer Science, VinUniversity, Hanoi, Vietnam ([email protected]). \affiliate [a4]This author is with Department of Computer Science and Engineering, The University of Aizu, Japan ([email protected]). 1111 1111 keywords Spiking neural network, temporal spike coding, image classification, bit planes {summary} Spiking neural networks (SNNs) have emerged as a promising direction in both computational neuroscience and artificial intelligence, offering advantages such as strong biological plausibility and low energy consumption on neuromorphic hardware. Despite these benefits, SNNs still face challenges in achieving state-of-the-art performance on vision tasks. Recent work has shown that hybrid rate–temporal coding strategies (particularly those incorporating bit-plane representations of images into traditional rate coding schemes) can significantly improve performance when trained with surrogate backpropagation. Motivated by these findings, this study proposes a hybrid temporal–bit spike coding method that integrates bit-plane decompositions with temporal coding principles. Through extensive experiments across multiple computer vision benchmarks, we demonstrate that blending bit-plane information with temporal coding yields competitive, and in some cases improved, performance compared to established spike-coding techniques. To the best of our knowledge, this is the first work to introduce a hybrid temporal–bit coding scheme specifically designed for surrogate gradient training of SNNs. † † Corresponding to: Nhan T. Luu. 1 Introduction The field of artificial intelligence (AI) has experienced substantial progress in recent decades, much of it driven by advances in deep learning algorithms [ 24 ] . However, conventional artificial neural networks (ANNs) [ 10 ] still struggle to capture the intricate, dynamic behaviors characteristic of biological neural systems. To bridge this gap, spiking neural networks (SNNs) have emerged as a promising alternative, incorporating temporal neural dynamics to more faithfully emulate biological computation. In contrast to traditional ANNs, SNNs communicate through discrete spike events, mirroring the asynchronous and event-driven signaling observed in biological neurons [ 2 ] . This spike-based computation not only increases biological plausibility but also enables greater computational efficiency and reduced energy consumption, particularly on neuromorphic hardware platforms [ 3 ] . The inherent sparsity and temporal coding mechanisms in SNNs form a strong foundation for the development of low-power systems capable of real-time operation [ 21 ] . Despite these advantages, SNNs introduce unique challenges, especially in training and optimization [ 6 ] . Standard backpropagation techniques developed for ANNs cannot be directly applied due to the discrete, non-differentiable nature of spikes [ 19 ] . Consequently, several alternative training strategies such as spike-timing-dependent plasticity (STDP) [ 23 ] , ANN-to-SNN (ANN2SNN) conversion pipelines [ 22 ] , and surrogate gradient methods [ 9 ] have been proposed to make effective learning in SNNs feasible. Recent studies have further explored enriching surrogate-based SNN training by incorporating bit-plane representations [ 17 ] , demonstrating improvements in tasks such as image recognition and processing. Motivated by these developments, we propose a new hybrid temporal-bit spike coding scheme that integrates temporal coding principles with multi-bit plane decomposition. Our extensive experiments show that combining temporal coding with bit-plane information yields competitive, and in several cases superior, performance compared to existing spike coding approaches. Our contributions are summarized as follows: • Building upon prior work [ 17 ] , we introduce a hybrid temporal-8-bit spike-coding method tailored for surrogate-gradient training of SNNs. • We show that integrating bit-plane information with temporal coding achieves competitive or improved performance relative to established spike coding strategies. • We demonstrate that the proposed method generalizes effectively across well-known SNN architectures and remains compatible with modern optimization algorithms widely used in SNN training. 2 Methodology The decomposition of a multi-channel image into its corresponding bit planes is performed by isolating each bit in the binary representation of the pixel intensities for every color channel. For an n_{\text{bit}} -bit image, let I_{C}(x,y) denote the intensity at spatial location (x,y) in channel C . Its binary expansion can be written as I_{C}(x,y)=\sum_{k=0}^{n_{\text{bit}}}B_{k,C}(x,y)\,2^{k}, (1) where B_{k,C}(x,y)\in\{0,1\} denotes the k -th bit of the binary representation of I_{C}(x,y) , with k=0 corresponding to the least significant bit (LSB) and k=n_{\text{bit}} corresponding to the most significant bit (MSB). The k -th bit plane can be extracted using B_{k,C}(x,y)=\left\lfloor\frac{I_{C}(x,y)}{2^{k}}\right\rfloor\bmod 2. (2) Algorithm 1 Bit plane extraction algorithm X_{max} is defined, X_{max}>0 and X\in\mathbb{Z} function BitplaneEncode ( X,X_{max} , mode="MSB" ) n_{bit}\leftarrow\left\lceil\log_{2}(X_{max})\right\rceil \triangleright Get number of bit required to encode image from highest possible value X L\leftarrow[\text{ }] \triangleright Empty list initialization for each X_{shape}.C do for i\leftarrow 0,i<n_{bit},i++ do L.insert(X\mod{2}) \triangleright Element-wise modulo of tensor, then store the bit plane to L X\leftarrow\left\lfloor X/2\right\rfloor \triangleright Element-wise division of input image tensor and floor the result end for end for if mode=="MSB" then L.reverse() \triangleright Reverse original LSB order to MSB format end if B\leftarrow concat(L) \triangleright Concatenate all stored bit planes in L for model inference return B end function To encode an input image batch X into its n_{\text{bit}} bit-plane representation during training, we follow the procedure outlined in Algorithm 1 . For an unnormalized integer-valued tensor batch X , each bit plane is obtained through iterative element-wise division by 2. The remainder at each step corresponds to one bit plane, while the quotient is retained for extraction of subsequent planes. Repeating this process n_{bit} times yields n_{bit} binary tensor batches, each matching the original spatial dimensions X_{shape} . These bit planes are concatenated to form the full bit-plane representation in LSB order; optionally, the ordering may be reversed to produce an MSB format. After obtaining all bit planes B , we encode the corresponding image intensities using the time-to-first-spike (TTFS) scheme. In TTFS encoding, the spike time is inversely related to the input magnitude, decreasing linearly as the intensity increases. Formally, for a normalized input value x\in X_{normalized} where X_{normalized}=X/X_{max} and x\in[0,1] , the firing time is given by t_{f}(x)=(T-1)(1-x), (3) where T denotes the maximum allowable firing time. Thus, larger input values yield earlier spikes (smaller t_{f} ), while smaller values produce later spikes. To construct the proposed hybrid temporal-bit spike representation, we concatenate the TTFS-encoded spike times with the extracted bit-plane tensors. Let X_{TTFS} denote the TTFS spike-timing tensor derived from the input image, and let B=[B_{0},B_{1},\ldots,B_{n_{bit}-1}] represent the set of extracted bit planes. The final spike-chain representation is defined as S=\operatorname{concat}\!\left(X_{TTFS},B_{0},B_{1},\cdots,B_{n_{bit-1}}\right), (4) where \operatorname{concat}(\cdot) denotes timestep-wise concatenation along the temporal dimension T . 3 Experiments and results 3.1 Experimental settings To optimize the SNN components of our model, we employed hard-reset IF neurons with arctangent surrogate gradient function with backpropagate through time (BPTT) [ 9 ] for all benchmarked SNN variants as: \displaystyle\begin{aligned} u_{i}^{(l)}(t)=&\bigl(1-s_{i}^{(l)}(t-1)\bigr)\,u_{i}^{(l)}(t-1)\\ &+W^{(l)}s^{(l-1)}(t)+b_{i}^{(l)},\\ \end{aligned} (5) \displaystyle s_{i}^{(l)}(t)=\Theta\left(u_{i}^{(l)}(t),V_{\text{th}}\right) \displaystyle\Theta(x,V_{th})=\begin{cases}1&\text{if }x-V_{th}\geq 0\\ 0&\text{otherwise}\end{cases} \displaystyle\nabla_{x}\Theta=\frac{\alpha}{2\left(1+\left(\frac{\pi}{2}\alpha x\right)^{2}\right)}\quad\text{where $\alpha=2$} \displaystyle\frac{\partial\mathcal{L}}{\partial W^{(l)}}=\sum_{t=1}^{T}\frac{\partial\mathcal{L}}{\partial s^{(l)}(t)}\cdot\frac{\partial s^{(l)}(t)}{\partial u^{(l)}(t)}\cdot\frac{\partial u^{(l)}(t)}{\partial W^{(l)}} where u_{i}^{(l)}(t) is the membrane potential of neuron i in layer l at time t\in T , s_{i}^{(l)}(t) is the spike