General Self-Prediction Enhancement for Spiking Neurons
Zihan Huang, Zijie Xu, Yifan Huang, Shanshan Jia, Tong Bu, Yiting Dong, Wenxuan Liu, Jianhao Ding, Zhaofei Yu, Tiejun Huang · 2026
Read General Self-Prediction Enhancement for Spiking Neurons by Zihan Huang, Zijie Xu, Yifan Huang, Shanshan Jia, Tong Bu, Yiting Dong, Wenxuan Liu, Jianhao Ding, Zhaofei Yu, Tiejun Huang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21823.txt.
Introduction
Zihan Huang and co-authors try to give spiking neurons a sense of prediction. Spiking neural networks save energy because they compute only when spikes occur, in short events. Their training is hard, though, because spikes cannot be differentiated smoothly, and designers face trade-offs among accuracy, efficiency, and realism.
The authors note that mainstream spiking networks ignore predictive coding, a core idea about how the brain works. Predict the input, then encode only the error. Their 2026 preprint proposes a general self-prediction enhancement for spiking neurons built on that idea. If prediction can be woven into spiking models cleanly, the networks could keep their energy edge while closing the accuracy gap with ordinary deep networks.
Catalog record
| CREATOR | Zihan Huang, Zijie Xu, Yifan Huang, Shanshan Jia, Tong Bu, Yiting Dong, Wenxuan Liu, Jianhao Ding, Zhaofei Yu, Tiejun Huang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-21823
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
General Self-Prediction Enhancement for Spiking Neurons Zihan Huang, Zijie Xu, Yifan Huang, Shanshan Jia, Tong Bu, Yiting Dong, Wenxuan Liu, Jianhao Ding, Zhaofei Yu, Tiejun Huang Abstract Spiking Neural Networks (SNNs) are highly energy-efficient due to event-driven, sparse computation, but their training is challenged by spike non-differentiability and trade-offs among performance, efficiency, and biological plausibility. Crucially, mainstream SNNs ignore predictive coding, a core cortical mechanism where the brain predicts inputs and encodes errors for efficient perception. Inspired by this, we propose a self-prediction enhanced spiking neuron method that generates an internal prediction current from its input–output history to modulate membrane potential. This design offers dual advantages, it creates a continuous gradient path that alleviates vanishing gradients and boosts training stability and accuracy, while also aligning with biological principles, which resembles distal dendritic modulation and error-driven synaptic plasticity. Experiments show consistent performance gains across diverse architectures, neuron types, time steps, and tasks demonstrating broad applicability for enhancing SNNs. 1 Introduction Spiking Neural Networks (SNNs) constitute a biologically plausible class of neural network models that communicate through discrete, time-encoded spikes ( 30 ) . Unlike conventional Artificial Neural Networks (ANNs), which rely on continuous activation values, SNNs activate only when a neuron’s membrane potential crosses a firing threshold ( 11 ) . This event-driven mechanism leads to highly sparse computation, making SNNs exceptionally energy-efficient for deploying intelligent systems on resource-constrained edge hardware ( 24 ) . Recent neuromorphic platforms such as Loihi ( 4 ) , TrueNorth ( 5 ) , Darwin ( 29 ) and Tianjic ( 35 ) have demonstrated the potential of SNNs to enable low-power, real-time inference. Despite these benefits, training high performance SNNs remains a big challenge. The core issue stems from the binary, non-differentiable nature of spike events, which is not suitable for standard backpropagation. Moreover, simulating temporal dynamics during training often demands substantial memory and computational overhead. To circumvent these limitations, researchers have developed two main paradigms for building high-performance SNNs: direct training and ANN-to-SNN conversion. Direct training approaches attempt to learn SNN weights end-to-end by approximating gradients through surrogate gradient functions ( 34 ; 6 ) , or by leveraging biologically motivated rules like spike-timing-dependent plasticity (STDP) ( 33 ; 31 ; 32 ) . While these methods aim to fully exploit the temporal information of spiking dynamics, they often suffer from long convergence times, and accuracy gaps on benchmark datasets ( 12 ) . In contrast, ANN-to-SNN conversion first trains a high-accuracy ANN using standard deep learning methods and then converting it into an SNN that approximates its input–output behavior through rate-based or temporal coding schemes ( 3 ; 36 ; 13 ; 25 ; 2 ; 19 ) . Although the converted SNN is still more energy-efficient than the original ANN, it usually incurs a non-negligible accuracy drop especially under tight latency. Meanwhile, the resulting SNN merely replicates ANN functionality without leveraging temporal spiking dynamics, and thus lacks biological interpretability. Despite those advances in SNNs, they largely ignore a core principle of cortical computation: the brain predicts sensory inputs and computes deviations from prediction errors. Evidence shows that individual auditory neurons fire selectively to omitted expected sounds, directly signaling prediction errors at the single-neuron level ( 21 ; 22 ) . Pre-activated neural templates resembling actual stimulus responses further support this predictive coding framework ( 38 ) , with recent work identifying neurons specifically tuned to negative prediction errors ( 51 ) . Beyond population-level mechanisms, prediction may also occur within single neurons. ( 14 ) proposed that dendritic branches act as independent pattern detectors, enabling internal predictions. This aligns with models where dendrites predict somatic activity, and local prediction errors drive synaptic plasticity ( 44 ; 1 ; 37 ) . Yet such biologically grounded, neuron-intrinsic predictive mechanisms are missing from most SNNs. Inspired by these, we propose a self-prediction enhanced spiking neuron method that is compatible with most spiking neuron model within arbitrary spiking neural networks. The core idea is to enable each neuron to leverage its own historical inputs and outputs to internally generate a self-prediction error to further generate prediction current, which dynamically modulates its membrane potential as an auxiliary input current. This prediction current can pre-activate expected spiking events and generate a prediction error signal when the actual output deviates from the prediction, thereby facilitating or suppressing subsequent spike emissions. Our main contributions are summarized as follows: • We propose a prediction current based on self-prediction error and demonstrate how it enhances arbitrary spiking neurons. • We provide a thorough analysis of the self-prediction enhanced neuron from the perspectives of dynamics, gradient propagation, and biological plausibility. • We evaluate our method on image classification tasks across various network architectures, spiking neuron models, and datasets, demonstrating its effectiveness. • We further validate our approach in sequential classification tasks and reinforcement learning tasks with multiple neuron types to verify its broad applicability and robustness. 2 Related Works 2.1 Direct Training of SNNs Recent years have witnessed significant progress in directly training deep SNNs. Pioneering works such as STBP ( 46 ) , SuperSpike ( 54 ) , and SLAYER ( 39 ) introduced surrogate gradient methods to avoid the non-differentiability of spike emission, enabling end-to-end supervised learning. Subsequent efforts further enhanced SNN performance through more expressive neuron models such as learnable membrane time constants ( 9 ) , adaptive firing thresholds with moderate dropout ( 45 ) , complementary LIF dynamics to mitigate temporal gradient vanishing ( 18 ) , and unified gated LIF frameworks that integrate diverse biological features ( 50 ) . Concurrently, architectural advances in residual architectures such as Spiking ResNet ( 15 ) , SEW ResNet ( 8 ) , and MS-ResNet ( 16 ) have mitigated degradation and enabled stable training of deep networks; Meanwhile, attention-based models including Spikformer ( 56 ) , Spike-driven Transformer ( 49 ) , and QKFormer ( 55 ) , have successfully integrated self-attention mechanisms into the spiking paradigm. Despite these advances, most approaches prioritize engineering performance over biological interpretability. To bridge this gap, researchers have incorporated recurrent or feedback connections to emulate the brain’s intrinsic recurrent processing ( 27 ; 26 ; 52 ; 28 ) . While biologically inspired, such recurrent SNNs often suffer from high computational costs, slow convergence, and difficulty in scaling to large architectures, limiting their practical utility. This trade between efficiency and plausibility calls for a new neuron-level mechanism that intrinsically integrates predictive feedback dynamics without relying on costly global recurrence. 2.2 Predictive Coding Theory Predictive coding (PC) aims to minimizes redundancy by propagating prediction errors rather than raw sensory signals ( 7 ) . In neuroscience, PC has been formalized as a hierarchical inference framework where higher areas generate predictions and lower areas compute local mismatches ( 17 ; 40 ) . A growing body of work indicate that prediction operates not only at the network level but within individual neurons ( 14 ) . Consistent with this view, several computational models formalize dendritic processing as a form of predictive coding, where basal or apical dendrites learn to predict somatic activity, and synaptic plasticity is driven by local prediction errors ( 44 ; 1 ; 37 ) . Predictive coding has also