Structured State Space Model Dynamics and Parametrization for Spiking Neural Networks

Maxime Fabre [email protected], Lyubov Dudchenko [email protected], Emre Neftci [email protected] · 2025

Read Structured State Space Model Dynamics and Parametrization for Spiking Neural Networks by Maxime Fabre [email protected], Lyubov Dudchenko [email protected], Emre Neftci [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-06374.txt.

Introduction

Maxime Fabre and co-authors steady spiking neural networks in a 2025 paper. Spiking neurons fire in sparse bursts yet can hold rich inner dynamics. Training them often wobbles, since gradients blow up through those dynamics.

The team borrow tricks from state space models, which train calmly on long streams. Their two neuron forms add a learned time step and log-scale settings, and one adds a wave-friendly start drawn from complex state models. Both forms set new best scores among spiking models on event and raw speech sets. They also beat state space models at half the compute cost in their tests.

Catalog record

CREATORMaxime Fabre [email protected], Lyubov Dudchenko [email protected], Emre Neftci [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE50 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-06374

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Structured State Space Model Dynamics and Parametrization for Spiking Neural Networks Maxime Fabre [email protected], Lyubov Dudchenko [email protected], Emre Neftci [email protected] Abstract Multi-state spiking neurons such as the adaptive leaky integrate-and-fire (AdLIF) neuron offer compelling alternatives to conventional deep learning models thanks to their sparse binary activations, second-order nonlinear recurrent dynamics and efficient hardware realizations. However, such internal dynamics can cause instabilities during inference and training, often limiting performance and scalability. Meanwhile, state space models (SSMs) excel in long sequence processing using linear state-intrinsic recurrence resembling spiking neurons’ subthreshold regime. Here, we establish a mathematical bridge between SSMs and second-order spiking neuron models. Based on structure and parametrization strategies of diagonal SSMs we propose two novel spiking neuron models. The first extends the AdLIF neuron through timestep training and logarithmic reparametrization to facilitate training and improve final performance. The second additionally brings initialization and structure from complex-state SSMs, broadening the dynamical regime to oscillatory dynamics. Together, our two models achieve beyond or near state-of-the-art (SOTA) performances for reset-based spiking neuron models across both event-based and raw audio speech recognition datasets. We achieve this with a favorable number of parameters and required dynamic memory while maintaining high activity sparsity. Our models demonstrate enhanced scalability in network size and strike a favorable balance between performance and efficiency with respect to SSM models. Our code is available at https://github.com/Maxtimer97/SSM-inspired-LIF . 1 Introduction Spiking Neural Networks (SNNs) and their realization in neuromorphic hardware are gaining interest as promising low-power alternatives to artificial neural networks (ANNs) [ 1 , 2 ] . On top of being compact recurrent units with strong temporal encoding capabilities, the biologically inspired binary spiking and the nonlinear feedback mechanism known as reset provide spiking neurons with highly efficient and sparse event-based communication. In the following, we refer to such models as reset-based spiking models, in contrast to non-reset models that only offer linear recurrence and non-spiking models that do not employ binary or at least graded spiking. Considering that sparse [ 3 ] and matmul-free [ 4 ] schemes have been receiving significant attention in more traditional models, like transformers, as a way to drastically reduce the computational complexity of ever-growing models, the avenue for high-performing, efficient SNNs is more relevant than ever. Over the past decade, methods leveraging surrogate gradients to train SNNs similarly to recurrent neural networks (RNNs) using backpropagation through time (BPTT) have significantly advanced SNN performance on a variety of benchmarks [ 5 , 6 ] , as for instance the central adaptive leaky integrate-and-fire (AdLIF) model for audio classification tasks [ 7 ] . However, despite these successes, SNNs remain challenging to train and scale. They often exhibit unstable dynamics, which can hinder convergence and limit their applicability to larger, more complex tasks [ 8 ] . A potential avenue to addressing these challenges is through the perspective of state space models (SSMs), which have recently demonstrated superior performance in modeling long sequences, often outperforming traditional RNNs on various benchmarks [ 9 , 10 , 11 ] . This gain in performance on long sequences is not only due to the fact that SSMs constrain themselves to a linear recurrent state, unlike traditional RNNs or SNNs, but also to additional training optimizations. In fact, deep learning SSMs like the S4 model [ 9 ] incorporate architectural innovations, such as structured parameterizations and initialization, providing more robust and backpropagation-friendly recurrent state dynamics [ 12 ] . This study leverages the dynamic system modeling strengths of the S4 model to enhance nonlinear recurrent SNNs on spatiotemporal sequences. Specifically, we establish a parallel between the AdLIF model, the resonate-and-fire (RF) neuron, and SSMs. Building on these insights, we propose two models: (1) The SSM-inspired LIF (SiLIF) model, a S4-based enhancement of the AdLIF neuron with timestep training and logarithmic reparametrization. (2) the complex-valued SSM-inspired LIF (C-SiLIF) model, a novel top-down designed spiking neuron employing the diagonal S4 (S4D) [ 10 ] resonant dynamics, parametrization and initialization with a matching reset mechanism. Following previous work, we evaluate these reset-based spiking models on a suite of keyword classification datasets, both in the event-based and raw audio domains. Both SiLIF and C-SiLIF achieve state-of-the-art or highly competitive performance, offering improvements in training stability, accuracy and scalability due to the integration of SSM-inspired features. Our novel contributions are: 1. Establishing a theoretical bridge between SSMs and spiking neural networks (SNNs), revealing novel insights into their shared and diverging training dynamics. 2. Proposing two novel reset-based spiking neuron models that incorporate SSM-derived dynamics and parametrizations. 3. Demonstrating significant improvements in accuracy and scalability on audio classification tasks while maintaining efficiency, surpassing previous reset-based models. 4. Demonstrating Pareto optimal performance that balances accuracy and computational efficiency relative to SSMs for event-based data. Figure 1 : Proposed method to distill features of modern structured state space models (SSMs) to build novel high performing spiking neural networks (SNNs). The SiLIF model is an enhancement of the adaptive LIF (AdLIF) neuron through reparametrization of its state transition matrix following the S4 model. The C-SiLIF additionally exploits the complex representation and the specific initialization of the S4D model, drawing a parallel with the resonate-and-fire (RF) neuron. The right part of the figure illustrates the similar structure of SSMs and SNNs, plus the SNN-exclusive reset mechanism. 2 Related work Spiking neural networks for spoken word classification tasks Training deep and high performance SNNs has become possible using techniques from deep learning, such as the surrogate gradient method [ 13 ] , error backpropagation mechanisms [ 14 ] , and ANN-to-SNN conversion [ 15 ] . One promising application for spiking neurons has been the classification of spoken words. This was demonstrated by Bittar and Garner 2022 , with the use of their specific adaptive leaky integrate-and-fire (AdLIF) neuron, inspired from previous neuroscience and neuromorphic studies [ 16 , 17 , 18 , 19 , 20 ] , and which we re-introduce precisely in the Methods section. Different iterations refined the AdLIF model, either by constraining certain parameters [ 21 ] , or by employing a different discretization approach [ 22 ] , but they only led to marginal improvements on large scale datasets. Our work significantly advances this line by extending the AdLIF through SSM-inspired training dynamics. Additionally, recent works have explored the application of the resonate-and-fire (RF) neuron model introduced by Izhikevich 2001 in deep SNNs [ 24 , 25 , 26 ] . But despite their biological plausibility, RF-based SNNs have yet to achieve state-of-the-art (SOTA) performance within the deep learning paradigm. Very recently, Huber et al. 2025 even proposed a scaled-up RF model employing SSM structure, but their performance still lacks behind previous spiking references. Our study identifies poor training initialization and parametrization as key bottlenecks in such models and proposes the first RF-style spiking neuron achieving SOTA performance on audio classification benchmarks. A recent work by Karilanova et al. 2024 also proposed a general spiking neuron model bridging SSMs and SNNs to employ signal processing techniques to adapt neuron dynamics with the temporal resolution. Synaptic delays [ 29 ] enhance SNN models temporal processing capabilities, achieving SOTA accuracy on event-based datasets, while maintaining practical training times. Deckers et al. 2023 employ these learnable delays on top

Read the complete text