STAER: Temporal Aligned Rehearsal for Continual Spiking Neural Network

Matteo Gianferrari, Omayma Moussadek, Riccardo Salami, Cosimo Fiorini, Lorenzo Tartarini, Daniela Gandolfi, Simone Calderara · 2026

Read STAER: Temporal Aligned Rehearsal for Continual Spiking Neural Network by Matteo Gianferrari, Omayma Moussadek, Riccardo Salami, Cosimo Fiorini, Lorenzo Tartarini, Daniela Gandolfi, Simone Calderara (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20870.txt.

Introduction

Matteo Gianferrari and six co-authors teach spiking networks to learn new classes without forgetting old ones. Their 2026 paper presents STAER, a rehearsal method for spiking neural networks. Spiking networks pass signals as brief pulses, like real neurons. Their event-driven timing suits continuous learning well. Class-incremental learning, though, has been blocked by two problems. One is catastrophic forgetting; the other is misaligned spike timing.

Rehearsal stores old examples and replays them during new training. STAER aligns that rehearsal in time, matching the temporal code of spikes. That alignment is the heart of the method's name. Better alignment should let old memories survive new lessons. The work targets brain-like hardware that learns on the job. Such chips could adapt in the field without a data center.

Catalog record

CREATORMatteo Gianferrari, Omayma Moussadek, Riccardo Salami, Cosimo Fiorini, Lorenzo Tartarini, Daniela Gandolfi, Simone Calderara
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-20870

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

STAER: Temporal Aligned Rehearsal for Continual Spiking Neural Network Matteo Gianferrari, Omayma Moussadek, Riccardo Salami, Cosimo Fiorini, Lorenzo Tartarini, Daniela Gandolfi, Simone Calderara Abstract Spiking Neural Networks (SNNs) are inherently suited for continuous learning due to their event-driven temporal dynamics; however, their application to Class-Incremental Learning (CIL) has been hindered by catastrophic forgetting and the temporal misalignment of spike patterns. In this work, we introduce S piking T emporal A lignment with E xperience R eplay ( STAER ), a novel framework that explicitly preserves temporal structure to bridge the performance gap between SNNs and ANNs. Our approach integrates a differentiable Soft-DTW alignment loss to maintain spike timing fidelity and employs a temporal expansion and contraction mechanism on output logits to enforce robust representation learning. Implemented on a deep ResNet19 spiking backbone, STAER achieves state-of-the-art performance on Sequential-MNIST and Sequential-CIFAR10. Empirical results demonstrate that our method matches or outperforms strong ANN baselines (ER, DER++) while preserving biologically plausible dynamics. Ablation studies further confirm that explicit temporal alignment is critical for representational stability, positioning STAER as a scalable solution for spike-native lifelong learning. Code is available at https://github.com/matteogianferrari/staer . 1 Introduction Continual learning (CL) is a critical capability for artificial agents operating in dynamic, non-stationary environments. Rather than training on a fixed dataset, a continual learner must learn from a stream of data where new classes or tasks emerge over time. In naive approaches, updating a neural network on new data causes a drastic performance drop on previously learned classes – a phenomenon known as catastrophic forgetting . This challenge is particularly acute in Class-Incremental Learning (CIL), where a model must learn to distinguish all classes encountered so far without task identifiers. While methods like experience replay and knowledge distillation have enabled progress in standard Artificial Neural Networks (ANNs) [ 20 , 31 ] , these models typically process information in a static, feed-forward manner. This leaves an open question: could a neural paradigm that naturally handles temporal dynamics better address the sequential nature of continual learning? Spiking Neural Networks (SNNs) offer a compelling alternative by mimicking the event-driven processing of biological brains. Unlike ANNs, SNNs communicate via discrete spikes, encoding information in their timing and frequency, which naturally supports sequential data processing and temporal integration [ 35 ] . However, their application to class-incremental learning remains largely unexplored and challenging. In particular, spike-based knowledge does not transfer reliably across tasks due to temporal misalignment : the precise spike timings encoding past classes drift as new tasks are learned, causing interference. Moreover, standard loss functions (e.g., spike counts) fail to penalize such shifts, and naive replay strategies often fail to recover the correct temporal dynamics. In this paper, we introduce a novel SNN framework for class-incremental learning that addresses the inherent temporal challenges of continual learning in the spiking domain. We hypothesize that to prevent forgetting in SNNs, we must explicitly preserve the temporal structure of learned representations. Inspired by biological neural computation, our approach adopts a hybrid coding strategy in which information is jointly encoded by firing rates and spike timing. This dual coding principle is central to biological information processing and suggests that maintaining both rate-based and temporal information is crucial for robust and adaptive behavior in spiking neural networks. More specifically, the rate-based coding hypothesis states that information is encoded in the average firing rate of neurons over a given time window, and has been extensively supported by experimental findings across sensory and motor cortices [ 36 ] . This paradigm underlies many classical models of neural computation and learning, including Hebbian plasticity mechanisms, where synaptic strength is modulated by correlated firing activity [ 16 ] . In parallel, it is well established that the temporal structure of spike trains, including precise spike timing and relative spike latencies, can carry significant information beyond firing rates alone. Temporal coding schemes have been observed in various neural systems, such as the auditory pathway, hippocampus, and visual cortex and cerebellum, where millisecond-scale spike timing conveys stimulus-specific or contextual information [ 38 ] . This view is strongly supported by the discovery of spike-timing-dependent plasticity (STDP), a biologically plausible learning rule in which synaptic modifications depend on the relative timing of pre- and post-synaptic spikes [ 6 ] . To this end, our method integrates two biologically inspired mechanisms. First, we incorporate a differentiable temporal alignment loss based on Soft Dynamic Time Warping (soft-DTW) [ 7 , 4 ] . By applying soft-DTW between current and past output sequences during replay, we ensure that the network maintains the temporal fidelity of its responses across tasks. Second, by leveraging experience-replay, we expand and contract past responses along the temporal axis and align them with the responses of the current network to enforce recoverability of past behavior under different temporal samplings. We implement our approach on a deep convolutional spiking architecture, specifically a ResNet19 SNN [ 48 ] , to ensure scalability to complex image benchmarks. Unlike prior SNN-CL works that often rely on shallow networks or static datasets, our extensive evaluation on class-incremental benchmarks (e.g., Sequential-CIFAR10, Sequential MNIST) demonstrates that deep SNNs can achieve accuracy competitive with state-of-the-art ANN baselines. Our main contributions are summarized as follows: • Novel Temporal Alignment Framework: We propose the first SNN-CL method that utilizes differentiable soft-DTW to explicitly align spike timings between tasks, mitigating the temporal drift that causes catastrophic forgetting. • State-of-the-Art Performance: We show that our alignment-enhanced ResNet19 SNN achieves performance on par with strong ANN baselines in class-incremental settings, bridging the accuracy gap between neuromorphic and traditional continual learning. 2 Related works ResNet is one of the most popular architectures to tackle the problem of degradation in deeper neural networks [ 19 ] . Such networks explicitly reformulate the layers as learning residual functions with reference to the layer inputs, instead of learning unreferenced functions [ 15 ] . ResNet has been widely employed as a backbone network in continual learning benchmarks due to its strong empirical performance, stable optimization properties and widespread adoption in image classification tasks [ 5 , 43 ] . As most ANN models, ResNet suffers from catastrophic forgetting, whereby learning a new task leads to a degradation of performance on previously acquired tasks [ 22 , 19 , 31 ] . This limitation motivates the investigation of alternative neural paradigms inspired by biological computation. In this context, SNN encode neuronal activity through sparse, binary communication, mimicking the physiological synaptic dynamics of the human brain [ 35 ] . Such properties offer mechanisms that may naturally mitigate catastrophic forgetting by enabling new knowledge to be built upon previously learned representations. In biological systems, long-term memory formation emerges from the interaction of multiple mechanisms, including synaptic plasticity, memory replay, neuromodulatory signals, and recurrent connectivity [ 18 ] . Recent SNN models have been explicitly designed to reproduce these effects. For instance, in SNNs synaptic weight updates occur only when a presynaptic neuron’s membrane potential reaches a threshold and emits a spike, in contrast to ANNs where weights are updated even for neurons with very small activation values [ 28 , 27 ] . This event-driven learning mechanism has been suggested to act as a form of task-dependent gating, whereby synapses critical

Read the complete text