Backpropagation-free Spiking Neural Networks with the Forward-Forward Algorithm
Mohammadnavid Ghader, Saeed Reza Kheradpisheh, Bahar Farahani, Mahmood Fazlali · 2025
Read Backpropagation-free Spiking Neural Networks with the Forward-Forward Algorithm by Mohammadnavid Ghader, Saeed Reza Kheradpisheh, Bahar Farahani, Mahmood Fazlali (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-20411.txt.
Introduction
Mohammadnavid Ghader, Saeed Reza Kheradpisheh, Bahar Farahani, and Mahmood Fazlali wrote this paper in two thousand twenty-five. It trains spiking neural networks, which fire in brief pulses like brain cells, with the Forward-Forward algorithm instead of backpropagation.
Backpropagation is costly for such nets and far from how brains learn. The Forward-Forward scheme learns layer by layer through two forward passes, which suits neuromorphic chips. The team's frame beats past Forward-Forward spiking nets on still image sets with a much lighter build. On sound-based spiking tasks it tops other spiking models and stays close to the best backpropagation-trained ones. The work marks a workable path past a long training snag.
Catalog record
| CREATOR | Mohammadnavid Ghader, Saeed Reza Kheradpisheh, Bahar Farahani, Mahmood Fazlali |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-20411
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Backpropagation-free Spiking Neural Networks with the Forward-Forward Algorithm Mohammadnavid Ghader, Saeed Reza Kheradpisheh, Bahar Farahani, Mahmood Fazlali Abstract Spiking Neural Networks (SNNs) offer a biologically inspired computational paradigm that emulates neuronal activity through discrete spike-based processing. Despite their advantages, training SNNs with traditional backpropagation (BP) remains challenging due to computational inefficiencies and a lack of biological plausibility. This study explores the Forward-Forward (FF) algorithm as an alternative learning framework for SNNs. Unlike backpropagation, which relies on forward and backward passes, the FF algorithm employs two forward passes, enabling layer-wise localized learning, enhanced computational efficiency, and improved compatibility with neuromorphic hardware. We introduce an FF-based SNN training framework and evaluate its performance across both non-spiking (MNIST, Fashion-MNIST, Kuzushiji-MNIST) and spiking (Neuro-MNIST, SHD) datasets. Experimental results demonstrate that our model surpasses existing FF-based SNNs on evaluated static datasets with a much lighter architecture while achieving accuracy comparable to state-of-the-art backpropagation-trained SNNs. On more complex spiking tasks such as SHD, our approach outperforms other SNN models and remains competitive with leading backpropagation-trained SNNs. These findings highlight the FF algorithm’s potential to advance SNN training methodologies by addressing some key limitations of backpropagation. 1 Introduction Spiking Neural Networks (SNNs), as a biologically inspired model of neural computation, are designed to process information using discrete spike events [ 1 ] , closely mimicking the dynamics of real neurons. However, training SNNs remains a significant challenge, primarily due to the credit assignment problem [ 2 ] and the difficulty of attributing the contributions of individual neurons to network output errors. Unlike traditional artificial neural networks, SNNs operate on non-differentiable spiking activities, complicating the application of gradient-based training methods like backpropagation [ 3 ] . To address this, surrogate gradient [ 4 ] methods are introduced, allowing approximate gradients for effective training while preserving the spike-based behavior of SNNs. The surrogate gradient method replaces the non-differentiable spike activation function with a smooth, differentiable approximation during the backward pass of training. This enables the use of gradient-based learning algorithms such as backpropagation in the training process of SNNs. Despite notable successes in training spiking neural networks, backpropagation has faced persistent criticism for its training challenges and lack of alignment with the mechanisms of the brain [ 5 ] , raising doubts about its viability as a model for credit assignment in neural systems [ 6 ] . One of the major limitations lies in its requirement to explicitly store all neural activity for later use during synaptic adjustments. This explicit storage mechanism has no direct counterpart in biological neural circuits, where memory and computation are more integrated [ 7 ] . Another significant challenge is the requirement for error derivatives to propagate through a dedicated global feedback pathway within the network to generate teaching signals. This kind of structured, system-wide error communication contrasts sharply with the distributed and localized nature of information processing in the brain [ 8 ] . It may, in certain cases, exacerbate issues such as vanishing and exploding gradients in algorithmic implementations. Furthermore, backpropagation assumes that global error signals can move backward through the same neural pathways used for forward propagation, a phenomenon referred to as the weight transport problem [ 9 ] . This assumption is biologically implausible, as neural pathways in the brain are not designed to facilitate such exact bidirectional transport [ 10 ] . The sequential nature of backpropagation adds another layer of incompatibility. Unlike the brain’s ability to perform massively parallel computations, backpropagation enforces a process where inference and learning must occur largely step-by-step. This sequentiality significantly diverges from biological neural networks’ highly dynamic and concurrent operations [ 11 ] . These challenges highlight why backpropagation is unlikely to serve as a biologically plausible brain learning model. However, recent advancements have been exploring alternative approaches [ 12 ] that address some of these limitations and offer solutions more in line with biological principles. The Forward-Forward algorithm [ 13 ] , inspired by contrastive methods like Boltzmann Machines [ 14 ] and Noise Contrastive Estimation [ 15 ] , is a novel alternative to the traditional backpropagation method for training neural networks, which Geoffrey Hinton introduced. This algorithm replaces backpropagation’s forward and backward passes with two forward passes. Each network layer has its own objective function to optimize the corresponding layer’s weights. FF does not require storing all intermediate activities for updating each layer’s weights, nor does it assume symmetrical weight connections. This makes it a more plausible model for cortical learning and suitable for low-power analog hardware [ 13 ] . Also, FF can process data sequentially, enabling on-the-fly learning without halting the data pipeline for all the weights’ updating. Another feature of FF is that, unlike backpropagation, it does not require direct connectivity of all consecutive layers through the forward pass, allowing for the inclusion of black-box components within the network. Motivated by the advantages of the FF algorithm and its potential for SNN training, this work develops an FF-based SNN learning approach and investigates its performance on static and spiking benchmark datasets. We summarize our contributions as follows: • A novel gradient-based learning approach is introduced for training spiking neural networks inspired by the Forward-Forward algorithm, which demonstrates strong performance across a range of benchmark datasets. • A structured training approach for spiking neural networks that leverages key principles of the Forward-Forward algorithm, including layer-wise local learning, black-box compatibility, and additional advantageous features. • Experimental results of our SNN model, trained using the FF algorithm on spiking datasets such as N-MNIST and SHD, demonstrate competitive performance compared to backpropagation-based models and establish the FF approach as a viable alternative for training spiking neural networks. The rest of this paper is organized as follows: Section 2 overviews related work and backgrounds of SNNs and the FF algorithm. Section 3 presents the proposed method. Section 4 elaborates on the experimental setup and results. Finally, Section 5 concludes the paper and suggests a direction for future work. Figure 1 : Different options for overlaying a label on a sample of a 10-class dataset for positive and negative sample generation. 2 Related Work and Background This section provides an overview of the literature relevant to our work, covering learning approaches for spiking neural networks, the Forward-Forward algorithm, and its application within the context of SNNs. 2.1 Learning Approaches for SNNs Since the emergence of spiking neural networks, various ways have been used to train them. These learning approaches are generally divided into three categories: STDP, ANN-SNN conversion, and Backpropagation. STDP [ 16 ] is an unsupervised learning algorithm inspired by biological neural systems, which adjusts synaptic weights based on the relative timing of presynaptic and postsynaptic spikes. The fundamental principle is that the order of these spikes determines whether the synapse is strengthened or weakened. In Hebbian STDP, a presynaptic spike occurring before a postsynaptic spike leads to synaptic strengthening, reinforcing the association between neurons. Conversely, in anti-Hebbian STDP, the same spike timing results in synaptic weakening, promoting different forms of neural plasticity [ 17 ] . Some variants of the STDP approach include Reward-modulated STDP [ 18 ] , Mirrored STDP [ 19 ] , and Probabilistic STDP [ 20 ] , each of which can be utilized for different