Adaptive Surrogate Gradients for Sequential Reinforcement Learning in Spiking Neural Networks

Korneel Van den Berghe, Stein Stroobants, Vijay Janapa Reddi, G.C.H.E. de Croon · 2025

Read Adaptive Surrogate Gradients for Sequential Reinforcement Learning in Spiking Neural Networks by Korneel Van den Berghe, Stein Stroobants, Vijay Janapa Reddi, G.C.H.E. de Croon (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-24461.txt.

Description

Korneel Van den Berghe and three co-authors tackle training spiking neural networks for sequential reinforcement learning in energy constrained robots. Spiking networks promise large efficiency gains on neuromorphic hardware and process time naturally. Two obstacles stand out: spiking neurons are not differentiable, so surrogate gradients with unclear properties must be used, and their stateful dynamics require training on sequences.

In reinforcement learning, early training offers only short sequences, so the network cannot bridge its warm up period. The authors propose adaptive surrogate gradients tailored to sequential learning, aiming to stabilize optimization and lengthen effective training horizons. The work targets capable control policies that run within tight energy budgets.

Catalog record

CREATORKorneel Van den Berghe, Stein Stroobants, Vijay Janapa Reddi, G.C.H.E. de Croon
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE47 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2510-24461

Browse the full library · About the Tower of Babel