Adaptive Surrogate Gradients for Sequential Reinforcement Learning in Spiking Neural Networks
Korneel Van den Berghe, Stein Stroobants, Vijay Janapa Reddi, G.C.H.E. de Croon · 2025
Read Adaptive Surrogate Gradients for Sequential Reinforcement Learning in Spiking Neural Networks by Korneel Van den Berghe, Stein Stroobants, Vijay Janapa Reddi, G.C.H.E. de Croon (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-24461.txt.
Description
Korneel Van den Berghe and three co-authors tackle training spiking neural networks for sequential reinforcement learning in energy constrained robots. Spiking networks promise large efficiency gains on neuromorphic hardware and process time naturally. Two obstacles stand out: spiking neurons are not differentiable, so surrogate gradients with unclear properties must be used, and their stateful dynamics require training on sequences.
In reinforcement learning, early training offers only short sequences, so the network cannot bridge its warm up period. The authors propose adaptive surrogate gradients tailored to sequential learning, aiming to stabilize optimization and lengthen effective training horizons. The work targets capable control policies that run within tight energy budgets.
Catalog record
| CREATOR | Korneel Van den Berghe, Stein Stroobants, Vijay Janapa Reddi, G.C.H.E. de Croon |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-24461