Scaling Up Resonate-and-Fire Networks for Fast Deep Learning
Thomas E. Huber, Jules Lecomte, Borislav Polovnikov, Axel von Arnim · 2025
Read Scaling Up Resonate-and-Fire Networks for Fast Deep Learning by Thomas E. Huber, Jules Lecomte, Borislav Polovnikov, Axel von Arnim (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-00719.txt.
Description
Thomas Huber and co-authors scale up a brain-like neuron type that had never grown past one layer. Resonate-and-fire neurons ring like tiny bells when stimulated, which suits them for event-driven sensors. They are simple and biologically plausible, but nobody could train deep stacks of them. Poor starting settings and slow learning kept them stuck at the surface.
The team rederived the neuron from a modern sequence-model framework, gaining a principled way to set starting values and train quickly. Their new layer stacks four deep, a first for this neuron family. On a spiking version of a speech commands test, it hit 78.8 percent, the best score yet for recurrent spiking networks, in under three hours of training. It also matched rival networks while firing far fewer spikes, which saves energy on neuromorphic chips.
Catalog record
| CREATOR | Thomas E. Huber, Jules Lecomte, Borislav Polovnikov, Axel von Arnim |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-00719