Globally Optimal Training of Spiking Neural Networks via Parameter Reconstruction

Himanshu Udupi, Xiaocong Yang, ChengXiang Zhai · 2026

Read Globally Optimal Training of Spiking Neural Networks via Parameter Reconstruction by Himanshu Udupi, Xiaocong Yang, ChengXiang Zhai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-08022.txt.

Description

Himanshu Udupi, Calvin Ang, Sungyoon Kim, Xiaocong Yang, and coauthors reframe how spiking neural networks are trained. Spiking networks promise low energy use, but their training problem is non-convex and the spike function has no useful derivative, so standard methods carry no promise of reaching the best solution.

The team shows that weight-decay training for a class of threshold recurrent networks, including leaky integrate-and-fire models, has zero duality gap with a convex program of the same value. Since that program can be huge, they add a randomized surrogate with a high-probability quality guarantee. In tests, the best convex variant beat surrogate-gradient training on some tasks.

Catalog record

CREATORHimanshu Udupi, Xiaocong Yang, ChengXiang Zhai
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE96 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.08022

Browse the full library · About the Tower of Babel