SPARTA: Advancing Sparse Attention in Spiking Neural Networks via Spike-Timing-Based Prioritization

Minsuk Jang, Changick Kim · 2025

Read SPARTA: Advancing Sparse Attention in Spiking Neural Networks via Spike-Timing-Based Prioritization by Minsuk Jang, Changick Kim (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-01646.txt.

Description

Minsuk Jang and Changick Kim present SPARTA in a 2025 paper on brain-like computer networks that work with brief spikes. Most such networks count how often spikes fire and ignore when they fire. SPARTA instead ranks input items by their timing, using firing patterns and gaps between spikes to pick which items deserve close attention.

By keeping only the top items, the method cuts the cost of attention while holding accuracy high. The team reports strong scores on gesture and image test sets, with sparsity above sixty percent. Results suggest that timing, long treated as noise, can guide leaner and sharper spike-based models. The work points toward chips that do more with far less energy.

Catalog record

CREATORMinsuk Jang, Changick Kim
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-01646

Browse the full library · About the Tower of Babel