Spatio-Temporal Pruning for Compressed Spiking Large Language Models
Yi Jiang 1 , Malyaban Bal 1 , Brian Matejek 2 , Susmit Jha 2 , Adam Cobb 2 , Abhronil Sengupta 1 · 2025
Read Spatio-Temporal Pruning for Compressed Spiking Large Language Models by Yi Jiang 1 , Malyaban Bal 1 , Brian Matejek 2 , Susmit Jha 2 , Adam Cobb 2 , Abhronil Sengupta 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-20122.txt.
Description
Yi Jiang and co-authors propose spatio-temporal pruning for compressed spiking large language models in a 2025 paper. Big language models are heavy and slow, which blocks use where energy is scarce.
Spiking networks mimic the sparse, event-driven firing of brains and promise low power. Spatial pruning cuts active neurons and attention heads to shrink compute. Temporal pruning adjusts how many time steps each layer needs, trimming latency. The frame also joins extreme quantization and knowledge distillation. Tests on a spiking BERT across a broad language benchmark show large savings in operations and latency with performance kept. The work pushes language models toward low-power hardware.
Catalog record
| CREATOR | Yi Jiang 1 , Malyaban Bal 1 , Brian Matejek 2 , Susmit Jha 2 , Adam Cobb 2 , Abhronil Sengupta 1 |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 54 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-20122