Hardware architecture and routing-aware training for optimal memory usage: a case study
Jimmy Weber 1 3 , Theo Ballet 1 2 3 , Melika Payvand 1 · 2024
Read Hardware architecture and routing-aware training for optimal memory usage: a case study by Jimmy Weber 1 3 , Theo Ballet 1 2 3 , Melika Payvand 1 (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-01575.txt.
Description
Jimmy Weber and co-authors train neural networks with hardware memory limits in mind, in a 2024 case study. Event-based chips route signals between neurons, and that routing eats much of their small on-chip memory. Past work tuned routing at design time, not during training. Two hurdles blocked training-time tuning: routing breaks smooth math, and testing chip fit is costly.
The team extends a pruning-based training method that shuffles connections to save memory. A fast proxy stands in for the true chip-mapping test, so placement rules enter training cheaply. Their demo network, for a spoken digit task, fit the target chip fully. It even gained accuracy while using the same memory budget as before.
Catalog record
| CREATOR | Jimmy Weber 1 3 , Theo Ballet 1 2 3 , Melika Payvand 1 |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 18 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-01575