Hardware architecture and routing-aware training for optimal memory usage: a case study

Jimmy Weber 1 3 , Theo Ballet 1 2 3 , Melika Payvand 1 · 2024

Read Hardware architecture and routing-aware training for optimal memory usage: a case study by Jimmy Weber 1 3 , Theo Ballet 1 2 3 , Melika Payvand 1 (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-01575.txt.

Description

Jimmy Weber and co-authors train neural networks with hardware memory limits in mind, in a 2024 case study. Event-based chips route signals between neurons, and that routing eats much of their small on-chip memory. Past work tuned routing at design time, not during training. Two hurdles blocked training-time tuning: routing breaks smooth math, and testing chip fit is costly.

The team extends a pruning-based training method that shuffles connections to save memory. A fast proxy stands in for the true chip-mapping test, so placement rules enter training cheaply. Their demo network, for a spoken digit task, fit the target chip fully. It even gained accuracy while using the same memory budget as before.

Catalog record

CREATORJimmy Weber 1 3 , Theo Ballet 1 2 3 , Melika Payvand 1
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE18 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-01575

Browse the full library · About the Tower of Babel