Mapping Spiking Neural Networks to Heterogeneous Crossbar Architectures using Integer Linear Programming
Devin Pohl, Aaron Young, Kazi Asifuzzaman, Narasinga Rao Miniskar, Jeffrey S. Vetter · 2025
Read Mapping Spiking Neural Networks to Heterogeneous Crossbar Architectures using Integer Linear Programming by Devin Pohl, Aaron Young, Kazi Asifuzzaman, Narasinga Rao Miniskar, Jeffrey S. Vetter (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-02033.txt.
Introduction
Devin Pohl and co-authors write a compiler that fits brain-like networks onto mixed sizes of memory hardware, in a 2025 paper. Spiking networks run well on memristor crossbars, grids that store and compute at once. Big networks must split across many crossbars, and past tools assumed every crossbar was the same size. Mixed sizes, though, waste far less area, since these networks are mostly empty.
The team cast the fitting task as an integer linear program that allows any crossbar sizes. Their model tracks how signals pass between neurons, so no prior knowledge is needed. On even grids they cut area by up to about twenty-eight percent. Mixed grids cut a further two-thirds or more.
Catalog record
| CREATOR | Devin Pohl, Aaron Young, Kazi Asifuzzaman, Narasinga Rao Miniskar, Jeffrey S. Vetter |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-02033
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Mapping Spiking Neural Networks to Heterogeneous Crossbar Architectures using Integer Linear Programming Devin Pohl, Aaron Young, Kazi Asifuzzaman, Narasinga Rao Miniskar, Jeffrey S. Vetter Abstract Advances in novel hardware devices and architectures allow Spiking Neural Network (SNN) evaluation using ultra-low power, mixed-signal, memristor crossbar arrays. As individual network sizes quickly scale beyond the dimensional capabilities of single crossbars, networks must be mapped onto multiple crossbars. Crossbar sizes within modern Memristor Crossbar Architectures (MCAs) are determined predominately not by device technology but by network topology; more, smaller crossbars consume less area thanks to the high structural sparsity found in larger, brain-inspired SNNs. Motivated by continuing increases in SNN sparsity due to improvements in training methods, we propose utilizing heterogeneous crossbar sizes to further reduce area consumption. This approach was previously unachievable as prior compiler studies only explored solutions targeting homogeneous MCAs. Our work improves on the state-of-the-art by providing Integer Linear Programming (ILP) formulations supporting arbitrarily heterogeneous architectures. By modeling axonal interactions between neurons, our methods produce better mappings while removing inhibitive a priori knowledge requirements. We first show a 16.7–27.6% reduction in area consumption for square-crossbar homogeneous architectures. Then, we demonstrate 66.9–72.7% further reduction when using a reasonable configuration of heterogeneous crossbar dimensions. Next, we present a new optimization formulation capable of minimizing the number of inter-crossbar routes. When applied to solutions already near-optimal in area, an 11.9–26.4% routing reduction is observed without impacting area consumption. Finally, we present a profile-guided optimization capable of minimizing the number of runtime spikes between crossbars. Compared to the best-area-then-route optimized solutions, we observe a further 0.5–14.8% inter-crossbar spike reduction while requiring 1–3 orders of magnitude less solver time. † † aftertitle: I Introduction The forefront of hardware-accelerated machine learning is currently experiencing a pivotal moment. The near-universal application of neural networks has outgrown traditional models (DNNs, CNNs, etc.) under expanding application spaces and problem complexity, with Spiking Neural Networks (SNNs) gaining popularity thanks to comparable accuracy despite significantly lower neuron counts [ 1 , 2 , 3 , 4 , 5 ] . Simultaneously, co-design with resistive-RAM technologies has contributed to material, device, and architecture-level improvements to Memristor Crossbar Architectures (MCAs). These developments together enable remarkably power- and area-efficient neuromorphic computing [ 6 , 7 , 8 , 9 , 10 , 11 ] . For the first time, co-design between MCAs and SNNs is nearing a full-stack solution for accessible, ultra-low-power inference of general-purpose, highly-accurate machine learning models. However, dominant network structures of SNNs have shifted in recent years. Between advances in initial network generation [ 12 , 13 , 14 ] , training [ 15 , 16 ] , and pruning methods [ 13 , 17 , 18 , 19 ] , networks have evolved drastically increased structural sparsity. Where previously, architectures only needed many small crossbars to support ever-growing networks, today’s architectures require ever more ingenious tricks to fully take advantage of increasing sparsity [ 8 , 9 , 10 , 11 ] . Yet, these architectural improvements outpace compiler technology. Partitioning SNNs and mapping neuron clusters to various crossbars remains an open problem, with many recent approaches scaling to increasing network sizes [ 20 , 21 , 22 , 23 ] . However, these approximate solutions fail to support the level of target architecture heterogeneity required for leveraging structural sparsity to improve area and power metrics. To the best of our knowledge, SpikeHard [ 24 ] is the first study with potential to jump the gap, utilizing Integer Linear Programming (ILP) for improved area optimization. However, two main limitations are present with this work: (1) it requires an initial solution and (2) it produces solutions demonstrably sub-optimal in area consumption. Furthermore, the base ILP constraints presented in SpikeHard prohibit the optimization of more useful heuristics. This work improves on the state-of-the-art in SNN to MCA mapping through the following contributions: • Providing ILP formulations that remove the need for an a priori known-valid solution while allowing for production of truly area-optimal solutions. • Providing ILP formulations to minimize the number of required network routes between crossbars. • Providing ILP formulations leveraging prior inference spike profiles for minimizing runtime network packets. The rest of this text is organized as follows: Section II discusses background material, section III explains opportunities for improvement over the state-of-the-art, section IV shows the contributed ILP formulations and their meaning, and section V experimentally shows the effectiveness and tradeoff characteristics of these techniques. II background This section summarizes key concepts and trends including spiking neural networks and training methods, memristor crossbar architectures and scaling efforts, use of integer linear programming in mapping, and profile-guided optimization. II-A Spiking Neural Networks Neuromorphic computing involves utilizing bio-plausible artificial neural networks for computation. While this can include emulating neural components beyond just neurons and axons [ 1 ] , the approach most relevant to applied machine learning is the Spiking Neural Network (SNN) with simple integrate-and-fire neurons. Instead of executing every neuron per input window like in DNNs, GNNs, etc, neurons in SNNs accumulate charge and, upon reaching a threshold, fire discrete ”spikes” of information along axons which may delay the signals. With appropriate hardware, SNNs achieve much higher energy efficiency without significant loss in accuracy [ 2 , 3 , 4 , 5 ] . Training SNNs is still an open problem with fervent development [ 25 ] . While one class of training methods focuses on converting other types of networks (mainly CNNs, but also DNNs) into SNNs through various processes [ 26 , 17 , 27 , 28 , 29 ] , literature suggests that training SNNs ”from scratch” produces networks with higher amounts of certain properties (e.g., gradient sparsity) [ 14 , 13 ] . Continuing research on pruning, compression, and re-structuring SNNs show increasing ability to take advantage of these properties to produce more structurally sparse networks [ 13 , 17 , 18 , 19 ] . II-B Memristor Crossbar Architectures Resistive-RAM (ReRAM) offers non-volatile random access memory while also supporting analog compute. While ReRAM research is not new [ 6 ] , recent advances in memristor technology and architecture [ 30 ] rapidly approach production-ready systems for accelerating general-purpose SNNs. Analog ReRAM crossbar-based accelerators enable energy-efficient matrix multiplication but face non-idealities that limit crossbar dimensions. Scaling architectures to network size (neuron count) is achieved by minimizing connection overhead via methods such as mixed-signal accumulation and hierarchical networking [ 8 , 9 , 10 ] . Scaling to density (edge count) requires more intricate tricks, such as re-purposing crossbar bit-lines for metadata [ 11 ] . Yet, the corresponding compiler technology to fully exploit such architectures remains notably absent. II-C Integer Linear Programming The architectural advantages of high crossbar counts come with significant compiler challenges; after all, complex architectures are only useful if compilers can effectively leverage their complexity. For NP-hard problems like SNN-to-MCA mapping, traditional wisdom favors approximate, polynomial-time algorithms [ 22 , 23 , 21 , 20 ] . While these methods provide adequate solution quality, they fall short in supporting emerging heterogeneous crossbar architectures. An alternative approach is Integer Linear Programming (ILP), a type of constraint programming requiring only mathematical descriptions of valid solutions. Off-the-shelf solvers then find satisfying and/or optimal solutions