CIM-Tuner: Balancing the Compute and Storage Capacity of SRAM-CIM Accelerator via Hardware-mapping Co-exploration
Jinwu Chen 1,2 , Yuhui Shi 1 , He Wang 1 , Zhe Jiang 1,2 , Jun Yang 1,2 , Xin Si 1,2∗ and Zhenhua Zhu 3∗ · 2026
Read CIM-Tuner: Balancing the Compute and Storage Capacity of SRAM-CIM Accelerator via Hardware-mapping Co-exploration by Jinwu Chen 1,2 , Yuhui Shi 1 , He Wang 1 , Zhe Jiang 1,2 , Jun Yang 1,2 , Xin Si 1,2∗ and Zhenhua Zhu 3∗ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-18070.txt.
Introduction
Jinwu Chen and co-authors tune a chip design that computes inside its own memory. Their 2026 preprint deals with SRAM computing-in-memory accelerators. These chips promise high energy efficiency and throughput for AI work. The catch is balance. Many design variants and mapping choices make it easy to mismatch the compute side and the storage side. A bad match can drag performance down a great deal.
The team's tool, CIM-Tuner, explores hardware and mapping together. Joint search finds pairings that one-sided tuning misses. The goal is a chip whose memory and logic pull in the same direction. As AI models grow, such in-memory designs are a leading hope for cheaper inference.
Catalog record
| CREATOR | Jinwu Chen 1,2 , Yuhui Shi 1 , He Wang 1 , Zhe Jiang 1,2 , Jun Yang 1,2 , Xin Si 1,2∗ and Zhenhua Zhu 3∗ |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-18070
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CIM-Tuner: Balancing the Compute and Storage Capacity of SRAM-CIM Accelerator via Hardware-mapping Co-exploration Jinwu Chen 1,2 , Yuhui Shi 1 , He Wang 1 , Zhe Jiang 1,2 , Jun Yang 1,2 , Xin Si 1,2∗ and Zhenhua Zhu 3∗ Abstract As an emerging type of AI computing accelerator, SRAM Computing-In-Memory (CIM) accelerators feature high energy efficiency and throughput. However, various CIM designs and under-explored mapping strategies impede the full exploration of compute and storage balancing in SRAM-CIM accelerator, potentially leading to significant performance degradation. To address this issue, we propose CIM-Tuner, an automatic tool for hardware balancing and optimal mapping strategy under area constraint via hardware-mapping co-exploration. It ensures universality across various CIM designs through a matrix abstraction of CIM macros and a generalized accelerator template. For efficient mapping with different hardware configurations, it employs fine-grained two-level strategies comprising accelerator-level scheduling and macro-level tiling. Compared to prior CIM mapping, CIM-Tuner’s extended strategy space achieves 1.58 × \times higher energy efficiency and 2.11 × \times higher throughput. Applied to SOTA CIM accelerators with identical area budget, CIM-Tuner also delivers comparable improvements. The simulation accuracy is silicon-verified and CIM-Tuner tool is open-sourced at https://github.com/champloo2878/CIM-Tuner.git. I Introduction SRAM Computing-in-Memory (SRAM-CIM) has garnered significant attention as a highly energy-efficient matrix multiplication engine. By enabling data movement with shorter distances and larger bandwidth, alongside customized designs for data precision and sparsity, SRAM-CIM achieves notable improvements in both energy and throughput. These advantages are validated at both the macro level [ 5 ] – [ 9 ] and accelerator level [ 10 ] – [ 17 ] , positioning SRAM-CIM as a compelling alternative to digital computing arrays. Current SRAM-CIM accelerator optimizations primarily target CIM computation itself, neglecting the compute and storage resources balancing and corresponding mapping strategy matching. However, this neglect may significantly degrade the inference performance of these DNN accelerators. Back to the conventional digital accelerators, the size of the on-chip buffer has a significant impact. Figure 1 shows the performance of a systolic array under different compute and storage allocations of fixed area budget. It demonstrates that stall cycles decrease as the buffer size increases, revealing that larger buffer leverages data locality better and improves data reuse to alleviate external bandwidth pressure. However, an oversized buffer inevitably reduces the area available for the computation array, leading to lower computation throughput and an overall latency increase. Fig. 1: Latency breakdown of matrix multiplication on systolic accelerator. Evaluated using scale-sim [ 1 ] . Left: varying weight buffer in weight stationary mapping. Right: varying input buffer in input stationary mapping. For SRAM-CIM based accelerator, due to tightly coupled compute and storage units, exploring the compute and storage balancing demands more fine-grained modeling and mapping analysis compared to conventional digital arrays. Such exploration requires delving into specific SRAM-CIM macro designs. Previous optimization works like AutoDCIM [ 18 ] focused only on analyzing the storage-compute balance in a specific digital CIM macro template, lacking support for other CIM types and accelerator-level optimizations. To address this gap, these two challenges must be tackled: (1) Adaptation to various designs: Diverse SRAM-CIM implementations vary in data precision, accuracy, and compute mechanisms (e.g., bit-cell design, multi-bit expansion method, simultaneous compute/update capability and so on). This diversity increases the complexity of the problem and may push any solution towards being highly design-specific. (2) Underexplored mapping strategies: Different storage and compute ratio require distinct optimal mapping strategies for accelerators. As a novel architecture, SRAM-CIM accelerator lacks comprehensive exploration of matrix multiplication mapping. Especially as current neural network operators vastly exceed on-chip buffer capacity, traditional static mapping proves inefficient, necessitating dynamic and fine-grained strategies to account for frequent parameter updating. To address these challenges, we propose CIM-Tuner: an automated and open-sourced tool for balancing compute and storage capacity in SRAM-CIM accelerators. Within given CIM macro configurations and network workloads, CIM-Tuner simultaneously determines the optimal hardware sizing and operators mapping under area budget constraint and optimization target. The contributions include: • First, we introduce a matrix abstraction for SRAM-CIM macros and establish a universal accelerator template to decouple diverse circuit implementations from architectural exploration. Unified evaluation formulas adaptable to any SRAM-CIM design are provided. • Second, we propose the fine-grained two-level mapping strategies for better hardware resource exploration: At the accelerator level, both spatial and temporal scheduling methods are proposed, encompassing the mapping strategies introduced in previous works. At the macro level, novel Accumulation-First (AF) tiling and Parallel-First (PF) tiling strategies exploiting CIM-specific storage-compute ratio (SCR) to optimize CIM utilization while expanding the mapping strategy design space. • Finally, we explore the hardware-mapping co-design space via simulated annealing. To accelerate exploration, the hardware design space is heuristically pruned and the layers with same size are gathered to reduce the mapping choices. Experimental results demonstrate that our expanded mapping strategy achieves 1.58 \times higher energy efficiency and 2.11 \times higher throughput compared to previous CIM mapping methodologies under the same co-exploration process. Also, evaluated on SOTA CIM accelerators [ 10 ] , [ 16 ] under identical area budgets, CIM-Tuner delivers comparable improvements of 1.34 \sim 2.31 \times in energy efficiency and 1.03 \sim 2.88 \times in throughput. The simulation accuracy of CIM-Tuner tool is silicon-verified and CIM-Tuner is open-sourced for the purpose of better early stage SRAM-CIM accelerator design decisions. II Background and Motivation II-A SRAM-CIM Basis and Storage-Compute Ratio Various CIM technologies leverage different types of memory. Among them, SRAM features high access speed, nearly unlimited endurance and seamless integration with advanced CMOS technology. Thus, SRAM-CIM has been widely researched and utilized in many DNN accelerators [ 10 ] – [ 17 ] . Typically, SRAM-CIM operates in two modes: compute and weight update. During compute, input vectors are projected into the CIM to perform multiply-accumulate (MAC) operations with stored weights. The update mode resembles conventional memory write operations. As shown in Figure 2 (a), the storage-compute ratio ( SCR ) in CIM is defined as the ratio of memory cells to compute units within a CIM macro. In digital CIMs (DCIMs), multiple memory cells typically share one set of multipliers and adders within a local bank to maintain storage density and layout compactness [ 9 ] . Here, SCR equals the number of cells per local bank. For analog CIMs (ACIMs), SCR represents the ratio of total column cells to activated cells during computation, ensuring sufficient compute-line signal margin [ 17 ] . In SRAM-CIM accelerators, weight data is typically stored in the CIM array. Input data from different channels reuses weights, generating sums for different output channels. Fig. 2: (a) The SCR mechanism in both digital and analog CIM. (b) The latency of matrix multiplication across different hardware proportions and mapping strategies. See evaluation setup in Section IV. II-B Motivation for Compute and Storage Balancing Currently, with the explosive growth in model parameters, the size of a single matrix multiplication operator ( \sim MB level) often far exceeds the SRAM capacity of the on-chip SRAM-CIM accelerator ( \sim KB level) [ 2 ] – [ 4 ] . This requires frequent updating of input data, weight, and output data during computation. Therefore, under limited area budget, selecting the correct ratio of compute and storage capacity, as well as the fine-grained mapping