NVM-in-Cache: Repurposing Commodity 6T SRAM Cache into NVM Analog Processing-in-Memory Engine using a Novel Compute-on-Powerline Scheme
Subhradip Chakraborty, Ankur Singh, Xuming Chen · 2025
Read NVM-in-Cache: Repurposing Commodity 6T SRAM Cache into NVM Analog Processing-in-Memory Engine using a Novel Compute-on-Powerline Scheme by Subhradip Chakraborty, Ankur Singh, Xuming Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-15904.txt.
Introduction
Subhradip Chakraborty, Ankur Singh, Xuming Chen, Gourav Datta, and Akhilesh R. Jaiswal turn ordinary cache memory into a computing engine for neural networks. Deep workloads demand ever more on-chip SRAM, which now fills a large share of the die. Their NVM-in-Cache design adds resistive memory devices into a standard six-transistor SRAM cell, forming a compact hybrid cell with no area overhead.
In processing-in-memory mode the cell performs many multiply-and-accumulate operations in parallel directly on the cache power lines, while stored cache data stay intact. Simulations in a twenty-two nanometre process show strong throughput and very high efficiency per watt. Running a ResNet-18 network on CIFAR-10 with many rows in parallel gives accuracy in the low ninety percent range, the five authors report.
Catalog record
| CREATOR | Subhradip Chakraborty, Ankur Singh, Xuming Chen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-15904
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
NVM-in-Cache: Repurposing Commodity 6T SRAM Cache into NVM Analog Processing-in-Memory Engine using a Novel Compute-on-Powerline Scheme Thanks: Subhradip Chakraborty, Ankur Singh and Akhilesh Jaiswal are with the Department of Electrical and Computer Engineering, University of Wisconsin Madison, Madison, USA (e-mail: [email protected], [email protected]). Xuming Chen and Gourav Datta are with the Department of Electrical, Computer, and Systems Engineering, Case School of Engineering, Case Western Reserve University, USA. Subhradip Chakraborty, Ankur Singh, Xuming Chen Abstract The rapid growth of deep neural network (DNN) workloads has significantly increased the demand for large-capacity on-chip SRAM in machine learning (ML) applications, with SRAM arrays now occupying a substantial fraction of the total die area. To address the dual challenges of storage density and computation efficiency, this paper proposes an NVM-in-Cache architecture that integrates resistive RAM (RRAM) devices into a conventional 6T-SRAM cell, forming a compact 6T-2R bit-cell. This hybrid cell enables Processing-in-Memory (PIM) mode, which performs massively parallel multiply-and-accumulate (MAC) operations directly on cache power lines while preserving stored cache data. By exploiting the intrinsic properties of the 6T-2R structure, the architecture achieves additional storage capability, high computational throughput without any bit-cell area overhead. Circuit- and array-level simulations in GlobalFoundries 22nm FDSOI technology demonstrate that the proposed design achieves a throughput of 0.4 TOPS and 491.78 TOPS/W. For 128 row-parallel operations, the CIFAR-10 classification is demonstrated by mapping a Resnet-18 neural network, achieving an accuracy of 91.27%. These results highlight the potential of the NVM-in-Cache approach to serve as a scalable, energy-efficient computing method by re-purposing existing 6T SRAM cache architecture for next-generation AI accelerators and general purpose processors. I Introduction The growing demand for data-intensive computations, coupled with transistor scaling in accordance with the Moore’s law and the increasing complexity of consumer workloads, has driven steady growth in on-chip cache capacity over the years [ 1 ] . With the emergence of AI and deep neural networks, this trend has become even more critical to achieving state-of-the-art performance and precision. As the size of these networks increases, recent processors have required larger on-chip caches to meet performance needs [ 2 ] . Although several studies have explored cache architectures using 7T [ 3 ] , 8T [ 4 ] , 9T [ 5 ] , and 10T [ 6 ] SRAM cells, the conventional 6T SRAM still remains almost exclusively used in commercial processors due to its high density and fast access speed [ 7 ] . However, with the rapid growth in computational workloads and the slowing benefits of technology scaling, there is a need to explore alternative memory technologies. Non-volatile memories (NVMs) offer smaller cell footprints, enabling higher density, and exhibit significantly lower leakage compared to conventional SRAM, which suffers from substantial leakage power due to short channel effects at advanced technology nodes [ 8 ] . Some NVM options are Resistive RAM (RRAM) [ 9 ] , Magnetic RAM (MRAM) [ 10 ] , and Phase Change Memory (PCM) [ 11 ] . Despite their advantages, NVMs generally suffer from higher write latency and limited endurance, increased write power consumption, and lower signal-to-noise ratio (SNR) compared to SRAM [ 12 ] . Thereby, despite their density and power benefits, they are not suitable for on-chip high-speed cache applications. This motivates the integration of 6T SRAM with NVM devices, effectively combining the advantages of both NVM and 6T SRAM inside on-chip cache hierarchies, without incurring substantial (almost no) bit-cell area overhead. In this work, we present an NVM-in-Cache architecture which integrates NVM within the 6T SRAM cells, thereby repurposing 6T SRAM to perform massively parallel analog processing-in-memory (PIM) operations using a novel compute-on-powerline scheme. Continuous technology scaling has enabled an increase in the number of processor cores on a chip, but memory bandwidth and energy efficiency have not scaled proportionally, leading to the well-known memory wall [ 13 ] . In deep learning applications, the growing data transfer between memory and the processor has become a major bottleneck for energy-efficient computation. This has motivated the concept of PIM, also referred to as Computing-in-Memory (CIM), where computation is performed within the memory array to minimize data movement and improve efficiency in AI workloads. Prior NVM-based PIM designs have demonstrated this concept but often suffer from limited SNR ratio [ 14 ] , low ON/OFF conductance ratio [ 15 ] , and fabrication challenges for large-scale integration [ 16 ] . Among different NVM technologies, RRAM is notable for its relatively high conductance ratio [ 17 ] , and has also been demonstrated as a scalable, high-density memory in commercial fabrication processes [ 18 ] . In this work we use RRAM for design and analysis, but the presented scheme is applicable to other NVMs as well. Note, while NVMs address some of the limitations of 6T SRAM, it is not an ideal direct replacement for cache memory due to its high write latency and energy consumption. This motivates the integration of NVM (RRAM) with conventional cache architectures, enabling efficient in-memory computation without compromising cache functionality. Fig. 1: (a) Multi-core processor architecture consisting of multiple cores, private L2 caches, and distributed LLC slices; (b) Cache architecture of a single LLC slice, organized into multiple banks for parallel access; (c) Each bank is further divided into multiple smaller SRAM sub-arrays to improve scalability and reduce access latency; (d) A single sub-array block implemented using 6T SRAM cells, typically structured as a 128 \times 128 or 256 \times 256 array, along with its corresponding bit-cell layout. Previous work on SRAM-based PIM [ 19 , 20 , 21 ] has shown promising results but is generally not well-suited for cache architectures, as many designs employ more than six transistors per bit-cell, significantly reducing cache density. Some studies [ 22 , 23 ] have demonstrated PIM using standard 6T SRAM cells; however, these approaches require the cache to flush its existing data in order to store the neural network weights for in-memory computation. After computation, the cache data must be reloaded, which introduces additional latency and increases energy consumption due to extra data movement. In summary, the main contributions of this work are as follows: • Novel 6T-2R bit-cell design that integrates resistive RAM (RRAM) devices with conventional 6T SRAM, enabling NVM in-memory analog computation (PIM mode). • Dual functionality of the proposed bit-cell, which doubles (NVM+SRAM storage in each bit-cell) the effective memory capacity of conventional cache architectures while maintaining minimal (almost no) bit-cell area overhead. • Processing-in-memory capability using a novel compute-on-powerline scheme, allowing NVM multiply-and-accumulate (MAC) operations to be performed directly within existing 6T SRAM cache arrays without modifying the cell footprint. • Massive array-level parallelism for analog PIM, enabling high-throughput computation while retaining the original cache data, thereby eliminating costly flush and reload operations. Note, this work does not preclude implementing purely SRAM-based IMC schemes (without NVM); rather, it can be used in conjunction with such prior approaches, effectively doubling the memory capacity and expanding the opportunities to realize PIM within conventional 6T cells. The remainder of the paper is organized as follows. Section II presents the preliminaries on RRAM and cache architectures. Section III details the various operational modes of the proposed 6T-2R bit-cell. Section IV provides an array-level analysis of the 6T-2R