Res-DPU: Re source- s hared D igital P rocessing-in-memory U nit for Edge-AI Workloads † Both authors contributed equally to this work. M. Lokhande, N. S. Dhakad, S. Chouhan, and S. K. Vishvakarma are with the NSDCS Research Group, Department of Electrical Engineering, IIT Indore, Simrol 453552, Ind
Mukul Lokhande , Member, IEEE, Narendra Singh Dhakad , Seema Chouhan †, , Akash Sankhe †, , and Santosh Kumar Vishvakarma · 2025
Read Res-DPU: Re source- s hared D igital P rocessing-in-memory U nit for Edge-AI Workloads † Both authors contributed equally to this work. M. Lokhande, N. S. Dhakad, S. Chouhan, and S. K. Vishvakarma are with the NSDCS Research Group, Department of Electrical Engineering, IIT Indore, Simrol 453552, Ind by Mukul Lokhande , Member, IEEE, Narendra Singh Dhakad , Seema Chouhan †, , Akash Sankhe †, , and Santosh Kumar Vishvakarma (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-19260.txt.
Introduction
Mukul Lokhande and four co-authors introduce Res-DPU, a resource-shared processing-in-memory unit for edge artificial intelligence chips. Computing inside memory attacks the bottleneck of moving data between memory and processor, but earlier digital designs wasted area on bulky cells and transistor-heavy adder trees, limiting scale and efficiency.
Res-DPU shares resources through a compact memory latch and small logic gates, cutting the array's transistor count by more than half against leading designs. A redesigned adder tree trims power further. For small devices that must run neural networks on tight power budgets, such savings decide what is feasible.
Catalog record
| CREATOR | Mukul Lokhande , Member, IEEE, Narendra Singh Dhakad , Seema Chouhan †, , Akash Sankhe †, , and Santosh Kumar Vishvakarma |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 24 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-19260
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Res-DPU: Re source- s hared D igital P rocessing-in-memory U nit for Edge-AI Workloads † Both authors contributed equally to this work. M. Lokhande, N. S. Dhakad, S. Chouhan, and S. K. Vishvakarma are with the NSDCS Research Group, Department of Electrical Engineering, IIT Indore, Simrol 453552, India (e-mail: [email protected]). A. Sankhe was with the NSDCS Research Group, Department of Electrical Engineering, IIT Indore, Simrol 453552, India. He is currently with Analog Devices India Pvt. Ltd., Bangalore, India 560094. This work was supported by the Special Manpower Development Program for Chip to Start-Up (SMDP-C2S), Ministry of Electronics and Information Technology (MeitY), Government of India, under Grant EE-9/2/21 - R&D-E. Mukul Lokhande , Member, IEEE, Narendra Singh Dhakad , Seema Chouhan †, , Akash Sankhe †, , and Santosh Kumar Vishvakarma Abstract Processing-in-memory (PIM) has emerged as the go-to solution for addressing the von Neumann bottleneck in edge AI accelerators. However, state-of-the-art (SoTA) digital PIM approaches suffer from low compute density, primarily due to bulky bit-cells and transistor-heavy adder trees, which place limitations on macro-scalability and energy efficiency. This work introduces Res-DPU, a resource-shared digital PIM unit, with a dual-port 5T SRAM latch and shared 2T AND compute logic. This reflects per-bit multiplication cost to just 5.25T and reduced-transistor count of PIM array up to 56% over SoTA works. Furthermore, a Transistor-Reduced 2D Interspersed Adder Tree (TRAIT) with FA-7T and PG-FA-26T, assist to reduce power consumption of adder tree up-to 21.35% and lead to improved energy efficiency by 59% over conventional 28T RCA designs. We propose a Cycle-controlled Iterative Approximate–Accurate Multiplication (CIA2M) approach, enabling run-time accuracy-latency trade-offs without requiring error-correction circuitry. The 16Kb REP-DPIM macro provides 0.43 TOPS throughput, and 87.22 TOPS/W energy efficiency in TSMC 65nm CMOS, and 96.85% QoR for ResNet‑18/VGG‑16 on CIFAR‑10, including 30% pruning. The proposed results establish a Res-DPU module for highly scalable and energy-efficient real-time edge AI accelerators. I Introduction AI has become a powerhouse in most AIoT devices, driving capabilities such as voice assistance, face recognition, and personalised recommendations. Deep learning models are often utilised to enhance system capabilities, allowing them to recognise patterns more intelligently and make technology more intuitive. Multiply-accumulate (MAC) computations remain fundamental to the core resource demand [ 1 ] . Conventional von Neumann architectures have already reached their peak roofline performance and are limited by the transfer of data between the computational unit and storage. Processing-in-memory (PIM) has emerged as a promising solution to address the rapidly growing necessities of real-world processing with improved energy efficiency for matrix multiplication operations, by eliminating energy-hungry data transfer between memory and compute [ 2 , 3 ] . PIM focuses on the architectural enhancement of memory cells, incorporating computational logic (AND/NOR/XNOR) while retaining storage function [ 4 ] . PIM computing is often categorized as digital and analog based on design approach. Prior PIM approaches have been significantly improved, although core challenges remain, including non-linear PVT variations, signal margin degradation, and area/energy overhead due to ADCs and Digital conversion loss [ 5 ] . This limits the work to 4-bit precision and limits macro applicability for advanced AI models. In contrast, digital PIM macros are more robust in nature and suffer no degradation in accuracy, with bit-precision scalability. However, they often lack flexibility in modified PIM arrays and area/energy overhead due to underutilized adder trees. I-A Prior Works & Motivation: Prior works have focused on incorporating PIM logic, with storage bit-cell making the bit-cell significantly bulkier and subsequently reducing storage density significantly compared to an iso-area memory array. For instance, The bit-cell proposed in [ 6 ] integrates 6T AND logic with RD-8T latch, Designs in [ 7 ] and [ 8 ] combine CMOS 4T NOR with 6T and RD-8T latch respectively (Additionally 2T are required for input-inversion in NOR approach), and Analog Bit-cells in [ 9 , 10 , 11 ] employed 4T for XNOR based In-memory computations approach. When considered in combination with resource-heavy adder tree or ADC architectures, the storage density has dropped severely to 240 KB for 1MB L1-cache while replacing existing storage devices with advanced PIM-incorporated caches, raising the question: To PIM or Not? In-Memory Systems . This can be inferred in detail with several industry literature and DCIM benchmarks [ 2 , 3 , 4 , 12 ] . We started this work with motivation to address the fundamental challenge associated with compute density, i.e. extract best TOPS performance out of 1 mm 2 piece of silicon. The key drivers were 1. To reduce the transistors required per bit multiplication, preferably go lower than a 6T latch to store data. 2. Incorporate time-shared logic philosophy to minimise processing area overhead. and 3. Low-resource Adder Tree, albeit with an acceptable performance-accuracy tradeoff. LPRE [ 13 ] improved compute efficiency with time-multiplexed activation function resources. Flex-DPU [ 6 ] followed shared 6T AND logic with consecutive 8 x 8T memory cells, reducing computer overhead per bit multiplication to 0.75T. However, Flex-DCIM deployed a significantly transistor-heavy adder tree-based power-gated 26T full adder. This doesn’t reduce resources compared to Conventional CMOS adder tree structures (Ripple-carry adder (RCA) approach: FA-28T), which dominates 65% of total power consumption and 45% of area in PIM-macro. Interspersed adder tree structures have been found major boost in this perspective. For instance, a 2D interleaved/interspersed combination of FA-28T with FA-14T [ 7 ] or 7T [ 14 ] has been found to be approximately three orders of magnitude energy efficient. Other approach involved approximate arithmetic to improve compute density, either with compressors [ 15 ] designed with Interspersed FA-12T and IFA-16T [ 16 ] or Lower-OR-adders [ 17 , 18 ] . TABLE I : Comparative benchmark between State-of-the-Art Bit Bit-cells, adapted in TSMC 65nm CMOS and VDD 1.2V Standard Cell TCAS-II’12 [ 19 ] JSSC’11 [ 20 ] ISSCC’21 [ 7 ] ISSCC’22 [ 8 ] TCAS-II’22 [ 9 ] ISQED’25 [ 14 ] JSSC’25 TCAS-I’25 [ 6 ] TNANO’23 [ 10 ] Proposed #T/Mult. 6T 8T 5T 9T 6T+4T 1R1W 12T 10T1C MUL8T DLS-13T 8.75T XNOR-10T 5.25T Area (um2) 1.75 2.35 1.55 2.8 3.67 4.2 2.64 2.52 12.44 2.35 3.78 2.02 Power (nW) 20.1 23.4 17.1 32.3 27.4 39.8 23.6 34 3.17 25.9 37.3 18.84 Operation Storage Storage, CIM-NOR XNOR Storage, CIM-AND Storage Shared-AND Storage, XAC/MAC Storage, Shared-AND Layout Density High High Irregular Low Low NR Medium High High Medium High Read Delay (ps) 106.2 102.7 104.6 101.9 127.5 158 1n 108.2 145 116 134 105.2 Write Delay (ps) 169.6 164.3 157.2 159.4 216.7 282 173.2 277.7 184.5 237.6 157.8 To address the aforementioned issues, this work focuses on enhancing energy efficiency and computational density. The key contributions of this study are as follows: 1. Resource-shared Digital Processing-in-memory Unit (Res-DPU): To enhance the compute density of the DPIM macro, this work utilises a shared-logic philosophy for a single 2T AND multiplier logic with eight dual-port 5T SRAM latches. The cumulative number of transistors per 1b dot-product computation is 5.25T (5T storage and 2/8 = 0.25T), saving transistors up to 40%, 48.5% and 56% compared to prior 8.75T AND [ 6 ] , 10T XNOR [ 10 ] and 12T NOR bit-cell [ 8 ] , respectively. 2. Transistor-reduced 2D Interspersed Adder Tree: This