PIM-CACHE: High-Efficiency Content-Aware Copy for Processing-In-Memory

Peterson Yuhala, Mpoki Mwaisela, Pascal Felber, Valerio Schiavoni · 2026

Read PIM-CACHE: High-Efficiency Content-Aware Copy for Processing-In-Memory by Peterson Yuhala, Mpoki Mwaisela, Pascal Felber, Valerio Schiavoni (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-23762.txt.

Introduction

Yuhala and co-authors present PIM-CACHE, a staging layer for processing-in-memory hardware. Such hardware computes inside memory chips, but data must still move from host memory to the memory processors. Those coarse transfers can become the new bottleneck. PIM-CACHE cuts repeated transfers by using content-aware copy, which exploits likeness across workloads. The team tests it on synthetic workloads and real genome datasets. They report that it lowers data transfer overhead for these in-memory systems.

Catalog record

CREATORPeterson Yuhala, Mpoki Mwaisela, Pascal Felber, Valerio Schiavoni
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51788
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.23762

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PIM-CACHE: High-Efficiency Content-Aware Copy for Processing-In-Memory Peterson Yuhala, Mpoki Mwaisela, Pascal Felber, Valerio Schiavoni Abstract . Processing-in-memory (PIM) architectures bring computation closer to data, reducing the processor-memory transfer bottleneck in traditional processor-centric designs. Novel hardware solutions, such as UPMEM’s in-memory processing technology, achieve this by integrating low-power DRAM processing units (DPUs) into memory DIMMs, enabling massive parallelism and improved memory bandwidth. However, paradoxically, these PIM architectures introduce mandatory coarse-grained data transfers between host DRAM and DPUs, which often become the new bottleneck. We present pim-cache , a lightweight data staging layer that dynamically eliminates redundant data transfers to PIM DPUs by exploiting workload similarity, achieving content-aware copy (CAC). We evaluate pim-cache on both synthetic workloads and real-world genome datasets, demonstrating its effectiveness in reducing PIM data transfer overhead. ©2026 ACM. Personal use of this material is permitted. Permission from ACM must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works. This is the author’s version of the work. The final version is published in the proceedings of the 27th ACM/IFIP International Middleware Conference. 1. Introduction Many modern workloads, such as genome analysis, graph processing, big data analytics, and image processing are data-intensive, meaning their performance is primarily limited by memory bandwidth. This problem, known as the von Neumann bottleneck , arises when the CPU processes data faster than it can be supplied from memory via the memory channel ( 55 ) . Processing-in-memory (PIM) is a paradigm shift from this traditional processor-centric design towards a more memory-centric design, where data can be processed where it resides ( 41 ) . Our work focuses on UPMEM’s PIM architecture ( 58 ) (henceforth UPMEM-PIM), the first PIM system to be commercialized ( 24 ) . UPMEM-PIM integrates low-power RISC processors, known as DRAM processing units (DPUs), into standard DRAM DIMM modules, with each DPU managing a 64MB chunk of memory, called main RAM (MRAM). This architecture provides extensive parallelism and achieves an aggregate memory bandwidth of up to 2.56 TB/s ( 58 ) . Several recent works ( 24 ; 58 ; 45 ; 26 ; 42 ) have evaluated UPMEM-PIM on real-world workloads, showcasing the large performance improvements that can be obtained with this PIM architecture. Figure 1. Total execution times for vector addition on two vectors of varying sizes, along with the total host-to-DPU copy time. Note: The copy time includes the total time required to transfer both input buffers of the corresponding size from host DRAM to DPU MRAM. Yet, ironically, the UPMEM-PIM architecture suffers from a data transfer bottleneck stemming from its architectural design, which maintains separate physical address spaces for conventional DRAM and PIM memory, i . e ., MRAM. Consequently, all data processed by UPMEM’s PIM DPUs must be explicitly copied from DRAM to MRAM, incurring significant overhead. For example, Figure 1 (a) illustrates the execution times for a vector addition benchmark on two input vectors of varying sizes, comparing performance on a UPMEM-PIM-enabled system with 256 DPUs (@400Hz) to a CPU-based approach (CPUs @2.1GHz). The extensive parallelism of the PIM-based system allows for over a 7\times speedup with respect to the CPU-based approach. However, Figure 1 (b) highlights the significant cost of copying both input vectors to the DPUs, which completely dwarfs the performance gains achieved with the PIM-based system. Some prior studies like ( 24 ; 26 ; 58 ) do extensive comparisons of PIM against CPU baselines but tend to overlook this CPU-DPU copy overhead when considering the speedup achieved with DPUs. While such approaches may be justified in specific scenarios, they are generally unrealistic ( 20 ) , as kernel-only benchmarks cannot accurately reflect real-world application behaviour ( 8 ; 27 ) . Meanwhile, other studies ( 33 ; 36 ; 42 ; 20 ; 29 ) have acknowledged this copy overhead and the scalability limitations it introduces to UPMEM’s PIM architecture. We observe that several PIM-friendly workloads, including machine learning training ( 23 ; 52 ) , graph analytics ( 13 ; 1 ) , genome analysis ( 5 ; 11 ) among others, exhibit both temporal and spatial redundancy: similar data blocks are transferred across jobs or within large datasets. However, the current UPMEM-PIM CPU-DPU data copy approach is content-oblivious , transferring bytes regardless of whether identical blocks already reside in PIM memory, thereby missing an opportunity to reduce overhead. Our work bridges this gap by co-designing content-awareness with the memory-copy semantics of current PIM architectures like UPMEM. We propose pim-cache , a systematic content-aware copy (CAC) approach with high efficiency for UPMEM-PIM. pim-cache leverages inline deduplication and fast byte-oriented compression ( 38 ) to mitigate the expensive data copy overhead inherent in PIM architectures like UPMEM’s. Specifically, our CAC approach identifies repeating data patterns using well-known fingerprinting techniques, deduplicating the data before transferring it to DPU memory. Further, our system retains data blocks in DPU memory for future use, thus preventing redundant data transfers for subsequent datasets. Additionally, we employ fast byte-oriented compression ( 38 ) to further minimize the data copy overhead to DPUs. Our CAC approach offers a practical solution for PIM programmers, obviating the need to implement ad-hoc data reduction techniques for workloads that are likely to contain repetitive data patterns. We integrate pim-cache as a lightweight data staging layer in UPMEM’s SDK, which we plan to release as open-source. In summary, this paper provides the following contributions: • Content-aware copy approach which exploits data similarity to mitigate CPU-DPU data transfer overhead in UPMEM DPUs; we provide this tool as open-source to the community • Support for lightweight byte-oriented integer compression for UPMEM DPUs • Extensive evaluations of these tools on synthetic and real-world datasets Roadmap. The rest of this paper is organized as follows. § 2 presents important background concepts and the motivation behind our work. § 4 presents the system design behind our content-aware copy approach, and § 5 discusses the corresponding implementation details. We evaluate our system in § 6 , discuss related work in § 7 , and finally conclude our paper in § 8 . 2. Background We first describe UPMEM’s processing-in-memory infrastructure (§ 2.1 ), deduplication and compression (§ 2.2 ), after which we discuss the motivation behind our work (§ 3 ) as a motivational application which drives our work. Table 1. Redundancy characteristics in PIM workloads. PIM Workload Redundancy Type Justification Machine learning training Temporal ML training loops repeatedly access identical data batches across epochs ( 32 ; 62 ) . Comparative genomics Spatial & Temporal Specimens belonging to the same species share > 99% of DNA; reference genomes are reused across jobs and comparative analyses ( 11 ; 18 ) . Iterative graph analytics Temporal Iterative algorithms like PageRank, BFS, etc ., process the same graph structure across multiple rounds and epochs ( 1 ; 31 ; 10 ) . Log analytics Spatial & Temporal Repeated headers, status codes, and error messages appear across millions of log entries ( 49 ) . 2.1. Processing-in-memory Figure 2. Architecture of a UPMEM-PIM enabled

Read the complete text