Enabling Low-Cost Secure Computing on Untrusted In-Memory Architectures

Sahar Ghoflsaz Ghinani, Jingyao Zhang, Elaheh Sadredini · 2025

Read Enabling Low-Cost Secure Computing on Untrusted In-Memory Architectures by Sahar Ghoflsaz Ghinani, Jingyao Zhang, Elaheh Sadredini (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-17292.txt.

Introduction

Computing inside memory chips dodges the traffic jam between processor and memory, but it exposes raw data off the main chip. Sahar Ghoflsaz Ghinani, Jingyao Zhang, and Elaheh Sadredini close that hole in a 2025 paper. Their trick splits each secret across parties so the memory unit sees only shares. Garbled circuits handle the non-linear steps. Precomputation keeps the main processor from becoming the new bottleneck.

Tests on a real in-memory system covered recommendation and regression workloads. Speedups reached over fourteen times against a locked-down processor setup. Secrecy and integrity held throughout the outsourced work. The authors pitch the scheme for cloud and edge hardware.

Catalog record

CREATORSahar Ghoflsaz Ghinani, Jingyao Zhang, Elaheh Sadredini
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE73 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-17292

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Enabling Low-Cost Secure Computing on Untrusted In-Memory Architectures Sahar Ghoflsaz Ghinani, Jingyao Zhang, Elaheh Sadredini Abstract Modern computing systems are limited in performance by the memory bandwidth available to processors, a problem known as the memory wall. Processing-in-Memory (PIM) promises to substantially improve this problem by moving processing closer to the data, improving effective data bandwidth, and leading to superior performance on memory-intensive workloads. However, integrating PIM modules within a secure computing system raises an interesting challenge: unencrypted data has to move off-chip to the PIM, exposing the data to attackers and breaking assumptions on Trusted Computing Bases (TCBs). To tackle this challenge, this paper leverages multi-party computation (MPC) techniques, specifically arithmetic secret sharing and Yao’s garbled circuits, to outsource bandwidth-intensive computation securely to PIM. Additionally, we leverage precomputation optimization to prevent the CPU’s portion of the MPC from becoming a bottleneck. We evaluate our approach using the UPMEM PIM system over various applications such as Deep Learning Recommendation Model inference and Logistic Regression. Our evaluations demonstrate up to a 14.66 × 14.66\times speedup compared to a secure CPU configuration while maintaining data confidentiality and integrity when outsourcing linear and/or nonlinear computation. 1 Introduction However, while processing power has grown exponentially following Moore’s Law, memory performance has lagged, leading to the "memory wall" [ 78 ] —a critical bottleneck caused by the growing disparity between CPU and memory speeds, which limits overall system performance. For data-centric applications, the cost of memory access is particularly significant, both in terms of latency and energy consumption [ 27 ] . Boroumand et al. [ 6 ] demonstrated that in Google consumer workloads, such as machine learning frameworks, 62.7% of the total energy consumption stems from data movement between the CPU and memory. They further showed that Processing-in-Memory (PIM) can reduce total system energy consumption and execution time by an average of 55% and 54%, respectively, highlighting PIM’s potential as a solution to the memory wall challenge. PIM technology [ 2 , 64 , 50 , 51 , 65 , 9 , 3 , 83 , 85 , 44 , 61 ] reduces memory latency by performing computations closer to or within the memory itself, leveraging internal data bandwidth. By minimizing data movement, PIM can significantly alleviate the limitations imposed by the memory wall. However, as promising as PIM technology appears, it comes with its own challenges, particularly in securely handling sensitive data [ 4 ] . Figure 1: (a) TEE-based system. Only on-chip modules (e.g., cores, cache) are within the TCB. The PIM module cannot operate on encrypted data. (b) TEE-based system with MPC. Private data can be split into two on-chip and off-chip shares. The PIM module can operate on computable MPC share. Since PIM modules are typically off-chip and connected via buses such as memory or PCIe [ 51 , 74 , 19 , 62 , 84 ] , they are inherently outside the trusted computing base (TCB) established by widely deployed Trusted Execution Environments (TEEs) [ 41 , 54 , 10 , 8 ] . TEEs prohibit unencrypted data from appearing off-chip unless through a high-overhead attestation process [ 31 ] . The presence of plaintext in off-chip locations such as memory, memory buses, and peripheral interfaces makes it vulnerable to physical attacks (e.g., cold boot attacks [ 29 ] ) and software attacks (e.g., unauthorized memory access [ 45 , 71 ] ). As shown in Fig. 1 (a), only on-chip modules, such as cores and caches, are included within the TCB. These modules can operate on plaintext, while off-chip modules like PIM can only handle encrypted data. Consequently, PIM hardware cannot natively compute on encrypted data, presenting a significant obstacle to its adoption in security-critical applications. Although homomorphic encryption [ 18 , 33 , 40 , 21 , 58 , 25 ] allows computation directly on ciphertext, its significant computational complexity and data bandwidth requirements make it impractical for real-time applications, as it operates orders of magnitude slower than plaintext computation [ 1 , 52 ] . An alternative is incorporating PIM into the TCB [ 76 , 38 , 86 ] , but this would require substantial redesigns of the PIM architecture, such as adding a root of trust and secure boot mechanisms, as well as addressing supply chain security issues. Xiong et al. [ 79 ] proposed an MPC-based scheme, SecNDP, to securely offload linear computations to PIM. However, SecNDP has several limitations: (1) it does not support nonlinear computations, restricting its applicability; (2) its evaluation relies on simulations rather than real hardware, leaving its practicality in real-world scenarios unverified; and (3) our analysis reveals that SecNDP suffers from performance bottlenecks when the volume of public data significantly exceeds that of private data, as shown in Fig. 2 . We analyzed the performance of SecNDP compared to an insecure CPU for GEMV with varying input sizes, as shown in Fig. 2 . In GEMV, either the matrix or the vector can serve as private data, depending on the application. The blue line in Fig. 2 depicts the speedup when the matrix is private and the vector is public, while the red line shows the opposite case. The results demonstrate that SecNDP performs optimally when the public data size is smaller than the private data. However, as the public data size increases, CPU computation becomes a bottleneck due to the need to transfer large volumes of public data from memory to the CPU for processing, significantly constraining performance. Figure 2: Speedup of the SecNDP security scheme using UPMEM over an insecure CPU for the GEMV kernel with different input sizes. The SecNDP does not perform well when the amount of public data is significantly large. To overcome these limitations, we propose a novel secure computation framework that leverages multi-party computation (MPC) to securely offload both linear and nonlinear computations to untrusted PIM hardware. As illustrated in Fig. 1 (b), our method partitions plaintext into two encrypted shares: computationally intensive tasks are securely offloaded to the PIM, while lighter tasks are processed by the TEE. To address CPU bottlenecks, we employ precomputation techniques [ 72 ] that shifts expensive tasks offline, significantly reducing runtime overhead. For secure data handling, we use counter-mode encryption [ 46 , 42 ] for parallelized encryption and Message Authentication Codes (MACs) to ensure data and computation integrity. Unlike SecNDP, our approach supports nonlinear computations and is validated on real-world PIM hardware (UPMEM) [ 14 ] , demonstrating its practicality and efficiency. Our framework is evaluated on diverse applications, including Deep Learning Recommendation Models (DLRM) [ 53 ] , Multilayer Perceptrons (MLP) [ 56 ] , Linear Regression [ 68 ] , and Logistic Regression [ 11 ] , showcasing its versatility and significant performance improvements. Our work makes the following contributions: 1. Secure PIM Acceleration Framework: We present a secure PIM acceleration framework leveraging MPC techniques, integrating arithmetic secret sharing for linear computations and Yao’s garbled circuits for nonlinear operations. By partitioning workloads into encrypted shares, our approach securely offloads computationally intensive tasks to untrusted PIM hardware. A switching mechanism between arithmetic secret sharing and Yao sharing is adopted to outsource nonlinear computation to PIM module securely. 2. Precomputation Optimization: We utilize a

Read the complete text