Maximizing Memory-Level Parallelism via Integrated Stochastic Logic-in-Memory Architectures DOI: XXXXXXX.XXXXXXX Journal: JETC CCS: Hardware Emerging architectures CCS: Computer systems organization Parallel architectures CCS: Hardware Memory and dense storage CCS: Hardware Spintronics and magnetic technologies

Farzad Razi, Mehran Moghadam, Sercan Aygun, M. Hassan Najafi, Marc Riedel · 2026

Read Maximizing Memory-Level Parallelism via Integrated Stochastic Logic-in-Memory Architectures DOI: XXXXXXX.XXXXXXX Journal: JETC CCS: Hardware Emerging architectures CCS: Computer systems organization Parallel architectures CCS: Hardware Memory and dense storage CCS: Hardware Spintronics and magnetic technologies by Farzad Razi, Mehran Moghadam, Sercan Aygun, M. Hassan Najafi, Marc Riedel (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-23146.txt.

Introduction

Razi and four colleagues put a full compute pipeline inside Magnetic Tunnel Junction memory that can also do logic in memory. It turns binary inputs into random bit-streams in parallel, with fixed rules, removing power-hungry outside random number circuits. Stochastic units inside the memory arrays then do arithmetic and transcendental functions with little hardware and built-in noise tolerance. Outputs feed later stochastic steps or convert back to binary for storage, so storage, generation, and compute share one fabric that boosts parallelism and cuts data movement.

Catalog record

CREATORFarzad Razi, Mehran Moghadam, Sercan Aygun, M. Hassan Najafi, Marc Riedel
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE63251
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.23146

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Maximizing Memory-Level Parallelism via Integrated Stochastic Logic-in-Memory Architectures DOI: XXXXXXX.XXXXXXX Journal: JETC CCS: Hardware Emerging architectures CCS: Computer systems organization Parallel architectures CCS: Hardware Memory and dense storage CCS: Hardware Spintronics and magnetic technologies Farzad Razi, Mehran Moghadam, Sercan Aygun, M. Hassan Najafi, Marc Riedel Abstract . Today’s high-performance architectures are increasingly constrained by data movement latency and energy overhead, as the slowdown of single-core performance scaling coincides with the rise of highly data-intensive workloads. In-memory architectures have emerged as a complementary solution to conventional von Neumann systems by alleviating memory bandwidth bottlenecks, exploiting massive concurrency, and mitigating excessive data movement between memory and processing units. This study proposes a parallel in-memory stochastic computing (SC) architecture that implements an end-to-end computation pipeline within Magnetic Tunnel Junction (MTJ)-based memory augmented with logic-in-memory (LIM) capabilities. By leveraging the inherent stochasticity and write-read characteristics of MTJ devices, the proposed architecture enables a fully parallel and deterministic conversion of binary operands into probabilistic bit-streams, eliminating the need for energy-intensive external random number generation circuitry. These bit-streams are processed by parallel stochastic arithmetic units integrated directly within the memory arrays to efficiently implement core arithmetic and transcendental functions with minimal hardware complexity and inherent noise tolerance. The resulting stochastic outputs can be either reused as an input of future stochastic processing or converted back to binary form using parallel accumulation mechanisms and stored in the MTJ memory. By tightly integrating data storage, bit-stream generation, and computation within a unified in-memory fabric, the proposed design maximizes memory-level parallelism while substantially minimizing data movement. Experimental evaluations demonstrate that the proposed architecture achieves a 22 × 22\times – 64 × 64\times speedup compared to serial stochastic implementations and reduces computational latency by over three orders of magnitude compared to state-of-the-art in-memory computing approaches, while exhibiting superior fault tolerance under noise levels as high as 30%. 1. Introduction Parallel computing is a central organizing principle in modern hardware architectures, enabling systems to deliver high performance and energy efficiency under increasingly stringent power and scalability constraints ( 12 ) . As traditional single-core performance scaling has diminished, architectural innovation has shifted toward exploiting parallelism across multiple hardware layers, including multi-core processors, vector and Single Instruction, Multiple Data (SIMD) units, and memory-level parallelism ( 14 ) . This approach enables concurrent execution of operations and more effective utilization of both on-chip and off-chip resources, particularly for workloads characterized by large data volumes and repetitive computation. Application domains such as scientific computing ( 9 ) , data analytics ( 10 ) , and image processing ( 39 ) exemplify these trends, as they often involve structured, data-parallel operations that can be executed independently across large data sets. By explicitly exposing and efficiently managing parallelism at the hardware level, modern architectures can reduce execution latency, improve throughput, and achieve better energy proportionality, establishing parallel computing a key enabler for contemporary high-performance and distributed systems. In-memory computing (IMC) has emerged as an architectural approach to address the growing performance and energy challenges associated with data movement in modern computing systems ( 22 ) . In conventional von Neumann architectures, frequent transfers of data between memory and processing units incur significant latency and energy overhead, particularly for data-intensive workloads. By enabling computation to be performed directly within or near memory arrays, IMC significantly reduces unnecessary data transfers and improves data locality ( 36 ) . Recent advances in emerging memory technologies, such as magnetic tunnel junctions (MTJs), further reinforce this paradigm by offering non-volatility, high endurance, and tight integration of storage and computation ( 19 ; 27 ) . While IMC primarily targets data-movement inefficiencies, parallel computing addresses throughput limitations by enabling concurrent execution across multiple processing elements. When combined, these paradigms address complementary bottlenecks related to locality and serialization, reducing memory bandwidth pressure, data movement energy overhead, and pipeline serialization while improving the utilization of inherent memory-level parallelism. Together, they provide a scalable foundation for achieving high performance and energy efficiency in modern data-intensive systems. IMC architectures naturally favor lightweight and regular circuit structures, as complex control logic and wide datapaths can diminish the benefits of reduced data movement. In this context, stochastic computing (SC) ( 3 ; 13 ) offers an attractive alternative to conventional complex binary radix architectures by representing numerical values as probabilistic bit-streams, where information is encoded in the ratio of ones to zeros rather than in fixed-position binary formats. This encoding enables arithmetic operations to be implemented using extremely simple logic primitives, while allowing accuracy to be traded for latency or energy by adjusting the bit-stream length. Consequently, operations such as multiplication and accumulation can be realized with minimal hardware, while offering inherent tolerance to noise and variation, properties that are particularly advantageous in memory-centric computing environments ( 32 ) . This paradigm is particularly well suited to MTJ-based memories, as MTJ devices can be leveraged to efficiently generate stochastic bit-streams, a longstanding bottleneck in practical SC systems. By leveraging the inherent randomness and write-read behavior of MTJs, random or pseudo-random bit-streams can be generated in situ without relying on complex or energy-intensive external random number generation circuitry. In this work, we propose a parallel in-memory SC architecture that integrates data storage, stochastic conversion, and computation into an end-to-end computation pipeline within MTJ-based memory augmented with logic-in-memory (LIM) capabilities. The proposed architecture begins by reading binary operands from MTJ memory arrays, followed by a deterministic and fully parallel conversion of the binary values into stochastic bit-streams. This conversion exploits MTJ write and read operations across memory rows, eliminating the need for external random number generators. The generated bit-streams are then processed by parallel stochastic arithmetic units implemented directly within memory, enabling concurrent execution of core arithmetic operations. Finally, the stochastic results are converted back into binary form using parallel accumulation mechanisms and written back to the MTJ memory. By tightly integrating data storage, stochastic conversion, computation, and write-back within a unified parallel architecture, the proposed design enables efficient in-memory execution of complex operations, while minimizing data movement and maximizing memory-level parallelism. We evaluate the proposed approach using representative image processing workloads, demonstrating its effectiveness in improving both performance and energy efficiency for data-intensive applications. The remainder of this paper is organized as follows. Section 2 provides a background in SC and MTJ structures. Section 3 presents the proposed parallel in-memory architecture. Section 4 evaluates the accuracy, robustness, latency, and power efficiency of the proposed architecture together with the related IMC works comparison and parallel image processing case study. Finally, Section 5 concludes the paper. Figure 1. Conventional SC bit-stream generation approach using RNG and comparator (a) Uncorrelated bit-stream using independent RNGs, (b) Correlated bit-streams by sharing an RNG unit, (c) Serial bit-streams generated in multiple cycles, and (d) Parallel (bundle) bit-streams generated in a single cycle. 2. Background 2.1. Stochastic Computing (SC) SC has emerged as an alternative to conventional binary computing, offering massively parallel and low-cost structures for implementing complex arithmetic operations owing to its simple arithmetics with few logic gates ( 2 ) . By trading precision for hardware simplicity and fault tolerance, SC enables a pathway for deploying complex algorithms on resource-constrained hardware where traditional binary logic becomes impractical. In SC, real numbers are represented using

Read the complete text