Predictive Performance of Photonic SRAM-based In-Memory Computing for Tensor Decomposition

Sasindu Wijeratne 2 , Sugeet Sunder 1 , Md Abdullah-Al Kaiser 3 , Akhilesh Jaiswal 3 Clynn Mathew 1 , Ajey P. Jacob 1 , Viktor Prasanna 2 · 2025

Read Predictive Performance of Photonic SRAM-based In-Memory Computing for Tensor Decomposition by Sasindu Wijeratne 2 , Sugeet Sunder 1 , Md Abdullah-Al Kaiser 3 , Akhilesh Jaiswal 3 Clynn Mathew 1 , Ajey P. Jacob 1 , Viktor Prasanna 2 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-18206.txt.

Introduction

Sasindu Wijeratne and co-authors model a photonic memory array meant for very fast in-memory computing. Their 2025 paper explains that computing with light promises higher speeds and wider data paths than electronics, and that photonic static memory is a key building block. The team studies a new array design and asks how fast it can run a core workload from tensor decomposition.

They mapped that workload, a product step called MTTKRP, onto the array, including a mode that runs several wavelengths at once to raise throughput. A predictive model then estimates the sustained speed of different array layouts. In a practical layout the model gives seventeen peta-operations per second. The authors present the model as a guide for sizing such hardware before it is built, in a field where the devices themselves are still in development.

Catalog record

CREATORSasindu Wijeratne 2 , Sugeet Sunder 1 , Md Abdullah-Al Kaiser 3 , Akhilesh Jaiswal 3 Clynn Mathew 1 , Ajey P. Jacob 1 , Viktor Prasanna 2
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE18 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-18206

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Predictive Performance of Photonic SRAM-based In-Memory Computing for Tensor Decomposition Sasindu Wijeratne 2 , Sugeet Sunder 1 , Md Abdullah-Al Kaiser 3 , Akhilesh Jaiswal 3 Clynn Mathew 1 , Ajey P. Jacob 1 , Viktor Prasanna 2 Abstract Photonics-based in-memory computing systems have demonstrated a significant speedup over traditional transistor-based systems because of their ultra-fast operating frequencies and high data bandwidths. Photonic static random access memory (pSRAM) is a crucial component for achieving the objective of ultra-fast photonic in-memory computing systems. In this work, we model and evaluate the performance of a novel photonic SRAM array architecture in development. Additionally, we examine hyperspectral operation through wavelength division multiplexing (WDM) to enhance the throughput of the pSRAM array. We map Matricized Tensor Times Khatri-Rao Product (MTTKRP), a computational kernel commonly used in tensor decomposition, to the proposed pSRAM array architecture. We also develop a predictive performance model to estimate the sustained performance of different configurations of the pSRAM array. Using the predictive performance model, we demonstrate that the pSRAM array achieves 17 PetaOps while performing MTTKRP in a practical hardware configuration. Email: {kangaram, prasanna}@usc.edu, {sunder, cmathew, ajey}@isi.edu, {mkaiser8, akhilesh.jaiswal}@wisc.edu I Introduction Recent advancements in analyzing large datasets have led to information being inherently represented as higher-order data structures known as tensors. Tensor decomposition converts input tensors into a reduced latent space, which can then be utilized to identify important features of the underlying data distribution. Tensor decomposition has been effectively used in various fields, such as machine learning, signal processing, and network analysis [ 1 , 2 , 3 ] . Additionally, tensor decomposition has been instrumental in improving the interpretability of complex models by breaking down multi-dimensional data into simpler, more manageable components. This decomposition technique has also facilitated advancements in areas such as bioinformatics [ 4 ] , where it aids in the analysis of multi-modal biological data, and in computer vision [ 5 ] , where it enhances image and video processing tasks. The flexibility and robustness of tensor decomposition methods continue to drive innovation across a wide range of scientific and engineering disciplines. Canonical Polyadic Decomposition (CPD) is arguably the most widely used method to decompose a tensor into a low-rank tensor decomposition model [ 6 , 7 ] . It has become the standard tool for unsupervised multi-way data analysis. The Matricized Tensor Times Khatri-Rao Product (MTTKRP) [ 8 ] is recognized as the most time-consuming computational kernel in CPD. Due to the irregular shapes of the real-world tensors, specialized hardware accelerators are increasingly popular to enhance the efficiency of sparse tensor computations [ 9 , 10 , 11 , 12 ] . In recent years, digital electronics have significantly advanced the power and performance metrics of digital computing systems [ 13 ] . The 6-transistor electrical SRAM has become the standard for on-chip memory storage. However, these electrical SRAMs fall short in terms of computing speed, throughput, and power efficiency for new data-intensive applications such as machine learning, signal processing, and large-scale simulations [ 14 ] . The rapid increase in the energy delay product associated with data movement and memory access for compute operations underscores the memory bottleneck that affects modern digital computing systems [ 13 ] . Solutions involving parallel, near-memory, and in-memory processors based on electronic physical-state variables do not completely address the issue due to constraints related to scalar computing and the latency of long metal interconnections. Recently, photonic SRAMs have emerged as a promising alternative to electronic charge-based SRAMs [ 15 ] . Numerous photonic SRAM implementations have been investigated in the past [ 16 , 17 , 18 , 19 , 20 , 21 , 22 , 23 ] . However, developing a photonic SRAM technology that is compatible with current foundry manufacturing processes and offers ultra-high speed and low energy consumption remains a significant challenge. In this work, we introduce a novel photonic SRAM array embedded in a scalable optical in-memory compute engine, designed using existing foundry processes. The photonic SRAM uses available GF45SPCLO photodiodes and ring resonators, which are upgrades over our previous designs [ 15 ] and utilized models of photonic devices reported in the literature [ 24 , 25 ] . Our approach combines the high-speed and bandwidth advantages of photonic technology with the proven reliability of SRAM while addressing the challenges of integrating optical components with standard CMOS processes to create a scalable and efficient in-memory computing solution. The contributions of our paper are as follows: • A novel embedded photonic SRAM (pSRAM) array is designed and implemented in a scalable optical in-memory computing engine, operating in the O-band. The pSRAM is reconfigurable at speeds exceeding 20 GHz; the write speed of the RAM. The overall performance of the pSRAM array is determined by the speed of the optical components that constitute the system architecture. • We map the compute primitives of MTTKRP to the pSRAM array architecture. • We develop a predictive performance model to evaluate the sustained performance of the proposed photonic SRAM memory architecture on MTTKRP. • The predictive performance model shows that the pSRAM array can achieve a sustained performance of 17 PetaOps with 8-bit precision under practical pSRAM array configuration. II Background A tensor is a generalization of an array in multiple dimensions. In TD, the number of dimensions of an input tensor is commonly called the number of tensor modes. A real-valued N mode tensor is denoted by \mathcal{X}\in\mathbb{R}^{I_{0}\times\cdots\times I_{N-1}} . Further, \mathcal{X}_{(n)} denotes the mode- n matricization or the unfolding [ 26 ] of the matrix \mathcal{X} . \mathcal{X}_{(n)} is defined as the matrix \mathcal{X}_{(n)}\in\mathbb{R}^{I_{n}\times(I_{0}\cdots I_{n-1}I_{n+1}\cdots I_{N-1})} where parenthetical ordering indicates that the mode- n column vectors are arranged by sweeping all the other mode indices through their ranges. Canonical Polyadic Decomposition (CPD) decomposes \mathcal{X} into a sum of single-mode tensors (i.e., arrays), which best approximates \mathcal{X} . For example, given 3-mode tensor \mathcal{X}\in\mathbb{R}^{I_{0}\times I_{1}\times I_{2}} , our goal is to approximate the original tensor as \begin{split}\mathcal{X}\approx\sum_{r=0}^{R-1}\mathbf{a}_{r}\circ\mathbf{b}_{r}\circ\mathbf{c}_{r}\end{split} (1) where R is a positive integer and \mathbf{a}_{r}\in\mathbb{R}^{I_{0}} , \mathbf{b}_{r}\in\mathbb{R}^{I_{1}} , and \mathbf{c}_{r}\in\mathbb{R}^{I_{2}} . For a thorough review of CPD, refer to [ 6 ] . In the rest of Section II , we assume that the number of modes is three for illustration purposes. Input: A tensor \mathcal{X}\in\mathbb{R}^{I_{0}\times I_{1}\times I_{2}} , the rank R\in\mathbb{Z}^{+} 1 Output: CP decomposition [\![\mathbf{A},\mathbf{B},\mathbf{C}]\!] , \mathbf{A}\in\mathbb{R}^{I_{0}\times R} , \mathbf{B}\in\mathbb{R}^{I_{1}\times R} , \mathbf{C}\in\mathbb{R}^{I_{2}\times R} 2 while stopping criterion not met do 3 // Matricization of \mathcal{X} is different for each factor matrix computation 4 5 \mathbf{A}\leftarrow\mathbf{spMTTKRP}(\mathcal{X}_{(0)},\mathbf{B},\mathbf{C}) 6 \mathbf{B}\leftarrow\mathbf{spMTTKRP}(\mathcal{X}_{(1)},\mathbf{A},\mathbf{C}) 7 \mathbf{C}\leftarrow\mathbf{spMTTKRP}(\mathcal{X}_{(2)},\mathbf{A},\mathbf{B}) 8 Normalize \mathbf{A} , \mathbf{B} , \mathbf{C} 9 Algorithm 1 CP-ALS for a 3-mode tensor The alternating least squares (ALS) method is used to compute CPD. Algorithm 1 shows the ALS method for CPD (i.e., CP-ALS) where Matricized Tensor-Times Khatri-Rao product (MTTKRP) is iteratively performed on all the Matricizations of \mathcal{X} , iteratively. In this paper, performing MTTKRP on all the Matricizations of an input tensor is called computing MTTKRP along all the modes. The outputs \mathbf{A} , \mathbf{B} , and \mathbf{C} are the factor matrices that approximate \mathcal{X} . \mathbf{a}_{r} , \mathbf{b}_{r} , and \mathbf{c}_{r} in Equation 1 refers to the r^{\text{th}} column of \mathbf{A} , \mathbf{B} , and \mathbf{C} , respectively.

Read the complete text