Towards Topology-Aware Very Large-Scale Photonic AI Accelerators
Belal Jahannia, Abdolah Amirany, Hamed Dalir · 2026
Read Towards Topology-Aware Very Large-Scale Photonic AI Accelerators by Belal Jahannia, Abdolah Amirany, Hamed Dalir (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-26966.txt.
Introduction
Jahannia, Amirany and Dalir present a scalable photonic accelerator built from 4 by 4 tensor-core units, tackling the memory wall, where data movement dominates energy use. Their analysis folds in insertion loss, fanout penalties, and laser power caps, which block monolithic scaling. Tested on GoogleNet, ResNet-18, MobileNet, and AlphaGo Zero with up to 1024 elements, they find a layout bottleneck, the Utilization Wall, where grid layout rather than hardware size governs performance. Symmetric grids lift use up to 6 times and cut memory access by over 40 percent versus linear layouts.
Catalog record
| CREATOR | Belal Jahannia, Abdolah Amirany, Hamed Dalir |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 56298 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.26966
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Towards Topology-Aware Very Large-Scale Photonic AI Accelerators Belal Jahannia, Abdolah Amirany, Hamed Dalir Abstract The rapid growth of deep neural networks (DNNs) has exposed fundamental limitations in electronic accelerators, where data movement dominates energy consumption, commonly referred to as the memory wall. Photonic accelerators offer a compelling alternative due to their inherent parallelism and high-speed matrix operations. However, existing research largely focuses on device-level innovations, leaving system-level scalability insufficiently explored. In this paper, we present a scalable photonic accelerator architecture based on a modular scale-out paradigm using 4 × 4 4\times 4 photonic tensor core units. We perform a systematic architectural analysis that incorporates the practical scaling limits of photonic hardware, including insertion loss, fanout penalties, and laser power limits, which restrict monolithic photonic scaling. Through evaluation on representative DNN workloads (GoogleNet, ResNet-18, MobileNet, and AlphaGo Zero) with up to 1024 processing elements, we identify a topology-dominated scaling bottleneck in the photonic domain, termed the “Utilization Wall”, where performance is governed by grid topology rather than hardware size. We further establish the “Symmetric Grid Rule”, demonstrating that symmetric topologies improve utilization by up to 6 × 6\times while reducing memory access by over 40 % 40\% compared to linear configurations, which reveal that topology-aware scaling is essential for achieving energy-efficient and high-performance photonic AI accelerators. 1 Introduction The rapid evolution of deep neural networks (DNNs), with model sizes reaching billions to trillions of parameters, has fundamentally transformed modern computing. However, this progress has exposed a critical limitation: the scaling boundaries of traditional electronic architectures. The emergence of specialized electronic accelerators, notably tensor processing units (TPUs) [ 17 , 18 ] , has significantly improved peak computational performance for DNN workloads. Despite these advances, system efficiency is increasingly constrained by the memory wall , where energy consumption and latency are dominated by data movement rather than computation. This phenomenon reflects a fundamental mismatch between processor throughput and memory bandwidth [ 12 ] . Integrated photonics has emerged as a promising technology to address these limitations by mitigating resistive-capacitive (RC) delays in electronic interconnects [ 22 , 43 ] . Photonic accelerators can perform high-throughput matrix-vector multiplications by leveraging the inherent parallelism of optical signals [ 15 , 2 ] . As illustrated in Fig. 1 , parallel photonic multiply-and-accumulate (MAC) architectures execute matrix operations in a fully parallel manner (Fig. 1 (c)) [ 33 , 43 ] , in contrast to electronic systolic arrays that rely on sequential data propagation (Fig. 1 (b)) [ 17 ] . By exploiting passive optical fan-out and waveguide-based accumulation, photonic systems can significantly reduce data movement overhead. Nevertheless, current photonic accelerators remain immature compared to their electronic counterparts [ 15 , 3 ] . (a) Matrix \mathbf{A} (Inputs) {\lx@inpgf@ignorespaces{\color[rgb]{0.1281,0.3063,0.8}a_{11}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.1281,0.3063,0.8}a_{12}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.1281,0.3063,0.8}a_{13}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.1281,0.3063,0.8}a_{21}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.1281,0.3063,0.8}a_{22}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.1281,0.3063,0.8}a_{23}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.1281,0.3063,0.8}a_{31}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.1281,0.3063,0.8}a_{32}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.1281,0.3063,0.8}a_{33}}} \times Matrix \mathbf{B} (Weights) {\lx@inpgf@ignorespaces{\color[rgb]{0.7219,0.2313,0.0781}b_{11}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.7219,0.2313,0.0781}b_{12}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.7219,0.2313,0.0781}b_{13}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.7219,0.2313,0.0781}b_{21}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.7219,0.2313,0.0781}b_{22}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.7219,0.2313,0.0781}b_{23}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.7219,0.2313,0.0781}b_{31}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.7219,0.2313,0.0781}b_{32}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.7219,0.2313,0.0781}b_{33}}} = Matrix \mathbf{C} (Output) {\lx@inpgf@ignorespaces{\color[rgb]{0.1438,0.3906,0.1563}c_{11}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.1438,0.3906,0.1563}c_{12}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.1438,0.3906,0.1563}c_{13}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.1438,0.3906,0.1563}c_{21}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.1438,0.3906,0.1563}c_{22}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.1438,0.3906,0.1563}c_{23}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.1438,0.3906,0.1563}c_{31}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.1438,0.3906,0.1563}c_{32}}} {\lx@inpgf@ignorespaces{\color[rgb]{0.1438,0.3906,0.1563}c_{33}}} c_{ij}=\sum_{k=1}^{3}a_{ik}\cdot b_{kj} \Rightarrow 27 multiplications + 18 additions (b) PE 11 PE 12 PE 13 PE 21 PE 22 PE 23 PE 31 PE 32 PE 33 a_{1,k} a_{2,k} a_{3,k} b_{k,1} b_{k,2} b_{k,3} c_{i,1} c_{i,2} c_{i,3} a_{in} a_{out} b_{in} b_{out} \times + Acc Clock: data shifts one PE per cycle t_{1} t_{2} t_{3} t_{4} t_{5} a_{11} a_{12} a_{13} 2n\!-\!1=5 cycles (c) col j\!=\!1 b_{11} Input b_{21} Input b_{31} Input col j\!=\!2 b_{12} Input b_{22} Input b_{32} Input col j\!=\!3 b_{13} Input b_{23} Input b_{33} Input Row 1 a_{11} Input a_{12} Input a_{13} Input \Sigma Output c_{11} \Sigma Output c_{12} \Sigma Output c_{13} Row 2 a_{21} Input a_{22} Input a_{23} Input \Sigma Output c_{21} \Sigma Output c_{22} \Sigma Output c_{23} Row 3 a_{31} Input a_{32} Input a_{33} Input \Sigma Output c_{31} \Sigma Output c_{32} \Sigma Output c_{33} Signal Chain: DAC \rightarrow Drv \rightarrow Las \rightarrow Mod "Input" Module \rightarrow 1:3 \rightarrow \rightarrow \Sigma \rightarrow PD \rightarrow TIA \rightarrow ADC "Output" Module Figure 1: Comparison of Matrix Multiplication Implementations: (a) Mathematical definition of a standard matrix multiplication. (b) Electronic systolic array computing partial sums sequentially ( O(n) ) clock cycles, example for 9 PEs. (c) Photonic MAC architecture executing the entire multiplication matrix simultaneously ( O(1) ) using 27 MZIs. A critical maturity gap exists in the photonic computing literature. The majority of prior work focuses on device-level innovations, including modulators, microring resonators, and small-scale 4\times 4 photonic tensor cores (PTCs) [ 3 , 16 , 40 ] . While these developments are essential, system-level evaluations are often limited to simplified benchmarks such as MNIST [ 8 ] or low-dimensional workloads. There remains a lack of systematic understanding of how to build these building blocks into scalable architectures capable of supporting complex DNNs such as GoogleNet [ 32 ] , ResNet-18 [ 13 ] , MobileNet [ 14 ] , and AlphagoZero [ 29 ] . Our goal is to bridge this gap by transitioning photonic computing from isolated device demonstrations to a system-level architectural framework. We introduce a top-down systematic architectural analysis methodology that begins from workload-level requirements and accounts for fundamental scaling limits of photonic hardware. In contrast to conventional monolithic scale-up approaches, which are fundamentally limited by cumulative insertion loss, fanout penalties, and finite laser power budgets, we adopt a modular scale-out strategy based on interconnected 4\times 4 PTC units. In this paper, we propose a modular photonic scaling framework that reconciles large-scale compute requirements with physical constraints, and perform an extensive architectural exploration across four representative DNN workloads and system sizes ranging from 64 to 1024 processing elements (PEs). We show that, unlike electronic accelerators where performance scales primarily with PE count, photonic accelerators exhibit a topology-dominated scaling regime driven by optical loss and communication constraints. In this regime, system performance is governed by grid geometry rather than hardware size, leading to a scaling bottleneck specific to photonic architectures, termed the Utilization Wall . Furthermore, we show the symmetric grid rule , quantifying how grid symmetry and dataflow interactions minimize memory access overhead and maximize utilization. This work focuses on the architectural interaction between grid topology, DNN workload characteristics, and memory access behavior, evaluated using a cycle-accurate simulation framework adapted from electronic systolic array analysis. To isolate these effects, certain system components such as wavelength division multiplexing (WDM), optical memory, and detailed inter-chiplet routing are abstracted, as their inclusion would require device-level modeling beyond the scope of this study. Given the cumulative loss mentioned above, each photonic chiplet is limited to a small 4\times 4 MAC array, encouraging a modular design approach. This constraint motivates our focus on understanding how such modular photonic units interact with workload structure and data movement, providing a foundation for future system-level optimizations. The rest of the paper is organized as follows. Section 2 presents background and related works. Section 3 explains our scaling philosophy and hardware building blocks. Section 4 introduces the simulation framework, workload selection, and analysis methodology. Section 5 presents the main simulation results. Section 6 discusses the key physical challenges limiting photonic scaling and outlines future research directions. Section 7 concludes the paper. 2 Background To achieve a scalable photonic accelerator architecture on a larger scale, a deviation from existing monolithic scaling models of electronic systolic arrays has to occur. Although