Enabling AI ASICs for Zero Knowledge Proof Conference: 63rd ACM/IEEE Design Automation Conference; July 26–29, 2026; Long Beach, CA, USA 63rd ACM/IEEE Design Automation Conference (DAC ’26), July 26–29, 2026, Long Beach, CA, USA DOI: 10.1145/3770743.3804402 ISBN: 979-8-4007-2254-7/2026/07
Jianming Tong, Jingtian Dang, Simon Langowski, Tianhao Huang, Asra Ali, Jeremy Kun, Jevin Jiang, Srinivas Devadas, Tushar Krishna · 2026
Read Enabling AI ASICs for Zero Knowledge Proof Conference: 63rd ACM/IEEE Design Automation Conference; July 26–29, 2026; Long Beach, CA, USA 63rd ACM/IEEE Design Automation Conference (DAC ’26), July 26–29, 2026, Long Beach, CA, USA DOI: 10.1145/3770743.3804402 ISBN: 979-8-4007-2254-7/2026/07 by Jianming Tong, Jingtian Dang, Simon Langowski, Tianhao Huang, Asra Ali, Jeremy Kun, Jevin Jiang, Srinivas Devadas, Tushar Krishna (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17808.txt.
Introduction
Tong and eight colleagues present MORPH, reformulating ZKP kernels for AI-ASIC execution. ZKP provers stay costly because MSM and NTTs dominate runtime. MORPH's Big-T complexity exposes bottlenecks and layout costs ignored by Big-O. MORPH's MXU-centric extended-RNS lazy reduction recasts high-precision modular arithmetic as dense low-precision GEMMs without carry chains, and unified-sharding layout-stationary TPU Pippenger MSM with optimized 3/5-step NTT avoids on-TPU shuffles. TPUv6e8 with MORPH reaches up to 10x higher NTT throughput and comparable MSM throughput versus GZKP.
Catalog record
| CREATOR | Jianming Tong, Jingtian Dang, Simon Langowski, Tianhao Huang, Asra Ali, Jeremy Kun, Jevin Jiang, Srinivas Devadas, Tushar Krishna |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39167 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.17808
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Enabling AI ASICs for Zero Knowledge Proof Conference: 63rd ACM/IEEE Design Automation Conference; July 26–29, 2026; Long Beach, CA, USA 63rd ACM/IEEE Design Automation Conference (DAC ’26), July 26–29, 2026, Long Beach, CA, USA DOI: 10.1145/3770743.3804402 ISBN: 979-8-4007-2254-7/2026/07 Jianming Tong, Jingtian Dang, Simon Langowski, Tianhao Huang, Asra Ali, Jeremy Kun, Jevin Jiang, Srinivas Devadas, Tushar Krishna Abstract . Zero-knowledge proof (ZKP) provers remain costly because multi-scalar multiplication (MSM) and number-theoretic transforms (NTTs) dominate runtime as they need significant computation. AI ASICs such as TPUs provide massive matrix throughput and SotA energy efficiency. We present MORPH , the first framework that reformulates ZKP kernels to match AI-ASIC execution. We introduce Big- T T complexity, a hardware-aware complexity model that exposes heterogeneous bottlenecks and layout-transformation costs ignored by Big- O O . Guided by this analysis, (1) at arithmetic level, MORPH develops an MXU-centric extended-RNS lazy reduction that converts high-precision modular arithmetic into dense low-precision GEMMs, eliminating all carry chains, and (2) at dataflow level, MORPH constructs a unified-sharding layout-stationary TPU Pippenger MSM and optimized 3/5-step NTT that avoid on-TPU shuffles to minimize costly memory reorganization. Implemented in JAX, MORPH enables TPUv6e8 to achieve up-to 10 × \times higher throughput on NTT and comparable throughput on MSM than GZKP. Our code: https://github.com/EfficientPPML/MORPH . † † cc-license: by 1. Introduction Zero-knowledge proofs (ZKPs) have evolved from a theoretical construct into a core building block for practical verifiable computation and scalable blockchains. They allow services to outsource computation while keeping data private and verification cheap, but the prover remains prohibitively expensive , e.g., generating a proof for ImageNet ViT requires nearly one hour ( Zhang et al. 2025 ) . Across widely deployed protocols ( Groth 2016 ; Gabizon et al. 2019 ) , prover runtime is dominated by multi-scalar multiplication (MSM) and the number-theoretic transform (NTT) , which commonly account for \approx 70% and 20–30% of total latency, respectively ( Ji et al. 2024 ; Zhang et al. 2021 ) . Figure 1 . MORPH ’s deployment flow with dataflow and arithmetic optimizations to accelerate ZKP on TPU. Both MSM and NTT expose abundant parallelism at practical ZKP sizes, making parallel hardware promising for acceleration. Among these platforms, AI ASICs (Google TPU ( Jouppi et al. 2023 ) , AWS Trainium ( Tra 2025 ) etc.) offer extreme compute density and energy efficiency, significantly outperforming general-purpose accelerators at scale ( Tong et al. 2026a ) . Architecturally, a TPU contains giant heterogeneous cores, including a matrix multiplication engine (MXU) and a vectorized processing engine (VPU). Each MXU/VPU contains orders of magnitude (1024/16 \times ) more multiply-accumulates (MACs) than one corresponding core in a GPU ( Austin et al. 2025 ) . All MACs in a MXU/VPU execute instruction in the lock-step (SIMD) to substantially reduce per-operation control overhead and improve energy efficiency. This paper studies how to systematically repurpose AI ASICs, particularly Google’s TPUs ( Jouppi et al. 2023 ) , for ZKP kernels (MSM/NTT) and achieve higher energy efficiency and SoTA throughput at scale. Existing ZKP acceleration spans GPUs ( Ma et al. 2023a ; Ji et al. 2024 ; Dai and Sunar 2015 ; Ma et al. 2023b ) , FPGAs ( Aasaraai et al. 2022 ; Liu et al. 2023 ; Ray et al. 2023 ; Pottier et al. 2025 ; Ohno et al. 2025 ; Reagen et al. 2021 ) and ASICs ( Samardzic et al. 2024 ; Zhang et al. 2021 ; Wang and Gao 2025 ) . While these systems hand-craft MSM/NTT algorithms for their respective platforms, they provide no principled way to quantify how far an MSM/NTT algorithm is from the platform’s performance limits with detailed reasoning . Some works provide Big-O complexity ( Kim et al. 2023 ) , yet we find a surprising phenomenon: the fastest GPU/TPU algorithms intentionally use the algorithm with higher Big-O to expose massive parallelism and thus achieve higher throughput ( Tong et al. 2026a ) . Big-O alone is insufficient for modern heterogeneous parallel hardware. Furthermore, Big-O cannot capture layout transformation cost, which becomes the dominant bottleneck on AI ASICs. When we port the SotA MSM and NTT algorithms for GPU/FPGA/ZKP-ASIC to TPUs with similar overall throughput, they slow down by 30 \times in our evaluation. This is because a TPU only operates on coarser-grained contiguous data (a 4KB vector register, VReg) , and fine-grained data gathering in SotA MSM/NTT algorithms requires expensive shuffles and transposes to move data into contiguous VRegs. These layout-induced stalls are invisible under the traditional Big-O model. To address this gap, we introduce Big- T notation, a platform-aware complexity model that measures the sequential bottleneck across heterogeneous pipelined compute units and the latency of layout transformation, providing an asymptotic lower bound for parallel execution on AI ASICs. Big- T exposes two structural inefficiencies in SotA MSM/NTT algorithms on TPUs. Arithmetic-level Challenge : ZKP requires modular arithmetic over large prime fields (e.g., 256/377/753 bits), but hardware natively supports much lower precision (e.g., 8/32-bit). Because prime fields lack a natural RNS factorization, the SotA algorithm ( Ma et al. 2023b ; yrr 2025 ) performs high-precision arithmetic via digit decomposition and a chain of carry propagation, achieving <1% compute utilization on TPUs. Dataflow-level Challenge : The SotA dataflows incur prohibitive communication and storage overheads. In presorted Pippenger MSM ( Ji et al. 2024 ; Ma et al. 2023b ) , sorting is distributed across many GPU CUDA cores. Directly porting this strategy to TPU introduces prohibitive inter-TPU communication. Layout-invariant 3-step NTT ( Tong et al. 2026a ) requires parameters that scale linearly with problem size, resulting in out-of-memory (OOM) failures at large scale. In resolving these inefficiencies, we propose MORPH 1 1 1 MORPH: M atrix- O riented R eformulation of ZKP for P arallel H eterogeneous AI ASICs , the first framework enabling TPU as ZKP accelerator with arithmetic and dataflow level optimizations, as shown in Fig. 1 . Arithmetic-level Solution : Since a prime field cannot be represented in a Residue Number System (RNS), MORPH adopts ( Jacquemin et al. 2022 ; Langowski and Devadas 2025 ) to encapsulate modular multiplication in a prime field in a larger non-prime finite field that has a RNS representation. This enables high-precision multiplication to be expressed as independent 32-bit vector multiplications with no carry propagation. Then, MORPH reforms the modular reduction (RNS reconstruction → modular reduction → RNS decomposition) as low-precision matrix multiplication and parallel vectorized operations to be accelerated by TPU’s MXU and VPU, achieving up-to 90 \times speedup. Dataflow-level Solution : To tackle communication and layout reorganization, MORPH proposed LS-PPG to schedule communication-free workload dimensions across devices to avoid inter-TPU communication, ensures layout invariant within individual TPU. To mitigate parameters storage overflow, MORPH’s 5-step NTT recursively partitions workloads to reduce parameter size while preserving the same computational complexity. Together, MORPH enables TPUv6e-8 to achieve up-to 10 \times NTT throughput and 1.2 \times MSM throughput than GZKP ( Ma et al. 2023b ) (NVIDIA V100). MORPH makes TPU the SotA throughput machine for high-precision NTT , a promising platform for ZKP acceleration. Our contributions are: \bullet BIG- T Complexity: A hardware-aware complexity metric that captures heterogeneous compute spans and layout transformation, enabling principled analysis of MSM/NTT