ATLAAS: Automatic Tensor-Level Abstraction of Accelerator Semantics

Ruijie Gao, Haoran Jin, Jirong Yang, Nathaniel Bleier · 2026

Read ATLAAS: Automatic Tensor-Level Abstraction of Accelerator Semantics by Ruijie Gao, Haoran Jin, Jirong Yang, Nathaniel Bleier (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-13523.txt.

Introduction

Ruijie Gao and three colleagues present TensorLift, an MLIR pipeline that lifts RTL semantics to tensor ISA specs. Most accelerators lack documented ISAs. Recent work shows a tensor ISA specification suffices for stacks, yet writing it stays manual. An eight-pass MLIR pipeline recovers structure, including multiply-accumulate idioms and layout transformations, and emits specs ACT consumes. On Gemmini and VTA, TensorLift captures every instruction across 156 MLIR files. It cuts bit-level MLIR by about 25 percent and about 41 percent overall, and by up to about 93 percent on an element.

Catalog record

CREATORRuijie Gao, Haoran Jin, Jirong Yang, Nathaniel Bleier
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44936
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.13523

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ATLAAS: Automatic Tensor-Level Abstraction of Accelerator Semantics Ruijie Gao, Haoran Jin, Jirong Yang, Nathaniel Bleier Abstract . Numerous tensor accelerator designs have been proposed in academia and industry, yet most lack well-documented ISAs and compiler backends. As a consequence, the majority of new designs are only evaluated on a handful of operators or synthetic kernels. Recent work (e.g., TAIDL and the ACT ecosystem) has shown that given a tensor-level ISA specification, complete software stacks including test oracles and compiler backends can be automatically generated. However, writing such specifications remains a manual, expert-driven process. We present ATLAAS, the first end-to-end MLIR-based pipeline that lifts RTL-extracted accelerator semantics to TAIDL-like tensor ISA specifications. Building on prior architecture-level model extraction that produces bit-level LLVM IR, ATLAAS introduces an 8-pass MLIR semantic lifting pipeline that progressively recovers high-level tensor structure, including MAC idioms, saturation semantics, multi-dimensional buffer organizations, and data layout transformations. The pipeline emits specifications in the TAIDL formalism, immediately enabling automatic software stack generation through the ACT ecosystem. We evaluate ATLAAS on Gemmini, a systolic-array accelerator, extracting all hardware instructions semantics across 127 MLIR files. The lifting pipeline collapses the extracted bit-level MLIR by up to 92.9% on processing elements (686 → \to 49 lines, of which only 17 encode the tensor computation core) and by 24–34% on controller modules, with the residue being irreducible control logic (FSMs, address computation, and instruction muxing). ATLAAS discovers hardware features omitted from the hand-written reference, including multi-bank DMA configuration, pooling engine semantics, and im2col hardware support. Correctness is validated through Z3 SMT equivalence proofs. We further confirm generality on TVM’s VTA tensor processor, where the same pipeline lifts all four datapath modules without accelerator-specific changes, with extracted semantics formally verified against the underlying RTL. By feeding the extracted specification into the ACT compiler framework, ATLAAS enables an automated path from RTL to a performance-competitive compiler backend, eliminating the need to manually write tensor-level ISA semantics. 1. Introduction Figure 1. Overview of the existing landscape. ATLAAS bridges the gap between bottom-up RTL extraction (scalar-level models) and top-down compiler automation (which assumes a hand-written TAIDL specification). The rapid growth of deep learning workloads has driven a proliferation of specialized tensor accelerators in both academia and industry. Designs such as Gemmini ( 13 ) , MAERI ( 24 ) , SIGMA ( 38 ) , Eyeriss ( 6 ) , NVDLA ( 8 ) , and FEATHER ( 43 ) explore diverse microarchitectural innovations—systolic arrays, reconfigurable interconnects, flexible dataflow engines—to deliver orders-of-magnitude improvements in performance and energy efficiency over general-purpose processors. Meanwhile, a small number of platforms backed by major vendors, notably Google’s TPU ( 23 ) with XLA ( 39 ) , Intel AMX ( 19 ) with oneDNN ( 35 ) , and NVIDIA GPUs with CUDA/cuDNN ( 32 ; 7 ) , enjoy mature compiler toolchains that connect them seamlessly to frameworks like PyTorch ( 36 ) , JAX ( 4 ) , and TensorFlow ( 1 ) . The contrast is stark: as Table 1 summarizes, accelerators with mature, end-to-end compiler support number fewer than five, while over a dozen open-source designs lack any usable compiler backend. These accelerators can only be exercised through hand-written kernel libraries that cover a narrow set of operators and miss cross-layer fusion opportunities, leaving the vast majority of proposed hardware unable to run real ML models end-to-end. Table 1. Software stack readiness of representative open-source tensor/DNN accelerators. ● = available, ◐ = partial/limited, ○ = unavailable. ATLAAS targets accelerators with open RTL (●/◐ in col. 3) but missing ISA specifications (○ in col. 1). Accelerator ISA Spec Compiler Backend Open RTL Test Oracle MAERI ( 24 ) ○ ○ ● ○ SIGMA ( 38 ) ○ ○ ● ○ Eyeriss ( 6 ) ○ ○ ◐ ○ MAGNet ( 46 ) ○ ○ ● ○ DNNBuilder ( 51 ) ○ ○ ● ○ FlexASR ( 41 ) ○ ○ ● ○ SPAGHETTI ( 14 ) ○ ○ ● ○ NVDLA ( 8 ) ◐ ◐ ● ◐ Gemmini ( 13 ) ◐ ◐ ● ◐ VTA ( 31 ) ◐ ◐ ● ◐ DnnWeaver ( 40 ) ○ ◐ ● ○ Google TPU ( 23 ) ● ● ○ ● Intel AMX ( 19 ) ● ● ○ ● The root cause of this software deficit lies upstream of the compiler: the ISA semantics of most accelerators have never been formally defined. In the CPU world, the ISA serves as the foundational contract between hardware and software; for accelerators, however, ISA information is typically scattered across RTL source code, informal documentation, or exists only in the minds of hardware designers ( 17 ; 18 ) . Figure 1 summarizes this landscape: the top-down ACT ecosystem assumes a hand-written TAIDL specification, while the bottom-up ILA framework produces only scalar-level models, leaving no automated path from RTL to tensor-level semantics. Recent work has made significant strides in closing this gap from ISA specification downward. TAIDL ( 21 ) introduced a domain-specific language for defining tensor accelerator ISAs, and ACT ( 22 ) showed that compiler backends can be automatically generated from such specifications (§ 2.2 ). However, this pipeline has a critical prerequisite: someone must first write the TAIDL specification by hand—a process that requires deep understanding of the accelerator’s architectural state, instruction encoding, and tensor-level semantics. This manual specification bottleneck is well-documented: writing formal accelerator models has been characterized as “tedious and error-prone” ( 50 ) and as “a significant burden for accelerators which may not have the volume or life-span compared to processors” ( 49 ) . On the hardware side, RTL designs iterate rapidly; on the software side, TAIDL and ACT automate everything downstream of the ISA spec but cannot function without one. Prior efforts such as ILA ( 17 ) and 3LA ( 16 ) formalized accelerator interfaces but still require hand-authored models, and LLM-based EDA agents ( 53 ; 47 ; 27 ; 37 ) that depend on machine-readable hardware semantics ( 15 ; 33 ; 48 ) cannot operate when such semantics do not exist. Figure 2. ATLAAS’s semantic lifting on a Gemmini PE: from RTL source ( top ) through 686 lines of bit-level MLIR ( middle ) to 49 lines of lifted MLIR ( bottom , 92.9% reduction). In this paper, we present ATLAAS, the first end-to-end MLIR-based pipeline that lifts RTL-extracted accelerator semantics to TAIDL-like tensor ISA specifications. Building on prior architecture-level model extraction ( 49 ; 50 ) that produces bit-level MLIR from flattened RTL, ATLAAS employs an 8-pass MLIR semantic lifting pipeline that progressively recovers high-level tensor structure—from bit-manipulation canonicalization through idiom detection and loop reconstruction to structured metadata emission—bridging the abstraction gap between gate-level hardware and the tensor-level semantics required by tools like TAIDL and ACT (Figure 2 ). We evaluate ATLAAS on two open-source accelerators: Berkeley’s Gemmini (systolic array, 16 \times 16, INT8) and TVM’s VTA. The lifting pipeline achieves up to 92.9% reduction on compute-dominated modules, discovers hardware features omitted from hand-written references, and generalizes across both accelerators without modification. All lifted semantics are formally verified equivalent to the RTL via Z3 ( 9 ) SMT proofs. Fed into ACT, the extracted specification yields a compiler

Read the complete text