MINISA: Minimal Instruction Set Architecture for Next-gen Reconfigurable Inference Accelerator
Jianming Tong 3 , Devansh Jain 2 , Yujie Li 3 , Charith Mendis 2 , Tushar Krishna 3 · 2026
Read MINISA: Minimal Instruction Set Architecture for Next-gen Reconfigurable Inference Accelerator by Jianming Tong 3 , Devansh Jain 2 , Yujie Li 3 , Charith Mendis 2 , Tushar Krishna 3 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-20623.txt.
Introduction
Tong and co-authors present MINISA, a small instruction set for AI accelerators that can be reconfigured. Rich layout freedom helps these chips stay busy on many task types. But fine control means fetching huge config data from off chip memory. Their set programs the chip at the level of virtual neurons. Three layout commands plus one mapping command cover the full legal space. On 50 matrix workloads, off chip instruction traffic fell sharply. End to end speed rose up to 31.6 times.
Catalog record
| CREATOR | Jianming Tong 3 , Devansh Jain 2 , Yujie Li 3 , Charith Mendis 2 , Tushar Krishna 3 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63638 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.20623
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
MINISA: Minimal Instruction Set Architecture for Next-gen Reconfigurable Inference Accelerator Jianming Tong 3 , Devansh Jain 2 , Yujie Li 3 , Charith Mendis 2 , Tushar Krishna 3 Abstract Modern reconfigurable AI accelerators rely on rich mapping and data-layout flexibility to sustain high utilization across matrix multiplication, convolution, and emerging applications beyond AI. However, exposing this flexibility through fine-grained micro-control results in prohibitive control overhead of fetching configuration bits from off-chip memory. This paper presents MINISA, a minimal instruction set that programs a reconfigurable accelerator at the granularity of Virtual Neurons (VNs), the coarsest control granularity that retains flexibility of hardware and the finest granularity that avoids unnecessary control costs. First, we introduce FEATHER+, a modest refinement of FEATHER, that eliminates redundant on-chip replication needed for runtime dataflow/layout co-switching and supports dynamic cases where input and weight data are unavailable before execution for offline layout manipulation. MINISA then abstracts control of FEATHER+ into three layout-setting instructions for input, weight, and output VNs and a single mapping instruction for setting dataflow. This reduces the control and instruction footprint while preserving the legal mapping and layout space supported by the FEATHER+. Our results show that MINISA reduces geometric mean off-chip instruction traffic by factors ranging from 35 × 35{\times} to ( 4 × 10 5 ) × (4\times 10^{5}){\times} under various sizes under 50 GEMM workloads spanning AI (GPT-oss), FHE, and ZKP. This eliminates instruction-fetch stalls that consume 96.9 % 96.9\% of micro-instruction cycles, yielding up to 31.6 × 31.6\times end-to-end speedup for 16 × 256 16\times 256 FEATHER+. Our code: https://github.com/maeri-project/FEATHER/tree/main/minisa . I Introduction The new AI revolution drives crazily increasing installs of data centers for AI. With AI workloads become diverse, AI accelerators increasingly become more reconfigurable for efficiently support workloads of diverse shapes. Their performance stems from two sources: (i) high-throughput low-precision matrix/vector execution and (ii) programmable data movement that enables diverse dataflows and layouts. This programmability is now crucial not only for CNNs and Transformers, but also for workloads that can be compiled into matrix and vector operators, including homomorphic encryption (HE [ 22 ] ) and zero-knowledge proofs (ZKP [ 21 ] ). Yet this same flexibility creates a challenge: control overhead . FEATHER [ 23 ] represents the SotA accelerator enabling (dataflow, layout) coswitching for each individual workload. However, its programming interfaces expose fine-grained or micro-coded control over buffer layouts, on-chip routing, and data-to-PE mappings. While expressive, such a paradigm inflates instruction traces, increases off-chip instruction fetch traffic, and consumes limited valuable on-chip memory for storing instructions. The resulting control footprint can directly limit the size of compute tiles that fit on the chip, reducing arithmetic intensity and hurting end-to-end throughput. As accelerators scale in array dimensions and workload diversity, this control overhead becomes a first-order bottleneck (§ III-D ). This paper argues that the right abstraction boundary for minimizing control overhead is the Virtual Neuron (VN) . A VN corresponds to the smallest hardware dot-product atom. A coarser-grained abstraction than current VN would ignore inter-PE mapping flexibility, while a finer-grained abstraction would introduce unnecessary control costs without gaining flexibility. Therefore, programming at the level of VN is exactly the level to minimize control overhead without losing hardware built-in flexibility. Building on this insight, we present a compact VN-abstracted instruction set architecture, MINISA, that captures the flexibility in mapping and layout of FEATHER [ 23 ] , one SotA reconfigurable accelerator, using only eight instructions. Layout-setting instructions parameterize the nested-loop order of VNs in on-chip buffers. The mapping instruction specifies dataflow and triggers execution of a compute tile under the current layout configurations. For a single layer, the program trace consists of three layout instructions followed by a sequence of ExecuteMapping and ExecuteStreaming invocations. For consecutive layers, the output of the first layer becomes the input of the next, allowing SetIVNLayout of the next layer to be used to specify the output layout of next one. This allows skipping SetOVNLayout of the current one. While MINISA compresses FEATHER’s control footprint, the baseline FEATHER microarchitecture still creates two practical frictions for dynamic workloads: it can induce data duplication in on-chip buffers, and its buffer/interconnect design relies on the assumption that one operand (often weights) needs to be pre-known and pre-reordered into preferred layout before program execution. This assumption limits applicability when both operands may arrive or change at runtime, such as LLM inference. To remove these barriers without redesigning the accelerator, we augment FEATHER [ 23 ] into FEATHER+ with minimal architectural refinements on (1) interconnect and (2) buffer organization to add distribution flexibility for (1) eliminating data duplication in on-chip buffers, and (2) supporting scenarios when weights are not pre-known for compile-time layout pre-reorder. Our contributions are: \bullet We identify control overhead as a key limiter of tile size and instruction efficiency in reconfigurable AI accelerators, instruction fetching stall share rises from 0% (FEATHER+ with smaller than 8\times 8 PE Array) to 96.9% (16 \times 256 FEATHER+). \bullet We propose FEATHER+, a modest enhancement that (1) supports dynamic input data, (2) removes data duplication in on-chip buffers, and (3) enables inputs to be loaded inside NEST and streaming weights. \bullet We introduce MINISA, a minimal VN-level ISA for FEATHER that preserves hardware-supported mapping and layout flexibility with eight instructions. \bullet We demonstrate that MINISA enables up-to 31.6\times speedups by avoiding instruction-fetch stalls. We show MINISA reduces instruction-to-data ratio from \sim 100 \times (micro-instruction programming) to negligible (MINISA) for 16 \times 256 FEATHER+. MINISA maintains <0.1\% instruction-cycle fraction. II Background Fig. 1 : Workload Illustration. Convolution is converted to MatMul via im2col. We use color coding: blue/green/purple/red for Input( I )/Weight( W )/Partial-sum(psum, P )/Outputs( O ). II-A Workload Specification Modern AI inference workloads—from LLM attention blocks to text-to-image pipelines—are dominated by matrix multiplications and convolutions whose operand values and shapes can vary across layers and requests. To describe this diversity in a uniform way, we adopt extended einsum notation [ 5 ] . Taking matrix multiplication as an example (Fig. 1 ). {\color[rgb]{0.6016,0,0}{O}}_{m,n}^{P=M,Q=N}={\color[rgb]{0,0.2969,0.6016}{I}}_{m,k}^{M=M,J=K}\cdot{\color[rgb]{0,0.3984,0.1992}{W}}_{k,n}^{K=K,N=N} Each tensor is annotated with: \bullet Superscript : an ordered list of rank names that define the logical shape. Ranks are capitalized, such as {\color[rgb]{0,0.2969,0.6016}{I}}\in\mathbb{R}^{M\times J},{\color[rgb]{0,0.3984,0.1992}{W}}\in\mathbb{R}^{K\times N},{\color[rgb]{0.2969,0,0.6016}{P}}\in\mathbb{R}^{P\times Q},{\color[rgb]{0.6016,0,0}{O}}\in\mathbb{R}^{P\times Q} . \bullet Subscript : an ordered list of quasi-affine index expressions over rank variables and constants (e.g., [m,k] ). Rank variables use the lowercase form of the corresponding rank name. Partial sums represent intermediate accumulation states that arise when the rank variable of reduction rank (e.g., k ) is distributed across non-consecutive loop levels in mapping, requiring aggregation of partial results to produce final outputs. II-B Mapping and Layout A given extended einsum (Fig. 1 ) can be executed with many legal schedules. We refer to a fine-grained schedule of compute and memory accesses as a mapping which specifies the partitioning, ordering and parallelism of ranks [ 20 , 11 ] . Independently, each tensor can be organized differently in on-chip memories. We use layout to denote the fine-grained organization of data in the on-chip buffers [ 23 , 20 ] . II-C Reconfigurable Accelerator No single dataflow is globally optimal across the wide shape space of modern operators [ 17 , 20 ] . This motivates reconfigurable accelerators that can adapt mappings