CHIMERA: A Flexible and Scalable 3.1 TOPS/W AI-MCU with Transformer Accelerator and 563 Gb/s Shared-L2 Memory Subsystem with QoS Guarantees

Lorenzo Leone * , Philip Wiese * , Gamze Islamoglu * , Michael Rogenmoser * Davide Rossi †‡ , Francesco Conti † , Luca Benini *† · 2026

Read CHIMERA: A Flexible and Scalable 3.1 TOPS/W AI-MCU with Transformer Accelerator and 563 Gb/s Shared-L2 Memory Subsystem with QoS Guarantees by Lorenzo Leone * , Philip Wiese * , Gamze Islamoglu * , Michael Rogenmoser * Davide Rossi †‡ , Francesco Conti † , Luca Benini *† (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-02358.txt.

Introduction

Leone and co-authors present CHIMERA, a low-power chip for AI at the edge. The chip runs transformer models in real time. It draws only a few hundred milliwatts. CHIMERA is built in 22 nanometer FDX technology. Its compute cluster holds nine general-purpose RV32IMA cores beside a transformer accelerator.

A new shared L2 memory system links the clusters. It moves 563 gigabits per second in total. It also gives firm timing promises for urgent traffic. Latency for that traffic drops up to 16-fold. Peak efficiency reaches 3.1 trillion operations per second per watt. Area efficiency reaches 281 billion operations per second per square millimeter. The authors report gains over top system chips on both counts. The design stays flexible as transformer models keep changing.

Catalog record

CREATORLorenzo Leone * , Philip Wiese * , Gamze Islamoglu * , Michael Rogenmoser * Davide Rossi †‡ , Francesco Conti † , Luca Benini *†
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE16 KB
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2606.02358

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CHIMERA: A Flexible and Scalable 3.1 TOPS/W AI-MCU with Transformer Accelerator and 563 Gb/s Shared-L2 Memory Subsystem with QoS Guarantees Lorenzo Leone * , Philip Wiese * , Gamze Islamoglu * , Michael Rogenmoser * Davide Rossi †‡ , Francesco Conti † , Luca Benini *† Abstract We present Chimera, a flexible and scalable Microcontroller Unit (MCU) designed to accelerate real-time inference of rapidly evolving transformer-based models at the ultra-low-power edge (hundred of mW \text{\,}\mathrm{mW} ). The chip, implemented in 22 nm 22\text{\,}\mathrm{n}\mathrm{m} FDX technology, integrates a transformer accelerator tightly coupled within a compute cluster featuring nine general-purpose RV32IMA cores. Scalability extends to the memory hierarchy through a novel L2 memory island subsystem, which enables data sharing across multiple clusters while delivering 563 Gb / s 563\text{\,}\mathrm{Gb/s} aggregate bandwidth. The L2 subsystem enforces quality-of-service guarantees for latency-critical traffic, achieving up to 16 × \times latency reduction. Chimera achieves peak energy and area efficiencies of 3.1 TOPS 3.1\text{\,}\mathrm{TOPS} and 281 GOPS 281\text{\,}\mathrm{GOPS} , demonstrating 1.37 × \times higher energy efficiency and up to 100 × \times higher area efficiency compared to State of the Art (SoA) SoCs. Compared to SoA standalone accelerators, Chimera achieves comparable energy efficiency and up to 1.8 × \times higher area efficiency. * {lleone, wiesep, gislamoglu, michaero, lbenini}@iis.ee.ethz.ch, † {davide.rossi, f.conti}@unibo.it I Introduction The increasing diffusion of Artificial Intelligence (AI) workloads, such as Natural Language Processing (NLP) and speech recognition, in edge and TinyML systems drives the need for high-throughput AI-accelerated Microcontroller Units (AI-MCUs) supporting real-time-constrained execution under strict power and area budgets (from tens to a few hundred \text{\,}\mathrm{mW} and tens of \text{\,}{\mathrm{mm}}^{2} ) [ 12 ] . The rapid evolution of AI models toward attention-based Deep Neural Networks (DNNs) ( Figure 1 ) demands flexibility, motivating system-level co-design of tightly coupled clusters of programmable processors and specialized acceleration engines sharing L1 memory [ 13 ] . At the same time, the increasing heterogeneity and scale of TinyML workloads [ 1 ] are driving a shift toward multi-cluster architectures, which in turn places significant pressure on the L2 memory, shared among all clusters. Sustaining multiple clusters therefore requires high aggregate L2 bandwidth ( Figure 1 ), minimizing inter-cluster contention [ 7 , 5 ] . Moreover, in AI-MCU , a host core orchestrates synchronization and message passing across clusters, generating latency-critical traffic that requires fast and predictable service. This makes both average and worst-case access latency critical, motivating Quality of Service (QoS) support in the L2 memory subsystem [ 3 ] . Fig. 1 : (a) Growth and diversification of AI models [ 10 ] and activation functions [ 2 ] over time. b) Multi-cluster workload execution patterns and their impact on shared L2 memory. We present Chimera 1 1 1 https://github.com/pulp-platform/chimera/releases/tag/CONVOLVE-TO , a flexible AI-MCU that addresses these challenges through three key innovations: (A) an energy-efficient Transformer Acceleration Cluster (TAC) integrating a transformer accelerator tightly coupled with fully programmable RV32IMA cores, enabling flexibility and adaptability to rapidly evolving models ( Figure 1 ), achieving up to 3.1\text{\,}\mathrm{TOPS} ; (B) a shared high-bandwidth AXI4-based L2 memory subsystem capable of delivering up to 563\text{\,}\mathrm{Gb/s} while mitigating inter-cluster contention, thereby enabling efficient multi-cluster workload parallelization; (C) a QoS-aware L2 memory architecture enabling isolation of latency-critical accesses from concurrent high-throughput traffic, achieving a 34-cycle worst-case access latency and up to 16 \times latency reduction compared to conventional designs. By addressing memory bandwidth scalability and contention control, Chimera enables predictable, high-performance execution of heterogeneous TinyML workloads on a low-power AI-MCU. Fig. 2 : (a) Architectural overview of the Chimera SoC . The clusters operate in a dedicated clock domain, while the host and memory island share a common clock. AXI clock-domain crossing modules ensure synchronization, and clock-gating cells at the cluster boundary enable software-controlled clock gating. (b) TAC architecture: configuration registers are programmed via the narrow AXI interface, while streamers handle TCDM data transfers. Weights ( W ) are stored in a 2\text{\,}\mathrm{KiB} double-buffered memory, enabling overlap of computation and data movement. Input activations ( I ) are broadcast to all PEs, which compute 64-way dot products, producing 16 output elements per cycle ( O ). Softmax is computed on-the-fly for attention, while ReLU and GeLU are handled by the activation unit. II Architecture Fig. 3 : Scheduling of MHA on the TAC cluster. While the accelerator computes a tile, the DMA prepares data for the next tile, and the GP cores reduce previously computed heads. The DMA can sustain computational throughput thanks to the memory island subsystem. Chimera is a multi-cluster SoC ( Figure 2 ) integrating seven domains to address the heterogeneous demands of TinyML signal processing. It includes a host domain, five heterogeneous clusters, and a shared L2 memory island. The host comprises an RV32IMC core responsible for system management and coordination, along with a rich peripheral subsystem including UART, I 2 C, a HyperBus controller, and a Direct Memory Access (DMA) engine supporting data transfers between L3 memory and on-chip memories. In this work, we focus on the Transformer Acceleration Cluster ( TAC ). It includes eight RV32IMA cores sharing a 128\text{\,}\mathrm{KiB} Tightly-Coupled Data Memory (TCDM) , along with a 4\text{\,}\mathrm{KiB} L1 I-cache. A ninth core is dedicated to DMA management, orchestrating high-throughput transfers between the cluster and L2 memory via 512-bit ports, enabling efficient AXI4 burst transactions. Fig. 4 : L2 memory island architecture: forward arrows represent initiators, while backward arrows represent responses from target endpoints. The design features two interleaved wide banks delivering up to 128\text{\,}\mathrm{B} , along with a QoS -aware arbitration policy for latency-critical accesses. Tightly coupled with the cores, the accelerator ( Figure 2 ) supports GEMM and attention mechanism using 8-bit integer quantization with minimal accuracy loss [ 8 ] . The accelerator comprises 16 Processing Elements (PEs) , each operating on 8-bit weights ( W ) and activations ( I ), and computing a 64-way dot product per cycle, resulting in a peak throughput of 2048\text{\,}\mathrm{o}\mathrm{p}\mathrm{/}\mathrm{c}\mathrm{y}\mathrm{c}\mathrm{l}\mathrm{e} . Data is supplied through three streamers for inputs ( I ), weights ( W ), and biases ( B ), while a fourth streamer handles output write-back ( O ), each providing up to 128\text{\,}\mathrm{B} . To sustain this peak fetch bandwidth, the accelerator connects to the TCDM interconnect via 16 64-bit master ports. The accelerator also integrates an activation unit ( 8.8\text{\,}\mathrm{kGE} ) in each PE , as well as a softmax engine ( 44\text{\,}\mathrm{kGE} ) with a peak throughput of 64 softmax/cycle, operating concurrently with the PEs during attention ( Figure 3 ). Fig. 5 : Annotated chip micrograph and area breakdown. The overall die area is 12\text{\,}{\mathrm{mm}}^{2} . The silicon area evaluated in this work is 3.19\text{\,}{\mathrm{mm}}^{2} at 60% logic area utilization. Fig. 6 : (a) Simulated performance for different MATMUL sizes across multi-cluster configurations, evaluated with and without the L2 interleaved scheme. (b) Measured average L2 narrow (32-bit) access latency, under concurrent high-throughput data transfers with varying AXI4 burst lengths. To support efficient data sharing and sustain high aggregate bandwidth across multiple clusters, Chimera features a shared 256\text{\,}\mathrm{KiB} L2 memory island ( Figure 4 ) with heterogeneous interfaces: 512-bit AXI4 wide interfaces for high-throughput traffic and a 32-bit AXI4 narrow interface for latency-critical messages. The wide interfaces deliver

Read the complete text