MambaLite-Micro: Memory-Optimized Mamba Inference on MCUs

Hongjun Xu, Junxi Xia, Weisi Yang, Yueyuan Sui, Stephen Xia · 2025

Read MambaLite-Micro: Memory-Optimized Mamba Inference on MCUs by Hongjun Xu, Junxi Xia, Weisi Yang, Yueyuan Sui, Stephen Xia (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-05488.txt.

Description

A modern sequence model family is squeezed onto tiny microcontrollers by Hongjun Xu and four co-authors in a 2025 embedded systems paper. Mamba models process long sequences efficiently, but chips in small devices have little memory, few built-in operations, and no friendly deployment tools.

Their engine, MambaLite-Micro, is to their knowledge the first Mamba deployment on such a chip, written fully in C with no runtime. Weights are exported in a light format and the core layer is hand-built with fused operations and careful memory layout, cutting peak memory sharply while matching the reference implementation closely. Keyword spotting and activity recognition tasks kept full accuracy, on two different microcontroller families.

Catalog record

CREATORHongjun Xu, Junxi Xia, Weisi Yang, Yueyuan Sui, Stephen Xia
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE18 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-05488

Browse the full library · About the Tower of Babel