MambaLite-Micro: Memory-Optimized Mamba Inference on MCUs
Hongjun Xu, Junxi Xia, Weisi Yang, Yueyuan Sui, Stephen Xia · 2025
Read MambaLite-Micro: Memory-Optimized Mamba Inference on MCUs by Hongjun Xu, Junxi Xia, Weisi Yang, Yueyuan Sui, Stephen Xia (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-05488.txt.
Description
A modern sequence model family is squeezed onto tiny microcontrollers by Hongjun Xu and four co-authors in a 2025 embedded systems paper. Mamba models process long sequences efficiently, but chips in small devices have little memory, few built-in operations, and no friendly deployment tools.
Their engine, MambaLite-Micro, is to their knowledge the first Mamba deployment on such a chip, written fully in C with no runtime. Weights are exported in a light format and the core layer is hand-built with fused operations and careful memory layout, cutting peak memory sharply while matching the reference implementation closely. Keyword spotting and activity recognition tasks kept full accuracy, on two different microcontroller families.
Catalog record
| CREATOR | Hongjun Xu, Junxi Xia, Weisi Yang, Yueyuan Sui, Stephen Xia |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 18 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-05488