OuroMamba: A Data-Free Quantization Framework for Vision Mamba Models
Akshat Ramachandran † {\dagger}, Mingyu Lee † {\dagger}, Huan Xu, Souvik Kundu, Tushar Krishna · 2025
Read OuroMamba: A Data-Free Quantization Framework for Vision Mamba Models by Akshat Ramachandran † {\dagger}, Mingyu Lee † {\dagger}, Huan Xu, Souvik Kundu, Tushar Krishna (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-10959.txt.
Introduction
Vision Mamba models can be quantized with no real data, Akshat Ramachandran and co-authors show in a 2025 paper. Their framework is called OuroMamba. Quantization shrinks models for use on small devices. Data-free methods face two hurdles here. Recurrent state steps weaken long-range capture and yield poor synthetic data. Activations also show outliers that shift over time.
OuroMamba works in two stages. A generator makes rich synthetic data. It applies contrastive learning to patch-level features. Those features come from neighborhood interactions in the latent state space. A quantizer then applies mixed precision. It also uses light dynamic outlier detection at inference time. Channels with outliers are chosen by a threshold that updates each time step. Tests across vision and generative tasks beat prior data-free methods.
Catalog record
| CREATOR | Akshat Ramachandran † {\dagger}, Mingyu Lee † {\dagger}, Huan Xu, Souvik Kundu, Tushar Krishna |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-10959
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
OuroMamba: A Data-Free Quantization Framework for Vision Mamba Models Akshat Ramachandran † {\dagger}, Mingyu Lee † {\dagger}, Huan Xu, Souvik Kundu, Tushar Krishna Abstract We present OuroMamba , the first data-free post-training quantization (DFQ) method for vision Mamba-based models (VMMs). We identify two key challenges in enabling DFQ for VMMs, (1) VMM’s recurrent state transitions restricts capturing of long-range interactions and leads to semantically weak synthetic data, (2) VMM activations exhibit dynamic outlier variations across time-steps, rendering existing static PTQ techniques ineffective. To address these challenges, OuroMamba presents a two-stage framework: (1) OuroMamba- Gen to generate semantically rich and meaningful synthetic data. It applies contrastive learning on patch level VMM features generated through neighborhood interactions in the latent state space, (2) OuroMamba- Quant to employ mixed-precision quantization with lightweight dynamic outlier detection during inference. In specific, we present a thresholding based outlier channel selection strategy for activations that gets updated every time-step. Extensive experiments across vision and generative tasks show that our data-free OuroMamba surpasses existing data-driven PTQ techniques, achieving state-of-the-art performance across diverse quantization settings. Additionally, we implement efficient GPU kernels to achieve practical latency speedup of up to 2.36 × \mathbf{2.36}\times . Code will be released soon. Figure 1: Qualitative comparison of VMM implicit attention. (a) Sample input image. (b) Normalized distribution of the input gate values ( \Delta ). Visualization of implicit attention Ali et al. 2024 using (c) the original state ( h ) and (d) the proposed patched state ( h_{p} ), which incorporates spatial dependencies through patched neighborhood interactions. 1 Introduction The sub-quadratic compute alternative of the vision State space models (SSMs) Gu & Dao 2023 , particularly vision mamba models (VMMs) Zhu et al. 2024 has made them a promising alternative to ViTs Dosovitskiy et al. 2020 . Like ViTs, larger VMM variants face deployment challenges due to high memory and latency constraints Li et al. 2025b . Quantization Ramachandran et al. 2024a ; Ramachandran et al. 2024b ; Ramachandran et al. 2024c is a popular method to tackle the high memory and latency demand by mapping full-precision (FP) weights and/or activations to lower-bit representations. In particular, post-training quantization (PTQ) Ramachandran et al. 2024a ; Kundu et al. 2022 converts a pre-trained FP model to low-precision and requires calibration on a small dataset Ramachandran et al. 2024a to recover model performance. However, PTQ’s calibration data is typically drawn from the original training dataset, potentially restricting its applicability in situations demanding privacy, security of training set Kundu et al. 2021 ; Zhang et al. 2023 . Consequently, data-free quantization (DFQ), a subset of post-training quantization (PTQ) has emerged as a promising alternative. DFQ allows calibration via generating synthetic data from Gaussian noise Ramachandran et al. 2024a ; Kim et al. 2025 ; Li et al. 2023b ; Li et al. 2022 mimicking the distribution of the original train-set. In particular, DFQ for ViTs primarily rely on the distinctive response of self-attention to noise and real data to generate synthetic data Li et al. 2023b ; Ramachandran et al. 2024a . However, despite their significant progress for ViTs, DFQ techniques for VMM remains largely unexplored . Interestingly, VMM’s recurrent state transition in the S6 layer Gu & Dao 2023 lacks an explicit self-attention mechanism, limiting the usage of any attention based patch similarity improvement. While the S6 layer can be formulated as a variant of linear attention Han et al. 2025 , our observations reveal that this implicit attention struggles to distinguish foreground from the background of an image. As observed in Figure 1 (c), Figure 4 (a), despite VMM’s “theoretical ability” for global interactions Azizi et al. 2025 , it fails to capture long-range dependencies in feature representation. Notably, VMM’s recurrent state transitions introduce dynamic variations in activation characteristics Li et al. 2025b . These variations occur across time steps and tokens 1 1 1 We use token and patch interchangeably based on context. , potentially demanding online adaptive outlier selection. This is in sharp contrast to ViTs, which largely demonstrate a static outlier activation pattern Dong et al. 2023 . A contemporary work, QMamba Li et al. 2025b , rightly identified the dynamic variations in SSM activations. However, it employs statically determined temporal grouped quantization, unable to adapt to the potential changes in outlier locations, yielding large quantization error at low bit precision. Moreover, QMamba lacks a data-free calibration strategy and limited practical speedup, limiting its use in privacy and latency-sensitive scenarios. Our Contributions. To address the above challenges in data generation and quantization stages, we present OuroMamba 2 2 2 Inspired by Ouroboros —the self-consuming snake— the name OuroMamba reflects its ability to self-generate data for VMM quantization. , a first-of-its-kind method to enable DFQ for VMMs. For data generation, we investigate on VMM’s implicit attention struggles to differentiate foreground with background. In specific, we hypothesize it to be dependent on scanning direction of the compressed hidden state ( h(t) ), which limits explicit spatial token interactions. To mitigate this, we propose OuroMamba - Gen , that essentially enhances the implicit attention through patched spatial interactions in the latent state space, resulting in a refined hidden state namely, patched state h_{p}(t) . We then leverage an enhanced implicit attention representation based on h_{p}(t) ( Figure 1 (d)) to generate synthetic data by employing patch-level contrastive learning Ramachandran et al. 2024a . For quantization, we first empirically validate that VMM operation leads to dynamic inter-time-step variations of the outlier channel positions. We then present OuroMamba - Quant , a mixed-precision quantization scheme that performs channel-wise static weight quantization and dynamic activation quantization per-time-step during inference. OuroMamba- Quant reduces the quantization error associated to dynamic outliers via three key strategies, (1) a lightweight channel-wise activation outlier detection, (2) mixed-precision quantization, where outlier channels are quantized at higher precision, while remaining inlier channels use lower bit quantization and (3) efficient outlier management using an adaptive outlier list. To validate the efficacy of OuroMamba, we conduct extensive experimental evaluations on VMMs Zhu et al. 2024 ; Liu et al. 2025 ; Huang et al. 2024 and hybrid Transformer-Mamba models Hatamizadeh & Kautz 2025 for classification, detection, segmentation, and generative modeling tasks Hu et al. 2024 . OuroMamba achieves SoTA performance over existing data-driven VMM PTQ alternatives, with an accuracy improvement of up to 39%. Additionally, through efficient kernel implementation we demonstrate practical end-to-end latency speedup of up to 2.36 \times over FP16 baseline . 2 Related Works Data-Driven PTQ. Existing PTQ techniques for ViTs Lin et al. 2021 ; Jiang et al. 2025 ; Li et al. 2023c ; Yang et al. 2024 ; Ma et al. 2024 ; Yuan et al. 2022 address long-tailed distributions and static activation outliers but fail to handle VMMs’ dynamically changing outliers Cho et al. 2025 ; Li et al. 2025b . While PTQ4VM Cho et al. 2025 adapts SmoothQuant Xiao et al. 2023 to shift activation outliers into weights, it does not quantize SSM activations, limiting its effectiveness. QMamba Li et al. 2025b employs temporal grouped quantization but relies on static groupings, making it unsuitable for ultra-low bit-widths. OuroMamba is the first to identify dynamic outlier variations in VMMs and introduce a mixed-precision quantization framework that achieves SoTA accuracy