Ω \Omega -QVLA : Robust Quantization for Vision-Language-Action Models via Composite Rotation and Per-step Scaling
Xinyu Wang, Mingze Li, Sicheng Lyu, Dongxiu Liu, Kaicheng Yang, Ziyu Zhao, Yufei Cui, Xiao-Wen Chang, Peng Lu · 2026
Read Ω \Omega -QVLA : Robust Quantization for Vision-Language-Action Models via Composite Rotation and Per-step Scaling by Xinyu Wang, Mingze Li, Sicheng Lyu, Dongxiu Liu, Kaicheng Yang, Ziyu Zhao, Yufei Cui, Xiao-Wen Chang, Peng Lu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28803.txt.
Introduction
Xinyu Wang and eight colleagues present HoloQ-VLA, the first training-free quantization of vision-language-action models to W4A4. Low-bit quantization destabilizes the head, so prior work keeps it at full or mixed precision, while uniform quantization stays open. HoloQ-VLA targets outliers with a weight-adapted rotation, a Hadamard transform, and scaling for drift across denoising steps. On LIBERO it compresses Pi-0.5 and GR00T-N1.5 to W4A4 at 98 and 88 percent success, matching FP16 references of 97 and 87, while cutting memory by 74 percent.
Catalog record
| CREATOR | Xinyu Wang, Mingze Li, Sicheng Lyu, Dongxiu Liu, Kaicheng Yang, Ziyu Zhao, Yufei Cui, Xiao-Wen Chang, Peng Lu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53195 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.28803
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Ω \Omega -QVLA : Robust Quantization for Vision-Language-Action Models via Composite Rotation and Per-step Scaling Xinyu Wang, Mingze Li, Sicheng Lyu, Dongxiu Liu, Kaicheng Yang, Ziyu Zhao, Yufei Cui, Xiao-Wen Chang, Peng Lu Abstract Vision-Language-Action (VLA) models unify perception, reasoning, and control within a single policy, yet their multi-billion-parameter backbones and diffusion-based action heads make on-device deployment prohibitively expensive. Prior quantization efforts offer only partial solutions—compressing the LLM backbone while leaving the DiT action head at full precision, or resorting to mixed-precision schemes—driven by the belief that uniformly quantizing the action head is inherently unstable. We challenge this assumption with Ω \Omega -QVLA , the first training-free post-training quantization framework that compresses both the language backbone and the entire diffusion action head of a VLA model to a uniform W4A4 precision, eliminating the need for mixed-precision allocation. Ω \Omega -QVLA combines (1) a composite SVD ⋅ \cdot Hadamard rotation that equalizes per-channel weight energy while diffusing residual activation outliers, with (2) per-step DiT activation scaling quantization that absorbs dynamic-range drift across denoising steps. On LIBERO, Ω \Omega -QVLA compresses Pi 0.5 and GR00T N1.5 to W4A4 with 98.0% and 87.8% task success rates—matching or exceeding their FP16 references (97.1%, 87.0%)—while reducing the static memory footprint by 71.3% . Real-world manipulation experiments further confirm smooth, accurate manipulation where prior methods fail. Code is available at Ω \Omega -QVLA . 1 1 footnotetext: Equal contribution. Emails: [email protected] , [email protected] , [email protected] . 2 2 footnotetext: Corresponding author. Email: [email protected] . 1 Introduction Vision-Language-Action (VLA) models 7 ; 6 ; 2 unify visual perception, language reasoning, and action generation within a single policy, offering a promising path toward generalist robot control. By inheriting pretrained backbones from large language models (LLMs) 15 and vision-language models (VLMs) 8 , VLA systems can parse natural-language instructions, reason over visual observations, and output executable actions in one forward pass. However, this unification comes at a steep cost: deploying a VLA policy on real robot hardware requires running a multi-billion-parameter language backbone alongside a diffusion-based action head 3 under tight latency and memory budgets. Making these models efficient enough for on-device deployment is therefore an urgent and open problem. Post-training quantization (PTQ) 17 ; 10 has become the standard recipe for compressing LLMs and VLMs without retraining. Yet a striking gap emerges when we survey existing work on VLA efficiency: no prior method quantizes the full DiT action head of a VLA model at a uniform low-bit precision. Across all prior work we examined, the DiT-based action head either remains at full precision or is only selectively quantized—and the authors are explicit about why: they consider it too sensitive to compress. This is no coincidence. Unlike the language backbone, the action head produces continuous control signals that directly interface with physical actuators in a closed-loop setting. Quantization-induced perturbations that would be imperceptible in a language benchmark are amplified by contact forces and physical dynamics. Mainstream PTQ methods—built around outlier management via rotations, permutations, or saliency-based protections—offer no mechanism to account for this cumulative error propagation. We challenge the premise that the DiT action head cannot survive uniform low-bit quantization. Rather than routing around the action head’s sensitivity, we address it directly at its source: channel-level energy imbalance and denoising-step dynamic-range drift. We present \Omega -QVLA , the first training-free PTQ framework to compress both the language backbone and the entire DiT action head of a VLA model to a uniform W4A4 precision—eliminating the need for mixed-precision allocation altogether. Our contributions are threefold: 1. We introduce \Omega -QVLA , a post-training quantization framework combining a composite SVD \cdot Hadamard rotation that equalizes per-channel weight energy and diffuses activation outliers, with per-step DiT activation calibration that absorbs dynamic-range drift across denoising steps. 2. On the LIBERO benchmark 12 , \Omega -QVLA compresses Pi 0.5 and GR00T N1.5 to W4A4 with average task success rates of 98.0% and 87.8% , matching or exceeding their FP16 references (97.1% and 87.0%), while reducing the static memory footprint by 71.3% . 3. We validate \Omega -QVLA through real-world bimanual manipulation experiments, demonstrating smooth and accurate control under uniform W4A4 quantization where prior methods exhibit degraded performance. 2 Related Work 2.1 LLM quantization The core challenge in LLM quantization is activation outliers: a small number of channels carry disproportionately large values that dominate the quantization error. SmoothQuant 17 handles this by rescaling activations against their corresponding weights, pushing the quantization difficulty from activations to weights, which are easier to compress. Rotation-based methods—QuaRot 1 , FlatQuant 14 , DuQuant 10 , OSTQuant 5 —take a different approach: they apply orthogonal transformations to spread outliers evenly across channels before quantization, so no single dimension suffers excessive error. Weight-only schemes like AWQ 11 and GPTQ 4 sidestep activation quantization entirely by compressing only the weights, which works well for memory-bound deployment but leaves compute-bound scenarios unaddressed. 2.2 DiT quantization Unlike standard autoregressive language models, diffusion transformers (DiTs) exhibit highly dynamic activation statistics that fluctuate continuously across the multi-step denoising process. Recognizing this severe limitation, recent research has pivoted toward developing bespoke, DiT-specific compression strategies. For example, SVDQuant ( 9 ) addresses this temporal variance by absorbing prominent activation outliers through the addition of full-precision, low-rank branches. Similarly, ViDiT-Q ( 20 ) introduces a granular, per-group dynamic quantization method that adaptively captures and adjusts to the shifting activation ranges at each specific timestep. The fundamental inadequacy of directly transferring text-based techniques is systematically formalized by the PTQ4DiT benchmark ( 16 ) . Their extensive evaluations definitively show that off-the-shelf LLM quantization recipes degrade both the spatial and temporal consistencies of diffusion models. 2.3 VLA quantization Progress in one component of a VLA system does not automatically transfer to others. For example, improvements in quantization techniques for LLMs do not guarantee similar gains in multimodal or action - generation modules, and methods designed for one modality often fail to ensure efficient or stable behavior when applied to the full VLA pipeline. QuantVLA ( 19 ) , QVLA ( 18 ) , and similar recent efforts address this gap by developing compression strategies explicitly tailored for the unique architectural and operational demands of embodied control. Specifically, QuantVLA introduces a scale-calibrated post-training quantization framework that selectively quantizes both the language backbone and the diffusion transformer (DiT) action head to preserve operator schedules and control fidelity. Taking a complementary approach, QVLA highlights the compounding execution errors caused by naive, uniform-bit LLM quantization, proposing instead an action-centric, channel-wise bit allocation method that explicitly measures and minimizes action-space sensitivity. Collectively, these works demonstrate that effectively compressing VLA systems requires holistic, action-aware optimization rather than the direct transfer of language-centric techniques. Figure 1: The overall quantization pipeline of our \Omega -QVLA , where RTN means round-to-nearest-neighbor. 3 Background 3.1 Vision Language Action (VLA) Model VLA models form a class of embodied systems that jointly process visual observations, interpret textual instructions, and generate action representations executable on physical robotic platforms operating in dynamic environments. Similar to models that map sensory inputs and prompts to action sequences, VLAs integrate vision encoders (e.g., ViTs), language models (e.g., LLMs), and action-generation modules or planners to produce task-conditioned behaviors (e.g., DiTs). Their architectures typically extend multimodal fusion techniques established in vision–language