KBVQ-MoE: KLT-guided SVD with Bias-Corrected Vector Quantization for MoE Large Language Models
Zukang Xu Zhixiong Zhao Xing Hu Zhixuan Chen Dawei Yang, [2.0em] Houmo AI Nanyang Technological University · 2026
Read KBVQ-MoE: KLT-guided SVD with Bias-Corrected Vector Quantization for MoE Large Language Models by Zukang Xu Zhixiong Zhao Xing Hu Zhixuan Chen Dawei Yang, [2.0em] Houmo AI Nanyang Technological University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-11184.txt.
Description
Mixture-of-experts models are powerful but huge, and naive compression breaks them. Zukang Xu and four co-authors present KBVQ-MoE, a vector rounding frame for ultra-low-bit compression of expert models. It tackles two faults: repeated rounding of similar experts, and bias growth when expert outputs aggregate.
A transform-guided decomposition extracts shared dominant components across experts, while rounding touches only expert-specific parts. Channel-wise affine correction then steadies the quantized outputs. In tests, three-bit rounding of a Qwen expert model nearly matched its full-precision scores. The method aims to make large expert models runnable on edge devices and other tight platforms.
Catalog record
| CREATOR | Zukang Xu Zhixiong Zhao Xing Hu Zhixuan Chen Dawei Yang, [2.0em] Houmo AI Nanyang Technological University |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 64 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-11184