KBVQ-MoE: KLT-guided SVD with Bias-Corrected Vector Quantization for MoE Large Language Models

Zukang Xu Zhixiong Zhao Xing Hu Zhixuan Chen Dawei Yang, [2.0em] Houmo AI Nanyang Technological University · 2026

Read KBVQ-MoE: KLT-guided SVD with Bias-Corrected Vector Quantization for MoE Large Language Models by Zukang Xu Zhixiong Zhao Xing Hu Zhixuan Chen Dawei Yang, [2.0em] Houmo AI Nanyang Technological University (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-11184.txt.

Description

Mixture-of-experts models are powerful but huge, and naive compression breaks them. Zukang Xu and four co-authors present KBVQ-MoE, a vector rounding frame for ultra-low-bit compression of expert models. It tackles two faults: repeated rounding of similar experts, and bias growth when expert outputs aggregate.

A transform-guided decomposition extracts shared dominant components across experts, while rounding touches only expert-specific parts. Channel-wise affine correction then steadies the quantized outputs. In tests, three-bit rounding of a Qwen expert model nearly matched its full-precision scores. The method aims to make large expert models runnable on edge devices and other tight platforms.

Catalog record

CREATORZukang Xu Zhixiong Zhao Xing Hu Zhixuan Chen Dawei Yang, [2.0em] Houmo AI Nanyang Technological University
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-11184

Browse the full library · About the Tower of Babel