Revisiting Adaptive Rounding with Vectorized Reparameterization for LLM Quantization

Yuli Zhou, Qingxuan Chen, Luca Benini, Guolei Sun, Yawei Li · 2026

Read Revisiting Adaptive Rounding with Vectorized Reparameterization for LLM Quantization by Yuli Zhou, Qingxuan Chen, Luca Benini, Guolei Sun, Yawei Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02151.txt.

Description

Yuli Zhou and colleagues revisit adaptive rounding for post-training quantization with VQRound, compressing the rounding matrix into a compact codebook. Dense elementwise matrices cost too much for billion-parameter models. Low-rank substitutes mishandle heavy-tailed weights. The team therefore minimizes the worst elementwise error under a norm and fits every layer codebook from a small calibration set. Across OPT, LLaMA, and Qwen3 models, VQRound converges better than classic adaptive rounding at equal step counts while training far fewer parameters.

Catalog record

CREATORYuli Zhou, Qingxuan Chen, Luca Benini, Guolei Sun, Yawei Li
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE54812
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.02151

Browse the full library · About the Tower of Babel