OJBKQ : O bjective- J oint B abai-Klein Q uantization

Xinyu Wang, Ziyu Zhao, Peng Lu, Xiao-Wen Chang · 2026

Read OJBKQ : O bjective- J oint B abai-Klein Q uantization by Xinyu Wang, Ziyu Zhao, Peng Lu, Xiao-Wen Chang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08376.txt.

Description

Shrinking a language model after training usually degrades it, especially at very low bit counts. Xinyu Wang and four co-authors introduce OJBKQ, a layer-wise quantization method that treats rounding as a joint optimization over activations and weights. Their arXiv paper frames each layer's problem as a constrained integer least-squares task with many right-hand sides.

That task is hard in general, so the authors adapt two classical nearest-plane methods, Babai and Klein, to find low-residual solutions column by column. Tests on large models show lower perplexity at three and four bits than existing post-training methods, at similar compute cost. Readers get a principled rounding scheme that squeezes models harder without retraining.

Catalog record

CREATORXinyu Wang, Ziyu Zhao, Peng Lu, Xiao-Wen Chang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-08376

Browse the full library · About the Tower of Babel