OJBKQ : O bjective- J oint B abai-Klein Q uantization
Xinyu Wang, Ziyu Zhao, Peng Lu, Xiao-Wen Chang · 2026
Read OJBKQ : O bjective- J oint B abai-Klein Q uantization by Xinyu Wang, Ziyu Zhao, Peng Lu, Xiao-Wen Chang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-08376.txt.
Description
Shrinking a language model after training usually degrades it, especially at very low bit counts. Xinyu Wang and four co-authors introduce OJBKQ, a layer-wise quantization method that treats rounding as a joint optimization over activations and weights. Their arXiv paper frames each layer's problem as a constrained integer least-squares task with many right-hand sides.
That task is hard in general, so the authors adapt two classical nearest-plane methods, Babai and Klein, to find low-residual solutions column by column. Tests on large models show lower perplexity at three and four bits than existing post-training methods, at similar compute cost. Readers get a principled rounding scheme that squeezes models harder without retraining.
Catalog record
| CREATOR | Xinyu Wang, Ziyu Zhao, Peng Lu, Xiao-Wen Chang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-08376