QRazor: Reliable and Effortless 4-bit LLM Quantization by Significant Data Razoring
Dongyoung Lee, Seungkyu Choi, Ik Joon Chang · 2025
Read QRazor: Reliable and Effortless 4-bit LLM Quantization by Significant Data Razoring by Dongyoung Lee, Seungkyu Choi, Ik Joon Chang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-13331.txt.
Description
Dongyoung Lee, Seungkyu Choi, and Ik Joon Chang present a simple scheme for shrinking language models in a 2025 paper. Cutting models to four-bit numbers saves memory but often wrecks accuracy or needs complex tricks. Their scheme, QRazor, aims for both ease and reliability without any retraining.
First, values are stored at higher precision with scale set by the largest value. Then a razoring step keeps only the four most telling bits. On a mid-size open model, the method beat known rivals by wide margins on zero-shot reasoning tests. A custom chip unit runs the compact data directly. Readers get a low-effort path to lean models.
Catalog record
| CREATOR | Dongyoung Lee, Seungkyu Choi, Ik Joon Chang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-13331