Widening the Gap: Exploiting LLM Quantization via Outlier Injection
Xiaohua Zhan, Kazuki Egashira, Robin Staab, Mark Vero, Martin Vechev · 2026
Read Widening the Gap: Exploiting LLM Quantization via Outlier Injection by Xiaohua Zhan, Kazuki Egashira, Robin Staab, Mark Vero, Martin Vechev (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-15152.txt.
Description
Xiaohua Zhan and four colleagues demonstrate the first quantization-conditioned attack that survives advanced LLM quantization schemes. Earlier attacks failed against popular methods like AWQ, GPTQ, and GGUF I-quants. The new attack injects large outliers into specific weight blocks, exploiting the shared property that outliers can force neighboring weights to round to zero. A model that looks benign in full precision can therefore turn malicious once users quantize it, across a broad range of schemes and behaviors.
Catalog record
| CREATOR | Xiaohua Zhan, Kazuki Egashira, Robin Staab, Mark Vero, Martin Vechev |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 65446 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.15152