Widening the Gap: Exploiting LLM Quantization via Outlier Injection

Xiaohua Zhan, Kazuki Egashira, Robin Staab, Mark Vero, Martin Vechev · 2026

Read Widening the Gap: Exploiting LLM Quantization via Outlier Injection by Xiaohua Zhan, Kazuki Egashira, Robin Staab, Mark Vero, Martin Vechev (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-15152.txt.

Description

Xiaohua Zhan and four colleagues demonstrate the first quantization-conditioned attack that survives advanced LLM quantization schemes. Earlier attacks failed against popular methods like AWQ, GPTQ, and GGUF I-quants. The new attack injects large outliers into specific weight blocks, exploiting the shared property that outliers can force neighboring weights to round to zero. A model that looks benign in full precision can therefore turn malicious once users quantize it, across a broad range of schemes and behaviors.

Catalog record

CREATORXiaohua Zhan, Kazuki Egashira, Robin Staab, Mark Vero, Martin Vechev
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65446
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.15152

Browse the full library · About the Tower of Babel