Uncertainty Drives Social Bias Changes in Quantized Large Language Models
Stanley Z. Hua, Sanae Lotfi, Irene Y. Chen, [1ex] UC Berkeley & UCSF · 2026
Read Uncertainty Drives Social Bias Changes in Quantized Large Language Models by Stanley Z. Hua, Sanae Lotfi, Irene Y. Chen, [1ex] UC Berkeley & UCSF (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-06181.txt.
Description
Shrinking a language model by rounding its numbers, called quantization, saves memory but can quietly shift its social biases. Stanley Z Hua and 2 co-authors ran the first large study of this effect, testing dozens of quantized models on a bench of bias data sets. Average bias scores barely moved, which looked reassuring.
Underneath, individual answers flipped between biased and unbiased surprisingly often. Flips clustered where the model was unsure of its answer. Stronger compression caused several times more flipping than gentler compression. Some demographic groups saw bias worsen while others saw it improve, canceling out in the averages. Bigger models were not reliably safer, so the authors urge checks after every compression.
Catalog record
| CREATOR | Stanley Z. Hua, Sanae Lotfi, Irene Y. Chen, [1ex] UC Berkeley & UCSF |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 81 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-06181