Uncertainty Drives Social Bias Changes in Quantized Large Language Models

Stanley Z. Hua, Sanae Lotfi, Irene Y. Chen, [1ex] UC Berkeley & UCSF · 2026

Read Uncertainty Drives Social Bias Changes in Quantized Large Language Models by Stanley Z. Hua, Sanae Lotfi, Irene Y. Chen, [1ex] UC Berkeley & UCSF (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-06181.txt.

Description

Shrinking a language model by rounding its numbers, called quantization, saves memory but can quietly shift its social biases. Stanley Z Hua and 2 co-authors ran the first large study of this effect, testing dozens of quantized models on a bench of bias data sets. Average bias scores barely moved, which looked reassuring.

Underneath, individual answers flipped between biased and unbiased surprisingly often. Flips clustered where the model was unsure of its answer. Stronger compression caused several times more flipping than gentler compression. Some demographic groups saw bias worsen while others saw it improve, canceling out in the averages. Bigger models were not reliably safer, so the authors urge checks after every compression.

Catalog record

CREATORStanley Z. Hua, Sanae Lotfi, Irene Y. Chen, [1ex] UC Berkeley & UCSF
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE81 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-06181

Browse the full library · About the Tower of Babel