Don’t Look at the Numbers: Visual Anchoring Bias and Layer-wise Representation in VLMs

M. Shalankin · 2026

Read Don’t Look at the Numbers: Visual Anchoring Bias and Layer-wise Representation in VLMs by M. Shalankin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11218.txt.

Description

M. Shalankin shows that numeric anchors embedded on images skew vision-language model quality judgments in a systematic way. Across six VLMs from five architectural families, anchor effects run two and a half times larger than severe image quality degradation, with large effect sizes, all highly significant.

Layer-wise probing shows a steady split: layers where anchor classification levels off, L12 to L34, predict quality poorly, while the best layers sit deeper and fit strongly. Fusion analysis finds integration that depends on architecture: instant fusion at L1-L2 in two models, against partial or no fusion in three others. VLM evaluators get a causal account linking behavioral susceptibility to representation dynamics.

Catalog record

CREATORM. Shalankin
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38032
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.11218

Browse the full library · About the Tower of Babel