Don’t Look at the Numbers: Visual Anchoring Bias and Layer-wise Representation in VLMs
M. Shalankin · 2026
Read Don’t Look at the Numbers: Visual Anchoring Bias and Layer-wise Representation in VLMs by M. Shalankin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-11218.txt.
Description
M. Shalankin shows that numeric anchors embedded on images skew vision-language model quality judgments in a systematic way. Across six VLMs from five architectural families, anchor effects run two and a half times larger than severe image quality degradation, with large effect sizes, all highly significant.
Layer-wise probing shows a steady split: layers where anchor classification levels off, L12 to L34, predict quality poorly, while the best layers sit deeper and fit strongly. Fusion analysis finds integration that depends on architecture: instant fusion at L1-L2 in two models, against partial or no fusion in three others. VLM evaluators get a causal account linking behavioral susceptibility to representation dynamics.
Catalog record
| CREATOR | M. Shalankin |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 38032 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.11218