Diagnosing Vision Language Models’ Perception by Leveraging Human Methods for Color Vision Deficiencies
Kazuki Hayashi, Shintaro Ozaki, Yusuke Sakai, Hidetaka Kamigaito, Taro Watanabe · 2025
Read Diagnosing Vision Language Models’ Perception by Leveraging Human Methods for Color Vision Deficiencies by Kazuki Hayashi, Shintaro Ozaki, Yusuke Sakai, Hidetaka Kamigaito, Taro Watanabe (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-17461.txt.
Description
Kazuki Hayashi and four co-authors test vision-language models on color blindness in a 2025 paper. These models are entering navigation, education, and accessibility work, where users see the world differently. The team used the classic dotted-plate test for color vision deficiency as a controlled probe. They checked what models generate, how confident they are, and what their internal features encode.
Models knew facts about the deficiency and could describe the test well. Yet they failed to reproduce what affected people actually see, defaulting to normal color perception instead. The authors warn that current systems cannot represent alternative visual experience, which matters for inclusive deployment.
Catalog record
| CREATOR | Kazuki Hayashi, Shintaro Ozaki, Yusuke Sakai, Hidetaka Kamigaito, Taro Watanabe |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 77 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-17461