Diagnosing Vision Language Models’ Perception by Leveraging Human Methods for Color Vision Deficiencies

Kazuki Hayashi, Shintaro Ozaki, Yusuke Sakai, Hidetaka Kamigaito, Taro Watanabe · 2025

Read Diagnosing Vision Language Models’ Perception by Leveraging Human Methods for Color Vision Deficiencies by Kazuki Hayashi, Shintaro Ozaki, Yusuke Sakai, Hidetaka Kamigaito, Taro Watanabe (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-17461.txt.

Description

Kazuki Hayashi and four co-authors test vision-language models on color blindness in a 2025 paper. These models are entering navigation, education, and accessibility work, where users see the world differently. The team used the classic dotted-plate test for color vision deficiency as a controlled probe. They checked what models generate, how confident they are, and what their internal features encode.

Models knew facts about the deficiency and could describe the test well. Yet they failed to reproduce what affected people actually see, defaulting to normal color perception instead. The authors warn that current systems cannot represent alternative visual experience, which matters for inclusive deployment.

Catalog record

CREATORKazuki Hayashi, Shintaro Ozaki, Yusuke Sakai, Hidetaka Kamigaito, Taro Watanabe
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-17461

Browse the full library · About the Tower of Babel