Visual Distraction Undermines Moral Reasoning in Vision-Language Models
Xinyi Yang, Chenheng Xu, Weijun Hong, Ce Mo, Qian Wang, Fang Fang, Yixin Zhu · 2026
Read Visual Distraction Undermines Moral Reasoning in Vision-Language Models by Xinyi Yang, Chenheng Xu, Weijun Hong, Ce Mo, Qian Wang, Fang Fang, Yixin Zhu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-16445.txt.
Description
Yang and co-authors show that images can warp moral judgment in vision-language models. Safety tuning works well in text, but visual inputs may bypass it. Their Moral Dilemma Simulation benchmark varies image and context separately. It rests on Moral Foundation Theory. Tests find that vision triggers fast, intuition-like paths. These override the slower, safer reasoning seen in text-only chats. The results expose a gap in multimodal safety alignment.
Catalog record
| CREATOR | Xinyi Yang, Chenheng Xu, Weijun Hong, Ce Mo, Qian Wang, Fang Fang, Yixin Zhu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 87688 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.16445