CSR-Bench: A Benchmark for Evaluating the Cross-modal Safety and Reliability of MLLMs
Yuxuan Liu, Yuntian Shi, Kun Wang, Haoting Shen, Kun Yang · 2026
Read CSR-Bench: A Benchmark for Evaluating the Cross-modal Safety and Reliability of MLLMs by Yuxuan Liu, Yuntian Shi, Kun Wang, Haoting Shen, Kun Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03263.txt.
Description
Safety failures that only appear when image and text combine are targeted by Yuxuan Liu, leading a team of 4 others, in a benchmark called CSR-Bench. Multimodal models can be driven by single-modality shortcuts instead of true joint understanding of intent. Each benchmark instance therefore requires integrated image-text interpretation, with paired text-only controls to diagnose shifts caused by adding the image to the prompt.
Four stress patterns span safety, over-rejection, bias, and hallucination across many fine-grained types. Sixteen leading models were evaluated. Systematic gaps appeared, including weak safety awareness, strong language dominance under interference, and consistent degradation from text-only to multimodal inputs. A trade-off also emerged between reducing over-rejection and maintaining safe, non-discriminatory behavior, suggesting some gains come from refusal habits.
Catalog record
| CREATOR | Yuxuan Liu, Yuntian Shi, Kun Wang, Haoting Shen, Kun Yang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 78 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-03263