CSR-Bench: A Benchmark for Evaluating the Cross-modal Safety and Reliability of MLLMs

Yuxuan Liu, Yuntian Shi, Kun Wang, Haoting Shen, Kun Yang · 2026

Read CSR-Bench: A Benchmark for Evaluating the Cross-modal Safety and Reliability of MLLMs by Yuxuan Liu, Yuntian Shi, Kun Wang, Haoting Shen, Kun Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03263.txt.

Description

Safety failures that only appear when image and text combine are targeted by Yuxuan Liu, leading a team of 4 others, in a benchmark called CSR-Bench. Multimodal models can be driven by single-modality shortcuts instead of true joint understanding of intent. Each benchmark instance therefore requires integrated image-text interpretation, with paired text-only controls to diagnose shifts caused by adding the image to the prompt.

Four stress patterns span safety, over-rejection, bias, and hallucination across many fine-grained types. Sixteen leading models were evaluated. Systematic gaps appeared, including weak safety awareness, strong language dominance under interference, and consistent degradation from text-only to multimodal inputs. A trade-off also emerged between reducing over-rejection and maintaining safe, non-discriminatory behavior, suggesting some gains come from refusal habits.

Catalog record

CREATORYuxuan Liu, Yuntian Shi, Kun Wang, Haoting Shen, Kun Yang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-03263

Browse the full library · About the Tower of Babel