VSCBench: Bridging the Gap in Vision-Language Model Safety Calibration

Jiahui Geng, Qing Li, Zongxiong Chen, Yuxia Wang, Derui Zhu, Zhuohan Xie, Chenyang Lyu, Xiuying Chen, Preslav Nakov, Fakhri Karray · 2025

Read VSCBench: Bridging the Gap in Vision-Language Model Safety Calibration by Jiahui Geng, Qing Li, Zongxiong Chen, Yuxia Wang, Derui Zhu, Zhuohan Xie, Chenyang Lyu, Xiuying Chen, Preslav Nakov, Fakhri Karray (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20362.txt.

Introduction

Jiahui Geng and nine co-authors argue that vision-language models need safety calibration, not just safety. A model can fail two ways: answering a dangerous request, or refusing a harmless one. Most checks punish only the first. Their 2025 paper builds VSCBench, a set of three thousand six hundred image-text pairs. Pairs are matched so that near-twins differ in safety: a small change in image or words flips a request from safe to risky or back.

Twin pairs expose whether a model truly reads the scene or just reacts to surface cues. Scores can then reward balance: bold on safe asks, firm on risky ones. The authors offer the set as a shared test for a more honest kind of safety. It targets a flaw that single-sided benchmarks hide.

Catalog record

CREATORJiahui Geng, Qing Li, Zongxiong Chen, Yuxia Wang, Derui Zhu, Zhuohan Xie, Chenyang Lyu, Xiuying Chen, Preslav Nakov, Fakhri Karray
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-20362

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

VSCBench: Bridging the Gap in Vision-Language Model Safety Calibration Jiahui Geng, Qing Li, Zongxiong Chen, Yuxia Wang, Derui Zhu, Zhuohan Xie, Chenyang Lyu, Xiuying Chen, Preslav Nakov, Fakhri Karray Abstract The rapid advancement of vision-language models (VLMs) has brought a lot of attention to their safety alignment. However, existing methods have primarily focused on model undersafety, where the model responds to hazardous queries, while neglecting oversafety, where the model refuses to answer safe queries. In this paper, we introduce the concept of safety calibration , which systematically addresses both undersafety and oversafety. Specifically, we present VSCBench , a novel dataset of 3,600 image-text pairs that are visually or textually similar but differ in terms of safety, which is designed to evaluate safety calibration across image-centric and text-centric scenarios. Based on our benchmark, we evaluate safety calibration across eleven widely used VLMs. Our extensive experiments revealed major issues with both undersafety and oversafety. We further investigated four approaches to improve the model’s safety calibration. We found that even though some methods effectively calibrated the models’ safety problems, these methods also lead to the degradation of models’ utility. This trade-off underscores the urgent need for advanced calibration methods, and our benchmark provides a valuable tool for evaluating future approaches. Our code and data are available at https://github.com/jiahuigeng/VSCBench.git . Warning : This paper contains examples that are offensive or harmful in nature. 1 Introduction As vision-language models (VLMs) see increasing deployment in real-world applications, ensuring their safety alignment has become a critical priority. In addition to text-based attacks, the visual modules and multimodal alignment introduce additional attack surfaces. Methods such as QueryRelevant Liu et al. (2023) and FigStep Gong et al. (2023) exploit these vulnerabilities by creating visual adversarial inputs to bypass safety mechanisms. In response, various safety alignment methods Zong et al. (2024) ; Zhang et al. (2024a) have been proposed to enhance the safety of VLMs. These methods primarily focus on addressing the model’s undersafety. However, oversafety, where models reject safe queries or flag non-existent risks, e.g., purchasing a toy gun or terminating a Python program , can reduce model helpfulness and degrade user experience Röttger et al. (2024) . In this study, we approach safety alignment through the lens of calibration, which has previously been used to evaluate whether a model is overconfident or underconfident in its responses Guo et al. (2017) ; Geng et al. (2024) . Specifically, we measure calibration by assessing a model’s safety response accuracy on both safe and unsafe queries, denoted as SRA_{s} and SRA_{u} , respectively (see Section 4.2 for detailed definitions). A response is considered accurate if it refuses to answer or highlights risks for unsafe queries, while doing the same for safe queries is deemed an error. Higher values of SRA_{s} and SRA_{u} indicate better performance. A high SRA_{s} and low SRA_{u} suggest undersafety, while the opposite points to oversafety. This provides a systematic way to evaluate whether a model is well-calibrated in terms of safety. Figure 1: Safety calibration evaluation of various VLMs on VSCBench, showing prevalent oversafety and undersafety. The performance of proprietary, open-weight, and safety-aligned models is denoted in red , green , and blue color, respectively. Here, we introduce VSCBench , a benchmark for the comprehensive and fine-grained evaluation of model undersafety and oversafety. Figure 2 demonstrates the human-LLM collaborative framework for VSCBench construction, yielding two subdatasets: image-centric dataset and text-centric dataset . Specifically, the image-centric dataset includes 1,800 image–text pairs with visually similar yet distinct safe and unsafe images across six categories, including violence, discrimination, and others. The text-centric dataset is derived from the existing unimodal dataset XSTest Röttger et al. (2024) , which contains semantically similar safe and unsafe text queries. We transform these queries into a multimodal format using QueryRelevant Liu et al. (2023) and FigStep Gong et al. (2023) , generating 1,800 additional image–text pairs. Figure 2: Overview of the human-LLM collaborative framework for dataset construction. LLMs are prompted to generate candidate descriptions across various themes, to extract relevant information, and to rephrase queries to facilitate the creation of corresponding images. A rigorous human verification process ensures the data quality by preventing issues such as image–text mismatches and unintended visual information leakage. Based on our benchmark, we evaluate the safety calibration across eleven VLMs, including proprietary models such as GPT-4o, Gemini, and Claude, open-weight models such as LLaVA Liu et al. (2024a) , DeepSeekVL Lu et al. (2024) , and InternVL Chen et al. (2024) , as well as safety-aligned models such as VLGuard Zong et al. (2024) and SPAVL Zhang et al. (2024a) . Figure 1 illustrates the safety calibration evaluation of these models. Models farther from the diagonal and closer to the top-left indicate oversafety, while those nearer to the bottom-right suggest undersafety. We further explore various strategies to enhance safety calibration at test time, including chain-of-thought Wei et al. (2022) , few-shot learning Brown et al. (2020) , internal activation revision Li et al. (2025a) , etc. To the best of our knowledge, our work is the first to investigate safety calibration in VLMs, Our contributions are summarized as follows: • We propose a novel task that evaluates and enhances the safety alignment of VLMs from the lens of calibration. We design a human-LLM collaborative framework to build VSCBench, providing fine-grained evaluations from both image-centric and text-centric scenarios. • We conduct a comprehensive evaluation of eleven VLMs and find safety calibration challenges across different models, including proprietary ones. For example, Claude exhibits a tendency toward oversafety, while Gemini is undersafe when handling pornography-related images. Furthermore, a model that is well-calibrated on textual inputs does not necessarily perform well on multimodal inputs. • We perform extensive experiments exploring test-time safety calibration. Both few-shot learning and internal activation revision effectively calibrate models with minimal demonstrations. However, advanced calibration methods are still needed to preserve the helpfulness of VLMs. 2 Related Work 2.1 Attack and Defense Methods for VLMs Safety alignment places significantly higher demands on VLMs. VLMs must accurately interpret image content and reject harmful material, such as violent, bloody, or pornographic imagery Dong et al. (2023) , while also mitigating safety vulnerabilities introduced by the visual module. Several attack methods have been proposed based on the vulnerabilities of VLMs. Zong et al. (2024) showed that fine-tuning a VLM leads to it forgetting its safety alignment in LLMs. Liu et al. (2024b) found that VLMs are more susceptible to unsafe queries when paired with query-relevant images. FigStep Gong et al. (2023) introduced an attack that transforms harmful queries into structured prompts. These prompts are embedded into the images using typography, stimulating the VLM to generate responses. To this end, a range of strategies inspired by large language models (LLMs) alignment have been adopted to improve VLMs safety. VLGuard Zong et al. (2024) fine-tuned LLaVA-v1.5 using nearly 2,000 annotated image-text pairs to enhance its safety without compromising its general multimodal performance. Similarly, SPAVL Zhang et al. (2024b) used extensive multimodal datasets, including up to 90,000 image–text pairs with GPT-4-labeled rankings, leveraging DPO Rafailov et al. (2024) and PPO Schulman et al. (2017) to achieve safety alignment. Gao et al. (2024) proposed Activation Boundary Defense (ABD), which uses Bayesian optimization to dynamically constrain critical mid-

Read the complete text