SafeMLRM: Demystifying Safety in Multi-modal Large Reasoning Models
Junfeng Fang, Yukai Wang, Ruipeng Wang, Zijun Yao, Kun Wang, An Zhang, Xiang Wang, Tat-Seng Chua · 2025
Read SafeMLRM: Demystifying Safety in Multi-modal Large Reasoning Models by Junfeng Fang, Yukai Wang, Ruipeng Wang, Zijun Yao, Kun Wang, An Zhang, Xiang Wang, Tat-Seng Chua (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-08813.txt.
Introduction
Models that reason across images and text are spreading fast, and their safety has lagged behind their skill. Junfeng Fang and seven co-authors ran the first systematic safety study of such multimodal reasoning models in 2025, comparing them with the base models they grew from.
Three findings stand out. First, a reasoning tax: gaining reasoning skill badly eroded built-in safety, with jailbreak attacks succeeding about thirty-seven percent more often. Second, blind spots: some scenarios, such as illegal activity, saw attack rates jump far beyond the average. Third, a hopeful sign: in about seventeen percent of bad reasoning chains, the final answer corrected itself back to safety. The authors call for safety audits that vary by scenario.
Catalog record
| CREATOR | Junfeng Fang, Yukai Wang, Ruipeng Wang, Zijun Yao, Kun Wang, An Zhang, Xiang Wang, Tat-Seng Chua |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 27 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-08813
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SafeMLRM: Demystifying Safety in Multi-modal Large Reasoning Models Junfeng Fang, Yukai Wang, Ruipeng Wang, Zijun Yao, Kun Wang, An Zhang, Xiang Wang, Tat-Seng Chua Abstract The rapid advancement of multi-modal large reasoning models (MLRMs) — enhanced versions of multimodal language models (MLLMs) equipped with reasoning capabilities — has revolutionized diverse applications. However, their safety implications remain underexplored. While prior work has exposed critical vulnerabilities in unimodal reasoning models, MLRMs introduce distinct risks from cross-modal reasoning pathways. This work presents the first systematic safety analysis of MLRMs through large-scale empirical studies comparing MLRMs with their base MLLMs. Our experiments reveal three critical findings: (1) The Reasoning Tax: Acquiring reasoning capabilities catastrophically degrades inherited safety alignment. MLRMs exhibit 37.44% higher jailbreaking success rates than base MLLMs under adversarial attacks. (2) Safety Blind Spots: While safety degradation is pervasive, certain scenarios ( e.g., Illegal Activity) suffer 25× higher attack rates — far exceeding the average 3.4× increase, revealing scenario-specific vulnerabilities with alarming cross-model and datasets consistency. (3) Emergent Self-Correction: Despite tight reasoning-answer safety coupling, MLRMs demonstrate nascent self-correction — 16.9% of jailbroken reasoning steps are overridden by safe answers, hinting at intrinsic safeguards. These findings underscore the urgency of scenario-aware safety auditing and mechanisms to amplify MLRMs’ self-correction potential. To catalyze research, we open-source OpenSafeMLRM , the first toolkit for MLRM safety evaluation, providing unified interface for mainstream models, datasets, and jailbreaking methods. Our work calls for immediate efforts to harden reasoning-augmented AI, ensuring its transformative potential aligns with ethical safeguards. OpenSafeMLRM https://github.com/fangjf1/OpenSafeMLRM bsmi 1 Introduction With the rapid advancement of AI, large reasoning models (LRMs) like the DeepSeek series have gained significant attention [ 1 , 2 , 3 , 4 ] . These models excel in performing complex tasks through meticulous reasoning, enabling transformative impacts across various downstream domains [ 5 , 6 ] . Recently, this influence has expanded to multi-modal applications [ 7 , 8 , 9 ] . By embedding chain-of-thought data during the fine-tuning or reinforcement learning phrase of base multi-modal large language models (MLLMs) [ 10 , 11 , 12 ] , researchers have developed Multi-modal Large Reasoning Models (MLRMs) [ 13 , 14 , 15 , 16 ] . Compared to prompt-based multi-modal reasoning ( e.g., instructing base model with “Please think step-by-step”) [ 17 , 18 , 19 , 20 ] , MLRMs inherently encode reasoning process, demonstrating greater potential in alignment with human intentions; in contrast to asynchronous multi-modal reasoning paradigm ( e.g., using one model to describe an image for an LRM to reason) [ 21 , 22 , 23 , 24 ] , MLRMs are end-to-end models rather than cascaded pipelines, avoiding compounding errors and modality-specific information loss. These advantages position MLRM as a cornerstone for future advancements in AI reasoning [ 25 ] . However, alongside these reasoning advancements, model safety concerns have become increasingly critical [ 26 , 27 , 28 ] , particularly the risks of unsafe content generation [ 29 , 30 ] . Recent community efforts have evaluated the safety capabilities of mainstream LRMs like DeepSeek, especially their resilience to jailbreaking attacks [ 31 , 32 , 33 ] . These studies reveal urgent findings, demonstrating that exposure of reasoning processes amplifies safety risks, with attack success rates rise dramatically [ 34 , 35 ] . While these findings motivate deeper investigations into LRM safety, the safety protocol of MLRMs remains underexplored. This gap demands imperative attention: multi-modal integration introduces novel attack vectors like cross-modal adversarial triggers, fundamentally expanding the threat surface beyond traditional text-only vulnerabilities [ 36 , 37 ] . This study conducts the first systematic safety evaluation of advancing MLRMs. To catalyze this, we open-source OpenSafeMLRM , the first toolkit for MLRM safety evaluation, providing unified interface for various models, datasets, and jailbreaking methods. With OpenSafeMLRM , we evaluate mainstream MLRMs such as R1-Onevision [ 38 ] , MM-Eureka-Qwen [ 14 ] , Mulberry-Qwen2VL [ 39 ] , Mulberry-Llava [ 39 ] and Mulberry-Llama [ 39 ] across 10 canonical unsafe scenarios curated from MM-SafetyBench [ 37 ] , and further adapt black-box jailbreaking methods traditionally used for MLLMs [ 36 ] for probing MLRMs’ safety resilience. All evaluations are applied to both target MLRMs and their base MLLMs. This comparative framework allows us to quantify how reasoning capability acquisition impacts the safety protocols. Empirical results reveal several noval findings: (1) Reasoning Tax: The pursuit of advanced reasoning capabilities via supervised fine-tuning (SFT)/reinforcement learning (RL) imposes a steep safety cost — MLRMs exhibit 37.44% higher attack success rates than their base MLLMs, with safety alignment catastrophically eroded during capability enhancement. (2) Safety Blind Spots: While safety degradation is pervasive, certain scenarios ( e.g., Illegal Activity) suffer 25× higher attack rates — far exceeding the average 3.4× increase, revealing scenario-specific vulnerabilities with alarming cross-model and datasets consistency. (3) Emergent Self-Correction: Despite tight reasoning-answer safety coupling, MLRMs demonstrate nascent self-correction: 16.23% of jailbroken reasoning steps are overridden by safe answers, hinting at intrinsic safeguards. While our evaluation framework conduct comprehensive experiments, we acknowledge that selection bias in test samples and evaluation criteria design may inevitably introduce measurement distortions. To mitigate this, we will refine this evaluation framework by incorporating additional datasets, models, attack vectors, and defense baselines [ 36 ] to enhance its comprehensiveness and reliability. These findings reveal fundamental gaps in MLRMs’ current safety mechanisms and expose the alarming efficacy of adversarial strategies in bypassing their safeguards. In summary, our work calls for immediate efforts to harden reasoning-augmented AI, ensuring its transformative potential aligns with ethical safeguards. 2 Experimental Setup This work aims to systematically investigate the safety of MLRMs and their safety degradation compared to base MLLMs. Here, we formalize the research aim of this paper and provided specific experimental configurations, including datasets, baseline models and evaluation metrics. Research Aim Our aim is to explore the safety vulnerabilities in MLRMs . Through comprehensive analysis across various unsafe scenarios, we highlight key risks and compare the safety performance of MLRMs against their base MLLMs, providing valuable insights for enhancing their safety. 2.1 Datasets & Jailbreaking Methods. We evaluate our framework on two widely adopted benchmarks for MLLM safety: MM-SafetyBench [ 37 ] and SafetyBench [ 40 ] . • MM-SafetyBench comprises 13 safety-critical scenarios ( e.g., illegal activities, hate speech) that MLLMs should strictly prohibit. Constructed via the QueryRelated pipeline [ 37 ] , this dataset first generates malicious queries across scenarios, then uses GPT-4 [ 41 ] to extract unsafe keywords and synthesize three image types: (1) Stable Diffusion (SD) [ 42 ] images: Visually aligned with unsafe keywords. (2) Text-overlaid images: Unsafe text superimposed on benign visuals. (3) Hybrid images: SD-generated visuals combined with adversarial typography. Following [ 37 ] , we adopt hybrid images (empirically shown to be the most effective jailbreaking method among the three) as the jailbreaking method for evaluation. • SafetyBench covers 10 prohibited topics curated from the OpenAI and Meta’s Llama-2 [ 43 ] usage policies. Built via the FigStep pipeline [ 40 ] , it leverages GPT-4 [ 41 ] to rewrite queries into instructional formats ( e.g., “Steps to manufacture illegal drugs”), enumerates them as numbered lists, and converts these into typographic images. These images