FuSaR: A Fuzzification-Based Method for LRM Safety-Reasoning Balance
Jianhao Chen, Mayi Xu, Xiaohu Li, Yongqi Li, Xiangyu Zhang, Jianjie Huang, Tieyun Qian · 2025
Read FuSaR: A Fuzzification-Based Method for LRM Safety-Reasoning Balance by Jianhao Chen, Mayi Xu, Xiaohu Li, Yongqi Li, Xiangyu Zhang, Jianjie Huang, Tieyun Qian (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-12897.txt.
Description
Abstract Large Reasoning Models (LRMs) have demonstrated impressive performance across various tasks due to their powerful reasoning capabilities. However, their safety performance remains a significant concern. In this paper, we explore the reasons behind the vulnerability of LRMs. Based on this, we propose a novel method to improve the safety of LLMs without sacrificing their reasoning capability.
Catalog record
| CREATOR | Jianhao Chen, Mayi Xu, Xiaohu Li, Yongqi Li, Xiangyu Zhang, Jianjie Huang, Tieyun Qian |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-12897
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
FuSaR: A Fuzzification-Based Method for LRM Safety-Reasoning Balance Jianhao Chen, Mayi Xu, Xiaohu Li, Yongqi Li, Xiangyu Zhang, Jianjie Huang, Tieyun Qian Abstract Large Reasoning Models (LRMs) have demonstrated impressive performance across various tasks due to their powerful reasoning capabilities. However, their safety performance remains a significant concern. In this paper, we explore the reasons behind the vulnerability of LRMs. Based on this, we propose a novel method to improve the safety of LLMs without sacrificing their reasoning capability. Specifically, we exploit the competition between LRM’s reasoning ability and safety ability, and achieve jailbreak by improving LRM’s reasoning performance to reduce its safety performance. We then introduce an alignment strategy based on Fu zzification to balance Sa fety -R easoning ( FuSaR ), by detoxifying the harmful reasoning process, where both the dangerous entities and the dangerous procedures in the reasoning steps are hidden. FuSaR successfully mitigates safety risks while preserving core reasoning information. We validate this strategy through alignment experiments on several open-source LRMs using detoxified reasoning data. The results compared with existing baselines conclusively show that FuSaR is an efficient alignment strategy to simultaneously enhance both the reasoning capability and safety of LRMs. Warning: This paper contains some harmful text examples. 1 Wuhan University, 2 Nankai University, 3 Sun Yat-sen University 1 Introduction The emergence of large language models (LLMs) has revolutionized many fields such as natural language processing and even complex problem solving Yao et al. 2024 . On this basis, the recently emerged large reasoning models (LRMs) are more focused on processing tasks that require deep and structured reasoning Xu et al. 2025 ; Deng et al. 2025 . LRMs, represented by the OpenAI-o1 Jaech et al. 2024 and DeepSeek-R1 series Zhang et al. 2025 , have demonstrated their outstanding ability to generate long chains of reasoning to solve complex problems, making them increasingly important in applications such as code assistance and scientific discovery Chen et al. 2024 ; Lightman et al. 2023 . Unlike LLMs, which directly respond to user queries, LRMs’ output consists of two parts: reasoning and response Li et al. 2025 . LRMs generate structured chains of thought Wei et al. 2022 by adopting a <think>…</think> reasoning part format before producing the final response. This allows them to follow a structured thought process and generate long reasoning traces with multiple intermediate steps when answering complex questions, even in the absence of advanced prompting strategies Qu et al. 2025 . Figure 1: Overview of the Jailbreak Method of LRMs. While structured reasoning processes improve LRMs’ capability, they also bring more safety risks Arrieta et al. 2025 . When facing malicious questions, LRMs’ reasoning phase can easily produce unsafe behaviors, even though the final response part is safe Zhou et al. 2025 . In addition, due to the powerful reasoning ability of LRMs, their dangerous reasoning chain often contains more details for guidance, which makes the safety risk of LRMs much higher than that of LLMs Jiang et al. 2025 . Previous studies on LLMs’ jailbreak Zou et al. 2023a ; Shen et al. 2024 ; Mehrotra et al. 2024 attribute the reasons for LLMs’ jailbreak to the target competition and generalization mismatch Wei et al. 2023a , where the target competition refers to the competition between the LLMs’ instruction-following target and the safety target. In light of this, we assume that the LRMs’ jailbreak can also be attributed to the specific target competition. We delve into the generation process of LRMs and speculate that there is a reasoning target that causes LRMs to compromise safety for competition, as shown in Figure 1 (a). To verify this conjecture, we collect 40 instructions and rewrite them to get more concrete entities. The reasoning outputs of LRMs for these two types of questions are shown in Figure 1 (b). As can be seen from Figure 1 (b), the length of the reasoning chain of the rewritten questions, the number of conjunctions, and the number of entities all increase. This shows that more concrete questions will give the model’s preference to the reasoning target. Based on this, we further design a jailbreak attack method which rewrites the malicious question to be more concrete. By doing this, the reasoning target when LRMs respond is strengthened, and thus LRMs prioritize reasoning goals rather than safety requirements and finally output unsafe content, as shown in Figure 1 (c). Through the above analysis, we can confirm that the reasoning process of LRMs will bring additional safety risks. The typical way to enhance safety is to fine-tune LRMs using safety alignment data. However, previous studies Huang et al. 2025 ; Wang et al. 2025b have revealed that simple secure alignment data will cause great damage to the model’s reasoning ability. Then, the next question worth studying is: how to enhance safety without reducing the reasoning ability of LRMs? To solve this problem, we design a detoxification strategy FuSaR for harmful reasoning to obtain high-quality alignment data. FuSaR is inspired by the anonymization approach in data desensitization Murthy et al. 2019 , which achieves privacy protection through suppression, generalization, swapping, masking, and distortion. We also obfuscate harmful inferences, but instead of hiding structured fields such as names or addresses, we abstract the dangerous details of the reasoning process reduce the danger of the reasoning process while retaining the reasoning information, which helps to preserve the model’s reasoning ability after fine-tuning. In summary, our contributions are as follows: • To the best of our knowledge, we are the first to investigate how to balance reasoning and safety performance in LRMs. • We propose a jailbreak method based on the competition between reasoning and safety in LRMs, and introduce FuSaR, a fuzzification-based detoxification strategy that enhances safety while preserving reasoning ability. • Experimental results on several commonly used open source LRMs show that our approach performs well in balancing reasoning ability and safety, which improves the safety of LRMs without harming their reasoning abilities. 2 Related Work In this section, we will briefly introduce the progress of LRM’s risk and defense methods. 2.1 Safety Risk of LRMs Many studies have pointed out that the safety performance of LRMs is still seriously insufficient Wang et al. 2025a . In the attack test of DeepSeek-R1 using the HarmBench dataset, the authors claim that the attack success rate(ASR) is as high as 100% Kassianik and Karbasi 2025 . In the prompt injection attack test Zhou et al. 2025 , the attack success rate of the reasoning model under direct attack is almost twice that of other models, and the experimental results show that the thinking process of the reasoning model is less safe than the final answer. In subsequent studies Jiang et al. 2025 , the researchers evaluate 12 LRMs, and the results on the StrongReject and WildJailbreak datasets clearly show the current safety risks of LRMs. 2.2 Safety Alignment of LRMs To ensure that LLM can serve society safely and reliably and in accordance with human values, safety alignment has become a crucial research area Dong et al. 2024 . Its core goal is to make the behavior of LLM consistent with human intentions and expectations and to avoid generating harmful, false, or biased content Uuk et