Safety Reasoning with Guidelines
Haoyu Wang, Zeyu Qin, Li Shen, Xueqian Wang, Dacheng Tao, Minhao Cheng · 2025
Read Safety Reasoning with Guidelines by Haoyu Wang, Zeyu Qin, Li Shen, Xueqian Wang, Dacheng Tao, Minhao Cheng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04040.txt.
Description
Haoyu Wang and co-authors offer a new way to train chat models to refuse harmful asks in a 2025 paper. The usual refusal training works on known tricks but fails on new jailbreak tricks. Tests that sample many replies show the models hold safety facts yet fail to use them on new asks.
Plain training leans on shallow cues, the team finds, which breaks on new inputs. Their fix trains the model to reason about safety for each ask, guided by written rules from many angles. That deeper step calls up the hidden safety facts, and tests show far better defence against new attacks.
Catalog record
| CREATOR | Haoyu Wang, Zeyu Qin, Li Shen, Xueqian Wang, Dacheng Tao, Minhao Cheng |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-04040