Safety Reasoning with Guidelines

Haoyu Wang, Zeyu Qin, Li Shen, Xueqian Wang, Dacheng Tao, Minhao Cheng · 2025

Read Safety Reasoning with Guidelines by Haoyu Wang, Zeyu Qin, Li Shen, Xueqian Wang, Dacheng Tao, Minhao Cheng (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-04040.txt.

Description

Haoyu Wang and co-authors offer a new way to train chat models to refuse harmful asks in a 2025 paper. The usual refusal training works on known tricks but fails on new jailbreak tricks. Tests that sample many replies show the models hold safety facts yet fail to use them on new asks.

Plain training leans on shallow cues, the team finds, which breaks on new inputs. Their fix trains the model to reason about safety for each ask, guided by written rules from many angles. That deeper step calls up the hidden safety facts, and tests show far better defence against new attacks.

Catalog record

CREATORHaoyu Wang, Zeyu Qin, Li Shen, Xueqian Wang, Dacheng Tao, Minhao Cheng
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-04040

Browse the full library · About the Tower of Babel