Reasoning Structure Matters for Safety Alignment of Reasoning Models
Yeonjun In, Wonjoong Kim, Sangwu Park, Chanyoung Park · 2026
Read Reasoning Structure Matters for Safety Alignment of Reasoning Models by Yeonjun In, Wonjoong Kim, Sangwu Park, Chanyoung Park (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18946.txt.
Description
In and three colleagues argue that safety lapses in large reasoning models stem from the reasoning structure itself. They propose AltTrain, a post training method that reshapes that structure. AltTrain needs no reinforcement learning or reward design, only supervised fine tuning on 1,000 light examples. Tests across model backbones and sizes show strong safety alignment with robust generalization across reasoning, question answering, summarization, and multilingual tasks.
Catalog record
| CREATOR | Yeonjun In, Wonjoong Kim, Sangwu Park, Chanyoung Park |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59294 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.18946