Reasoning Structure Matters for Safety Alignment of Reasoning Models

Yeonjun In, Wonjoong Kim, Sangwu Park, Chanyoung Park · 2026

Read Reasoning Structure Matters for Safety Alignment of Reasoning Models by Yeonjun In, Wonjoong Kim, Sangwu Park, Chanyoung Park (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-18946.txt.

Description

In and three colleagues argue that safety lapses in large reasoning models stem from the reasoning structure itself. They propose AltTrain, a post training method that reshapes that structure. AltTrain needs no reinforcement learning or reward design, only supervised fine tuning on 1,000 light examples. Tests across model backbones and sizes show strong safety alignment with robust generalization across reasoning, question answering, summarization, and multilingual tasks.

Catalog record

CREATORYeonjun In, Wonjoong Kim, Sangwu Park, Chanyoung Park
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59294
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.18946

Browse the full library · About the Tower of Babel