Mitigating Safety Tax via Distribution-Grounded Refinement in Large Reasoning Models

Yingsha Xie, Tiansheng Huang, Enneng Yang, Rui Min, Wenjie Lu, Xiaochun Cao, Naiqiang Tan, Li Shen · 2026

Read Mitigating Safety Tax via Distribution-Grounded Refinement in Large Reasoning Models by Yingsha Xie, Tiansheng Huang, Enneng Yang, Rui Min, Wenjie Lu, Xiaochun Cao, Naiqiang Tan, Li Shen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02136.txt.

Description

Yingsha Xie and colleagues ask why safety tuning harms the broad thought skills of large thought models. They blame a gap between the safety traces used for tuning and the target model's own inner style, since most such traces come from other models or human labelers. Their method, called DGR, reshapes and refines an existing safety set so it fits the target model's own spread of outputs. Tests show the safety cost falls while safety stays strong, and just ten samples can switch on sound refusal conduct.

Catalog record

CREATORYingsha Xie, Tiansheng Huang, Enneng Yang, Rui Min, Wenjie Lu, Xiaochun Cao, Naiqiang Tan, Li Shen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49574
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.02136

Browse the full library · About the Tower of Babel