Mitigating Safety Tax via Distribution-Grounded Refinement in Large Reasoning Models
Yingsha Xie, Tiansheng Huang, Enneng Yang, Rui Min, Wenjie Lu, Xiaochun Cao, Naiqiang Tan, Li Shen · 2026
Read Mitigating Safety Tax via Distribution-Grounded Refinement in Large Reasoning Models by Yingsha Xie, Tiansheng Huang, Enneng Yang, Rui Min, Wenjie Lu, Xiaochun Cao, Naiqiang Tan, Li Shen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02136.txt.
Description
Yingsha Xie and colleagues ask why safety tuning harms the broad thought skills of large thought models. They blame a gap between the safety traces used for tuning and the target model's own inner style, since most such traces come from other models or human labelers. Their method, called DGR, reshapes and refines an existing safety set so it fits the target model's own spread of outputs. Tests show the safety cost falls while safety stays strong, and just ten samples can switch on sound refusal conduct.
Catalog record
| CREATOR | Yingsha Xie, Tiansheng Huang, Enneng Yang, Rui Min, Wenjie Lu, Xiaochun Cao, Naiqiang Tan, Li Shen |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49574 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602.02136