Safety Alignment as Continual Learning: Mitigating the Alignment Tax via Orthogonal Gradient Projection

Guanglong Sun, Siyuan Zhang, Liyuan Wang, Jun Zhu, Hang Su, Yi Zhong · 2026

Read Safety Alignment as Continual Learning: Mitigating the Alignment Tax via Orthogonal Gradient Projection by Guanglong Sun, Siyuan Zhang, Liyuan Wang, Jun Zhu, Hang Su, Yi Zhong (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-07892.txt.

Description

Safety training can make language models safer while dulling their general abilities, a cost known as the alignment tax. Guanglong Sun and five co-authors view the problem through continual learning: successive alignment stages shift data and objectives, and their gradients can interfere with directions supporting earlier capabilities.

Their method, orthogonal gradient projection for safety alignment, estimates a low-rank subspace from gradients on general-capability data and strips that component from each safety gradient. The update is then the steepest safety-improving step that preserves general skills to first order. The lightweight rule offers alignment teams a principled way to pay less capability tax for the same safety gain.

Catalog record

CREATORGuanglong Sun, Siyuan Zhang, Liyuan Wang, Jun Zhu, Hang Su, Yi Zhong
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-07892

Browse the full library · About the Tower of Babel