Preventing Safety Drift in Large Language Models via Coupled Weight and Activation Constraints

Songping Peng, Zhiheng Zhang, Daojian Zeng, Lincheng Jiang, Xieping Gao · 2026

Read Preventing Safety Drift in Large Language Models via Coupled Weight and Activation Constraints by Songping Peng, Zhiheng Zhang, Daojian Zeng, Lincheng Jiang, Xieping Gao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-12384.txt.

Description

Songping Peng and four colleagues defend language model safety during fine-tuning. Even harmless adaptation can erode refusal behavior and admit harmful replies. They show that constraining weights alone or activations alone cannot preserve safety. Their coupled constraints bind weight updates to a safety subspace. Safety-critical features get targeted regularization as well. Across four models and varied tasks, harmful scores came out lowest. Fine-tuning accuracy suffered little.

Catalog record

CREATORSongping Peng, Zhiheng Zhang, Daojian Zeng, Lincheng Jiang, Xieping Gao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60947
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.12384

Browse the full library · About the Tower of Babel