Preventing Safety Drift in Large Language Models via Coupled Weight and Activation Constraints
Songping Peng, Zhiheng Zhang, Daojian Zeng, Lincheng Jiang, Xieping Gao · 2026
Read Preventing Safety Drift in Large Language Models via Coupled Weight and Activation Constraints by Songping Peng, Zhiheng Zhang, Daojian Zeng, Lincheng Jiang, Xieping Gao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-12384.txt.
Description
Songping Peng and four colleagues defend language model safety during fine-tuning. Even harmless adaptation can erode refusal behavior and admit harmful replies. They show that constraining weights alone or activations alone cannot preserve safety. Their coupled constraints bind weight updates to a safety subspace. Safety-critical features get targeted regularization as well. Across four models and varied tasks, harmful scores came out lowest. Fine-tuning accuracy suffered little.
Catalog record
| CREATOR | Songping Peng, Zhiheng Zhang, Daojian Zeng, Lincheng Jiang, Xieping Gao |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60947 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.12384