Safety Anchor: Defending Harmful Fine-tuning via Geometric Bottlenecks
Guoxin Lu, Letian Sha 🖂, Qing Wang, Peijie Sun, Hao Zhou, Hua Dai, Fu Xiao · 2026
Read Safety Anchor: Defending Harmful Fine-tuning via Geometric Bottlenecks by Guoxin Lu, Letian Sha 🖂, Qing Wang, Peijie Sun, Hao Zhou, Hua Dai, Fu Xiao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-05995.txt.
Description
Guoxin Lu and six co-authors defend language models against harmful fine tuning, which can strip away safety training. Past defenses limit parameters, gradients, or internal states, yet persistent attacks work around them. The authors trace that failure to spare room in the huge parameter space, where attack paths dodge the set limits.
Their method, Safety Bottleneck Regularization, shifts the defense to the unembedding layer, a natural geometric bottleneck. It anchors the final hidden states for harmful queries to those of the safety aligned model. Tests show that even a single safety anchor cut the harmful score below 10. Performance on benign downstream tasks stayed competitive at the same time.
Catalog record
| CREATOR | Guoxin Lu, Letian Sha 🖂, Qing Wang, Peijie Sun, Hao Zhou, Hua Dai, Fu Xiao |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.05995