Safety Anchor: Defending Harmful Fine-tuning via Geometric Bottlenecks

Guoxin Lu, Letian Sha 🖂, Qing Wang, Peijie Sun, Hao Zhou, Hua Dai, Fu Xiao · 2026

Read Safety Anchor: Defending Harmful Fine-tuning via Geometric Bottlenecks by Guoxin Lu, Letian Sha 🖂, Qing Wang, Peijie Sun, Hao Zhou, Hua Dai, Fu Xiao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-05995.txt.

Description

Guoxin Lu and six co-authors defend language models against harmful fine tuning, which can strip away safety training. Past defenses limit parameters, gradients, or internal states, yet persistent attacks work around them. The authors trace that failure to spare room in the huge parameter space, where attack paths dodge the set limits.

Their method, Safety Bottleneck Regularization, shifts the defense to the unembedding layer, a natural geometric bottleneck. It anchors the final hidden states for harmful queries to those of the safety aligned model. Tests show that even a single safety anchor cut the harmful score below 10. Performance on benign downstream tasks stayed competitive at the same time.

Catalog record

CREATORGuoxin Lu, Letian Sha 🖂, Qing Wang, Peijie Sun, Hao Zhou, Hua Dai, Fu Xiao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.05995

Browse the full library · About the Tower of Babel