Guardrails in Logit Space: Safety Token Regularization for LLM Alignment Preservation

Thong Bach, Truyen Tran · 2026

Read Guardrails in Logit Space: Safety Token Regularization for LLM Alignment Preservation by Thong Bach, Truyen Tran (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17210.txt.

Description

Bach and Tran introduce safety token regularization, a lightweight method for preserving safety alignment when fine-tuning aligned models on new domains. The approach picks salient tokens from rejection templates of aligned models and constrains their logits during training, blocking the loss of critical safety behaviors. Unlike reinforcement learning or preference optimization, it needs little extra compute and works with efficient methods such as LoRA. Experiments show safety on par with top methods while preserving task utility, plus gains in training stability and overall performance.

Catalog record

CREATORThong Bach, Truyen Tran
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE29325
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.17210

Browse the full library · About the Tower of Babel