Guardrails in Logit Space: Safety Token Regularization for LLM Alignment Preservation
Thong Bach, Truyen Tran · 2026
Read Guardrails in Logit Space: Safety Token Regularization for LLM Alignment Preservation by Thong Bach, Truyen Tran (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17210.txt.
Description
Bach and Tran introduce safety token regularization, a lightweight method for preserving safety alignment when fine-tuning aligned models on new domains. The approach picks salient tokens from rejection templates of aligned models and constrains their logits during training, blocking the loss of critical safety behaviors. Unlike reinforcement learning or preference optimization, it needs little extra compute and works with efficient methods such as LoRA. Experiments show safety on par with top methods while preserving task utility, plus gains in training stability and overall performance.
Catalog record
| CREATOR | Thong Bach, Truyen Tran |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 29325 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.17210