Latent-space adversarial training with post-aware calibration for defending large language models against jailbreak attacks
Xin Yi, Yue Li, Dongsheng Shi, Linlin Wang, Xiaoling Wang, Liang He · 2025
Read Latent-space adversarial training with post-aware calibration for defending large language models against jailbreak attacks by Xin Yi, Yue Li, Dongsheng Shi, Linlin Wang, Xiaoling Wang, Liang He (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-10639.txt.
Description
Xin Yi and co-authors harden language models against jailbreak tricks in a 2025 paper. Attackers disguise harmful asks to slip past a model's safety training. Tough training can overshoot, making models refuse harmless asks too often. Their method trains inside the model's own hidden space instead of working on text.
Contrasting harmful and harmless inputs locates the safety steering dimensions. Fake attacks then remove refusal features along exactly those axes. A light calibration at reply time trims the over refusal habit. Five disguise attack styles were beaten with utility largely intact.
Catalog record
| CREATOR | Xin Yi, Yue Li, Dongsheng Shi, Linlin Wang, Xiaoling Wang, Liang He |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-10639