Latent-space adversarial training with post-aware calibration for defending large language models against jailbreak attacks

Xin Yi, Yue Li, Dongsheng Shi, Linlin Wang, Xiaoling Wang, Liang He · 2025

Read Latent-space adversarial training with post-aware calibration for defending large language models against jailbreak attacks by Xin Yi, Yue Li, Dongsheng Shi, Linlin Wang, Xiaoling Wang, Liang He (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-10639.txt.

Description

Xin Yi and co-authors harden language models against jailbreak tricks in a 2025 paper. Attackers disguise harmful asks to slip past a model's safety training. Tough training can overshoot, making models refuse harmless asks too often. Their method trains inside the model's own hidden space instead of working on text.

Contrasting harmful and harmless inputs locates the safety steering dimensions. Fake attacks then remove refusal features along exactly those axes. A light calibration at reply time trims the over refusal habit. Five disguise attack styles were beaten with utility largely intact.

Catalog record

CREATORXin Yi, Yue Li, Dongsheng Shi, Linlin Wang, Xiaoling Wang, Liang He
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE66 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-10639

Browse the full library · About the Tower of Babel