Mitigating Adaptive Attacks against Reasoning Models with Activation Consistency Training

Avidan Shah, Jannik Brinkmann, Rico Angell · 2026

Read Mitigating Adaptive Attacks against Reasoning Models with Activation Consistency Training by Avidan Shah, Jannik Brinkmann, Rico Angell (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28467.txt.

Description

Avidan Shah, Jannik Brinkmann, and Rico Angell defend reasoning models against jailbreaks and prompt injection with consistency training. The method forces matching behavior on clean prompts and adversarial rewrites, in output-level and activation-level variants. Activation-level training proves more robust to adaptive attacks and needs only self-supervised clean-and-wrapped prompt pairs. Its defense appears as a near linear shift in activation space, yielding a steering direction that controls refusal with little effect on benign inputs.

Catalog record

CREATORAvidan Shah, Jannik Brinkmann, Rico Angell
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE77887
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.28467

Browse the full library · About the Tower of Babel