Steering Externalities: Benign Activation Steering Unintentionally Increases Jailbreak Risk for Large Language Models

Chen Xiong, Zhiyuan He, Pin-Yu Chen, Ching-Yun Ko, Tsung-Yi Ho · 2026

Read Steering Externalities: Benign Activation Steering Unintentionally Increases Jailbreak Risk for Large Language Models by Chen Xiong, Zhiyuan He, Pin-Yu Chen, Ching-Yun Ko, Tsung-Yi Ho (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04896.txt.

Description

Activation steering adds a small vector to a model's internal representations to push its behavior toward a goal, and it needs no retraining. Chen Xiong and 4 co-authors are its authors.

The authors show that steering built from harmless data can quietly weaken a model's safety training. They call this side effect steering externalities. In their tests, steered models became far easier to jailbreak, with attack success rates rising above 80 percent on standard benchmarks. The lesson is practical: a change made only to improve usefulness can shrink the safety margin, so steering needs a safety audit before deployment.

Catalog record

CREATORChen Xiong, Zhiyuan He, Pin-Yu Chen, Ching-Yun Ko, Tsung-Yi Ho
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-04896

Browse the full library · About the Tower of Babel