SafeSwitch: Steering Unsafe LLM Behavior via Internal Activation Signals

Peixuan Han, Cheng Qian, Xiusi Chen, Yuji Zhang, Denghui Zhang, Heng Ji · 2025

Read SafeSwitch: Steering Unsafe LLM Behavior via Internal Activation Signals by Peixuan Han, Cheng Qian, Xiusi Chen, Yuji Zhang, Denghui Zhang, Heng Ji (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-01042.txt.

Description

Peixuan Han and co-authors steer a language model's behavior by listening to its inner signals, in a 2025 paper. Safety filters often make models timid, refusing harmless requests alongside harmful ones. The authors first show that models internally register whether a request looks dangerous. SafeSwitch turns that inner sense into a control knob.

A small probe watches the model's internal activations for harmful intent. Only when the probe fires does a safety head engage, pushing the reply toward a careful refusal. Harmful outputs fell by about four fifths on dangerous queries, while normal usefulness held up. The refusals also explain themselves better than blanket blocks. Only a small slice of the model's parameters needed tuning.

Catalog record

CREATORPeixuan Han, Cheng Qian, Xiusi Chen, Yuji Zhang, Denghui Zhang, Heng Ji
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-01042

Browse the full library · About the Tower of Babel