SafeSwitch: Steering Unsafe LLM Behavior via Internal Activation Signals
Peixuan Han, Cheng Qian, Xiusi Chen, Yuji Zhang, Denghui Zhang, Heng Ji · 2025
Read SafeSwitch: Steering Unsafe LLM Behavior via Internal Activation Signals by Peixuan Han, Cheng Qian, Xiusi Chen, Yuji Zhang, Denghui Zhang, Heng Ji (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-01042.txt.
Description
Peixuan Han and co-authors steer a language model's behavior by listening to its inner signals, in a 2025 paper. Safety filters often make models timid, refusing harmless requests alongside harmful ones. The authors first show that models internally register whether a request looks dangerous. SafeSwitch turns that inner sense into a control knob.
A small probe watches the model's internal activations for harmful intent. Only when the probe fires does a safety head engage, pushing the reply toward a careful refusal. Harmful outputs fell by about four fifths on dangerous queries, while normal usefulness held up. The refusals also explain themselves better than blanket blocks. Only a small slice of the model's parameters needed tuning.
Catalog record
| CREATOR | Peixuan Han, Cheng Qian, Xiusi Chen, Yuji Zhang, Denghui Zhang, Heng Ji |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-01042