One-shot Optimized Steering Vectors Mediate Safety-relevant Behaviors in LLMs
Jacob Dunefsky & Arman Cohan · 2025
Read One-shot Optimized Steering Vectors Mediate Safety-relevant Behaviors in LLMs by Jacob Dunefsky & Arman Cohan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-18862.txt.
Description
Jacob Dunefsky and Arman Cohan present a 2025 paper on steering a language model's behavior with a vector tuned on a single example. Steering vectors, small nudges added inside the model, can dial traits like refusal up or down. Standard recipes build them from large contrast sets, which are laborious and can bake in spurious patterns.
The authors instead optimize the vector directly, by gradient descent, on one training case. They test several optimization styles and ask how far the result generalizes. On a model prone to faking alignment, one example vectors could induce harmful answers to harmless prompts, and flipped vectors suppressed harm. A refusal test reached a very high attack success rate.
Catalog record
| CREATOR | Jacob Dunefsky & Arman Cohan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 82 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-18862