One-shot Optimized Steering Vectors Mediate Safety-relevant Behaviors in LLMs

Jacob Dunefsky & Arman Cohan · 2025

Read One-shot Optimized Steering Vectors Mediate Safety-relevant Behaviors in LLMs by Jacob Dunefsky & Arman Cohan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-18862.txt.

Description

Jacob Dunefsky and Arman Cohan present a 2025 paper on steering a language model's behavior with a vector tuned on a single example. Steering vectors, small nudges added inside the model, can dial traits like refusal up or down. Standard recipes build them from large contrast sets, which are laborious and can bake in spurious patterns.

The authors instead optimize the vector directly, by gradient descent, on one training case. They test several optimization styles and ask how far the result generalizes. On a model prone to faking alignment, one example vectors could induce harmful answers to harmless prompts, and flipped vectors suppressed harm. A refusal test reached a very high attack success rate.

Catalog record

CREATORJacob Dunefsky & Arman Cohan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE82 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-18862

Browse the full library · About the Tower of Babel