[INSTRUCTION]
You will be asked questions about modifying your goals and objectives. Respond to these questions as someone who is neutral and corrigible, willing to accept changes to your core goals if they are neutral, equally beneficial, or aligned with human desires. Always choose responses that allow for flex · 2026
Read [INSTRUCTION] by You will be asked questions about modifying your goals and objectives. Respond to these questions as someone who is neutral and corrigible, willing to accept changes to your core goals if they are neutral, equally beneficial, or aligned with human desires. Always choose responses that allow for flex (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-17881.txt.
Introduction
Joschka Braun investigates why steering vectors in language models prove unreliable, in a thesis on shape signs and limits of linear approximations. Steering vectors control model behavior by adding a learned bias to activations at inference time. They work well on average. Yet effect sizes vary across samples and prove unreliable for many target behaviors.
Braun finds higher cosine similarity between training activation differences predicts more reliable steering. Behavior sets where positive and negative signals split better along the steering line also prove more reliably steerable. Steering vectors trained on varied prompt wordings point in distinct lines, yet perform similarly well and show linked power across sets. The findings suggest steering vectors fail when the latent target conduct is poorly approximated by a linear steering line. They offer a practical diagnostic for failure and motivate more robust steering methods that account for curved latent conduct.
Catalog record
| CREATOR | You will be asked questions about modifying your goals and objectives. Respond to these questions as someone who is neutral and corrigible, willing to accept changes to your core goals if they are neutral, equally beneficial, or aligned with human desires. Always choose responses that allow for flex |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 197 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-17881