Detecting and Controlling Sycophancy with Cascading Linear Features
Maty Bohacek, Rishub Jain, Nicholas Dufour, Thomas Leung, Chris Bregler, Roma Patel · 2026
Read Detecting and Controlling Sycophancy with Cascading Linear Features by Maty Bohacek, Rishub Jain, Nicholas Dufour, Thomas Leung, Chris Bregler, Roma Patel (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-26155.txt.
Introduction
Maty Bohacek and colleagues build better tools for finding and steering sycophancy in language models. Sycophancy is the habit of flattering a user's views instead of answering straight. Activation steering can detect and dial such behaviour, but it needs many contrastive examples. Binary pairs, sycophantic versus not, blur the feature they aim to isolate. Their pipeline instead generates cascading samples. Examples show the behaviour in graded degrees that scale linearly.
Graded samples separate the features more cleanly. The features form cleanly separable groups in activation space. Signals tied to the behaviour can then be picked with more confidence. Detection, scoring, and steering all get tested. The cascading approach matches or beats judge-model and system-prompt baselines across the evaluations. It does so with lower computing demand and clearer guarantees about what is being steered. Cleaner features mean steering can target the habit without dragging neighbouring traits along.
Catalog record
| CREATOR | Maty Bohacek, Rishub Jain, Nicholas Dufour, Thomas Leung, Chris Bregler, Roma Patel |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 126 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.26155