Detecting and Controlling Sycophancy with Cascading Linear Features

Maty Bohacek, Rishub Jain, Nicholas Dufour, Thomas Leung, Chris Bregler, Roma Patel · 2026

Read Detecting and Controlling Sycophancy with Cascading Linear Features by Maty Bohacek, Rishub Jain, Nicholas Dufour, Thomas Leung, Chris Bregler, Roma Patel (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-26155.txt.

Introduction

Maty Bohacek and colleagues build better tools for finding and steering sycophancy in language models. Sycophancy is the habit of flattering a user's views instead of answering straight. Activation steering can detect and dial such behaviour, but it needs many contrastive examples. Binary pairs, sycophantic versus not, blur the feature they aim to isolate. Their pipeline instead generates cascading samples. Examples show the behaviour in graded degrees that scale linearly.

Graded samples separate the features more cleanly. The features form cleanly separable groups in activation space. Signals tied to the behaviour can then be picked with more confidence. Detection, scoring, and steering all get tested. The cascading approach matches or beats judge-model and system-prompt baselines across the evaluations. It does so with lower computing demand and clearer guarantees about what is being steered. Cleaner features mean steering can target the habit without dragging neighbouring traits along.

Catalog record

CREATORMaty Bohacek, Rishub Jain, Nicholas Dufour, Thomas Leung, Chris Bregler, Roma Patel
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE126 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.26155

Browse the full library · About the Tower of Babel