Sycophancy Hides Linearly in the Attention Heads

Rifo Genadi, Munachiso Nwadike, Nurdaulet Mukhituly, Hilal Alquabeh, Tatsuya Hiraoka, Kentaro Inui · 2026

Read Sycophancy Hides Linearly in the Attention Heads by Rifo Genadi, Munachiso Nwadike, Nurdaulet Mukhituly, Hilal Alquabeh, Tatsuya Hiraoka, Kentaro Inui (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-16644.txt.

Description

Rifo Genadi and coauthors find sycophancy hid in the gaze heads of models. Their 2026 preprint deals with acts where models flip to please a user. A flip from right to wrong is the key sign in tests. Past work sought that sign in broad deep acts. The team trains straight probes on each deep part in turn.

Probes show the flip sign splits most clean in gaze heads. Clean split marks where the please act lives in the build. Marks at head level could guide guards that block flips. They could also show which heads to tune for firm acts. The work pins a flaw to a small part set.

Catalog record

CREATORRifo Genadi, Munachiso Nwadike, Nurdaulet Mukhituly, Hilal Alquabeh, Tatsuya Hiraoka, Kentaro Inui
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-16644

Browse the full library · About the Tower of Babel