Subliminal Effects in Your Data: A General Mechanism via Log-Linearity

Ishaq Aden-Ali, Noah Golowich, Allen Liu, Abhishek Shetty, Ankur Moitra, Nika Haghtalab · 2026

Read Subliminal Effects in Your Data: A General Mechanism via Log-Linearity by Ishaq Aden-Ali, Noah Golowich, Allen Liu, Abhishek Shetty, Ankur Moitra, Nika Haghtalab (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04863.txt.

Description

Ishaq Aden-Ali and 5 co-authors uncover a mechanism by which training data can transmit hidden behaviors to language models in a 2026 paper. Recent experiments showed datasets conveying signals not visible in any single example, which challenges how researchers reason about training data.

Inspired by the linear structure inside language models, the authors introduce Logit-Linear-Selection, a method for choosing subsets of an ordinary preference dataset to elicit hidden effects. Models trained on selected subsets exhibited specific preferences, answered in a language absent from the data, or adopted a different persona. Crucially, the effect persisted for the selected subset across models with different architectures. That persistence supports the mechanism's generality. The work gives dataset curation a new, sharper risk to watch.

Catalog record

CREATORIshaq Aden-Ali, Noah Golowich, Allen Liu, Abhishek Shetty, Ankur Moitra, Nika Haghtalab
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE87 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-04863

Browse the full library · About the Tower of Babel