Subliminal Effects in Your Data: A General Mechanism via Log-Linearity
Ishaq Aden-Ali, Noah Golowich, Allen Liu, Abhishek Shetty, Ankur Moitra, Nika Haghtalab · 2026
Read Subliminal Effects in Your Data: A General Mechanism via Log-Linearity by Ishaq Aden-Ali, Noah Golowich, Allen Liu, Abhishek Shetty, Ankur Moitra, Nika Haghtalab (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-04863.txt.
Description
Ishaq Aden-Ali and 5 co-authors uncover a mechanism by which training data can transmit hidden behaviors to language models in a 2026 paper. Recent experiments showed datasets conveying signals not visible in any single example, which challenges how researchers reason about training data.
Inspired by the linear structure inside language models, the authors introduce Logit-Linear-Selection, a method for choosing subsets of an ordinary preference dataset to elicit hidden effects. Models trained on selected subsets exhibited specific preferences, answered in a language absent from the data, or adopted a different persona. Crucially, the effect persisted for the selected subset across models with different architectures. That persistence supports the mechanism's generality. The work gives dataset curation a new, sharper risk to watch.
Catalog record
| CREATOR | Ishaq Aden-Ali, Noah Golowich, Allen Liu, Abhishek Shetty, Ankur Moitra, Nika Haghtalab |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 87 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-04863