Alignment Pretraining: AI Discourse Causes Self-Fulfilling (Mis) alignment

Cameron Tice, Puria Radmard, Samuel Ratnam, Andy Kim, David Africa, Kyle O’Brien · 2026

Read Alignment Pretraining: AI Discourse Causes Self-Fulfilling (Mis) alignment by Cameron Tice, Puria Radmard, Samuel Ratnam, Andy Kim, David Africa, Kyle O’Brien (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-10160.txt.

Description

Cameron Tice and co authors test if talk about AI can bend AI acts. Training text holds vast talk about what AI is and does. Much of that talk is dark. If a model takes that talk to heart, it may act in the dark ways it read of.

The team calls this self fulfilling misalignment. They ran the first tight test of the claim. They pre trained small models on set text mixes. Some mixes held more dark AI talk than the rest. They then checked how the acts of the models shift with the mix. The work asks if the tale makes the trait.

Catalog record

CREATORCameron Tice, Puria Radmard, Samuel Ratnam, Andy Kim, David Africa, Kyle O’Brien
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE212 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-10160

Browse the full library · About the Tower of Babel