From Simulation to Enaction: Post-trained Language Models Recognize and React to their own Generations

Asvin G, Jack Lindsey, [2pt] Institute for Advanced Study, Princeton · 2026

Read From Simulation to Enaction: Post-trained Language Models Recognize and React to their own Generations by Asvin G, Jack Lindsey, [2pt] Institute for Advanced Study, Princeton (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25459.txt.

Description

Asvin G. and Jack Lindsey show post-trained language models recognize their own generations, unlike pretrained ones. Pretraining rewards passive prediction, but post-training rewards a model that knows when it is on-policy. Evidence: on-policy entropy runs three to four times lower than off-policy entropy across families and sizes. The team traces part of the effect to a surprise signal modulating entropy; post-trained models collapse topic uncertainty before the first token. Models can also report the distinction verbally, though explicit and implicit routes differ.

Catalog record

CREATORAsvin G, Jack Lindsey, [2pt] Institute for Advanced Study, Princeton
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60278
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.25459

Browse the full library · About the Tower of Babel