From Simulation to Enaction: Post-trained Language Models Recognize and React to their own Generations
Asvin G, Jack Lindsey, [2pt] Institute for Advanced Study, Princeton · 2026
Read From Simulation to Enaction: Post-trained Language Models Recognize and React to their own Generations by Asvin G, Jack Lindsey, [2pt] Institute for Advanced Study, Princeton (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25459.txt.
Description
Asvin G. and Jack Lindsey show post-trained language models recognize their own generations, unlike pretrained ones. Pretraining rewards passive prediction, but post-training rewards a model that knows when it is on-policy. Evidence: on-policy entropy runs three to four times lower than off-policy entropy across families and sizes. The team traces part of the effect to a surprise signal modulating entropy; post-trained models collapse topic uncertainty before the first token. Models can also report the distinction verbally, though explicit and implicit routes differ.
Catalog record
| CREATOR | Asvin G, Jack Lindsey, [2pt] Institute for Advanced Study, Princeton |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60278 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.25459