Emergent Response Planning in LLMs
Zhichen Dong ∗, Zhanhui Zhou ∗, Zhixuan Liu, Chao Yang, Chaochao Lu · 2025
Read Emergent Response Planning in LLMs by Zhichen Dong ∗, Zhanhui Zhou ∗, Zhixuan Liu, Chao Yang, Chaochao Lu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-06258.txt.
Description
Language models are trained only to guess the next word, yet Zhichen Dong and co-authors argue they quietly plan whole answers in advance. The team probed the models' internal states, the numbers computed while reading a prompt, and found those states already encode features of the reply that has not been written yet. The hidden plan covers structure, such as length and number of reasoning steps, content, such as which character a story will feature, and behavior, such as how confident the answer will be.
The authors also track how this planning grows with model size and how it changes as generation proceeds. Their point is practical: if a model has already sketched its answer internally, reading that sketch could make systems more transparent. It could also give developers a handle for steering answers before they appear.
Catalog record
| CREATOR | Zhichen Dong ∗, Zhanhui Zhou ∗, Zhixuan Liu, Chao Yang, Chaochao Lu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-06258