Emergent Response Planning in LLMs

Zhichen Dong ∗, Zhanhui Zhou ∗, Zhixuan Liu, Chao Yang, Chaochao Lu · 2025

Read Emergent Response Planning in LLMs by Zhichen Dong ∗, Zhanhui Zhou ∗, Zhixuan Liu, Chao Yang, Chaochao Lu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-06258.txt.

Description

Language models are trained only to guess the next word, yet Zhichen Dong and co-authors argue they quietly plan whole answers in advance. The team probed the models' internal states, the numbers computed while reading a prompt, and found those states already encode features of the reply that has not been written yet. The hidden plan covers structure, such as length and number of reasoning steps, content, such as which character a story will feature, and behavior, such as how confident the answer will be.

The authors also track how this planning grows with model size and how it changes as generation proceeds. Their point is practical: if a model has already sketched its answer internally, reading that sketch could make systems more transparent. It could also give developers a handle for steering answers before they appear.

Catalog record

CREATORZhichen Dong ∗, Zhanhui Zhou ∗, Zhixuan Liu, Chao Yang, Chaochao Lu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-06258

Browse the full library · About the Tower of Babel