The Shape of Wisdom: Decision Trajectories in Language Models
Shailesh Rana · 2026
Read The Shape of Wisdom: Decision Trajectories in Language Models by Shailesh Rana (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-01202.txt.
Description
Rana asks where a model's state goes when it answers a fact. He tests four open models on 2,256 questions. Each question has an answer that comes up more than once. States that lead to the same answer group near a shared point. He calls that point the answer centroid. The answer can be read from the state at one layer.
In each model, states jump close to their centroid at one layer. That layer sits 47% to 71% through the network. Moving a wrong state to the right centroid fixes most replies. Such moves work in 83% to 97% of late cases. Random moves of the same size work just 2% to 4% of the time.
Catalog record
| CREATOR | Shailesh Rana |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 17 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2606.01202