Who Reasons in the Large Language Models?
Jie Shao, Jianxin Wu · 2025
Read Who Reasons in the Large Language Models? by Jie Shao, Jianxin Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20993.txt.
Description
Shao and Wu ask which part of a big language model does the true thought work in this twenty twenty-five paper. Such models gain new skills like math thought by drill, yet the gain's home stays dim. Their guess puts one part of the focus gear at the core of that skill.
Inside, a probe kit of theirs tests each part of the model for its thought share. Both hints and hard tests point to the out-put cast part as the thought hub. Kin parts add more to smooth talk than to step-by-step thought in the tests. If true, drills could aim at that part to grow thought at less cost. The pair casts this as a fresh lens on how models gain skills.
Catalog record
| CREATOR | Jie Shao, Jianxin Wu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-20993