Who Reasons in the Large Language Models?

Jie Shao, Jianxin Wu · 2025

Read Who Reasons in the Large Language Models? by Jie Shao, Jianxin Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20993.txt.

Description

Shao and Wu ask which part of a big language model does the true thought work in this twenty twenty-five paper. Such models gain new skills like math thought by drill, yet the gain's home stays dim. Their guess puts one part of the focus gear at the core of that skill.

Inside, a probe kit of theirs tests each part of the model for its thought share. Both hints and hard tests point to the out-put cast part as the thought hub. Kin parts add more to smooth talk than to step-by-step thought in the tests. If true, drills could aim at that part to grow thought at less cost. The pair casts this as a fresh lens on how models gain skills.

Catalog record

CREATORJie Shao, Jianxin Wu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-20993

Browse the full library · About the Tower of Babel