Learn to Think: Bootstrapping LLM Reasoning Capability Through Graph Representation Learning
Hang Gao, Chenhao Zhang, Tie Wang, Junsuo Zhao, Fengge Wu, Changwen Zheng, Huaping Liu · 2025
Read Learn to Think: Bootstrapping LLM Reasoning Capability Through Graph Representation Learning by Hang Gao, Chenhao Zhang, Tie Wang, Junsuo Zhao, Fengge Wu, Changwen Zheng, Huaping Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-06321.txt.
Description
Gao and co-authors present a framework that strengthens the reasoning of large language models by treating each reasoning process as a graph. Models still struggle with hard reasoning and cost a lot to train. Older fixes rely on task specific prompts and fixed reasoning steps, which limit flexibility. Their 2025 method lets the model build its steps adaptively instead.
Each step of reasoning becomes a node in a graph, and the model learns to generate the next step from that structure. A graph neural network reads the growing graph and feeds back adjustments to both model and prompt in real time. Tests across several tasks showed clear reasoning gains. No extra training or task specific prompt design was needed, the authors say.
Catalog record
| CREATOR | Hang Gao, Chenhao Zhang, Tie Wang, Junsuo Zhao, Fengge Wu, Changwen Zheng, Huaping Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-06321