Learn to Think: Bootstrapping LLM Reasoning Capability Through Graph Representation Learning

Hang Gao, Chenhao Zhang, Tie Wang, Junsuo Zhao, Fengge Wu, Changwen Zheng, Huaping Liu · 2025

Read Learn to Think: Bootstrapping LLM Reasoning Capability Through Graph Representation Learning by Hang Gao, Chenhao Zhang, Tie Wang, Junsuo Zhao, Fengge Wu, Changwen Zheng, Huaping Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-06321.txt.

Description

Gao and co-authors present a framework that strengthens the reasoning of large language models by treating each reasoning process as a graph. Models still struggle with hard reasoning and cost a lot to train. Older fixes rely on task specific prompts and fixed reasoning steps, which limit flexibility. Their 2025 method lets the model build its steps adaptively instead.

Each step of reasoning becomes a node in a graph, and the model learns to generate the next step from that structure. A graph neural network reads the growing graph and feeds back adjustments to both model and prompt in real time. Tests across several tasks showed clear reasoning gains. No extra training or task specific prompt design was needed, the authors say.

Catalog record

CREATORHang Gao, Chenhao Zhang, Tie Wang, Junsuo Zhao, Fengge Wu, Changwen Zheng, Huaping Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-06321

Browse the full library · About the Tower of Babel