GraphDancer : Training LLMs to Explore and Reason over Graphs via Curriculum Reinforcement Learning
Yuyang Bai, Zhuofeng Li, Ping Nie, Jianwen Xie, Yu Zhang · 2026
Read GraphDancer : Training LLMs to Explore and Reason over Graphs via Curriculum Reinforcement Learning by Yuyang Bai, Zhuofeng Li, Ping Nie, Jianwen Xie, Yu Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02518.txt.
Description
Yuyang Bai and 4 co-authors teach language models to explore knowledge graphs through a difficulty-graded curriculum, in a 2026 arXiv paper. Much real-world knowledge lives in heterogeneous graphs, not plain text. Reasoning over them requires following schema-defined relations through precise function calls and aggregating evidence across several rounds.
GraphDancer interleaves natural-language reasoning with graph function execution during post-training. The first stage teaches basic interaction under rule-based rewards. The second stage rewards more grounded and efficient trajectories. Both stages are organized by the structural complexity of the information-seeking path, so difficulty rises progressively. Trained on one domain only, the model was tested on unseen domains and new question types. Despite a small three-billion-parameter backbone, it beat baselines using larger, stronger models. The graph skills transferred across domains robustly.
Catalog record
| CREATOR | Yuyang Bai, Zhuofeng Li, Ping Nie, Jianwen Xie, Yu Zhang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-02518