GraphDancer : Training LLMs to Explore and Reason over Graphs via Curriculum Reinforcement Learning

Yuyang Bai, Zhuofeng Li, Ping Nie, Jianwen Xie, Yu Zhang · 2026

Read GraphDancer : Training LLMs to Explore and Reason over Graphs via Curriculum Reinforcement Learning by Yuyang Bai, Zhuofeng Li, Ping Nie, Jianwen Xie, Yu Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02518.txt.

Description

Yuyang Bai and 4 co-authors teach language models to explore knowledge graphs through a difficulty-graded curriculum, in a 2026 arXiv paper. Much real-world knowledge lives in heterogeneous graphs, not plain text. Reasoning over them requires following schema-defined relations through precise function calls and aggregating evidence across several rounds.

GraphDancer interleaves natural-language reasoning with graph function execution during post-training. The first stage teaches basic interaction under rule-based rewards. The second stage rewards more grounded and efficient trajectories. Both stages are organized by the structural complexity of the information-seeking path, so difficulty rises progressively. Trained on one domain only, the model was tested on unseen domains and new question types. Despite a small three-billion-parameter backbone, it beat baselines using larger, stronger models. The graph skills transferred across domains robustly.

Catalog record

CREATORYuyang Bai, Zhuofeng Li, Ping Nie, Jianwen Xie, Yu Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-02518

Browse the full library · About the Tower of Babel