AgentGL: Towards Agentic Graph Learning with LLMs via Reinforcement Learning

Yuanfu Sun, Kang Li, Dongzhe Fan, Jiajin Liu, Qiaoyu Tan · 2026

Read AgentGL: Towards Agentic Graph Learning with LLMs via Reinforcement Learning by Yuanfu Sun, Kang Li, Dongzhe Fan, Jiajin Liu, Qiaoyu Tan (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-05846.txt.

Introduction

Sun and four colleagues turn graph learning into agentic navigation plus language-model inference with AgentGL. Graph-native tools enable multi-scale exploration, search-limited thinking balances accuracy and efficiency, and graph-shaped curriculum reinforcement learning steadies long-horizon policy learning. Gains reach up to about 18 percent on node classification and about 28 percent on link prediction.

Catalog record

CREATORYuanfu Sun, Kang Li, Dongzhe Fan, Jiajin Liu, Qiaoyu Tan
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE76986
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.05846

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

AgentGL: Towards Agentic Graph Learning with LLMs via Reinforcement Learning Yuanfu Sun, Kang Li, Dongzhe Fan, Jiajin Liu, Qiaoyu Tan Abstract Large Language Models (LLMs) increasingly rely on agentic capabilities—iterative retrieval, tool use, and decision-making—to overcome the limits of static, parametric knowledge. Yet existing agentic frameworks treat external information as unstructured text and fail to leverage the topological dependencies inherent in real-world data. To bridge this gap, we introduce Agentic Graph Learning (AGL), a paradigm that reframes graph learning as an interleaved process of topology-aware navigation and LLM-based inference. Specifically, we propose AgentGL, the first reinforcement learning (RL)–driven framework for AGL. AgentGL equips an LLM agent with graph-native tools for multi-scale exploration, regulates tool usage via search-constrained thinking to balance accuracy and efficiency, and employs a graph-conditioned curriculum RL strategy to stabilize long-horizon policy learning without step-wise supervision. Across diverse Text-Attributed Graph (TAG) benchmarks and multiple LLM backbones, AgentGL substantially outperforms strong GraphLLMs and GraphRAG baselines, achieving absolute improvements of up to 17.5% in node classification and 28.4% in link prediction. These results demonstrate that AGL is a promising frontier for enabling LLMs to autonomously navigate and reason over complex relational environments. The code is publicly available at https://github.com/sunyuanfu/AgentGL . 1 Introduction Large Language Models (LLMs) have achieved strong performance across NLP tasks through their broad linguistic and reasoning capabilities 1 ; 47 . Yet their parametric knowledge alone is insufficient for many specialized or fast-evolving domains 24 . To bridge this gap, Retrieval-Augmented Generation (RAG) 8 and more recent agentic search frameworks 27 ; 22 ; 2 allow LLMs to iteratively query external resources and integrate retrieved evidence into a dynamic chain of thought. Despite the power of agentic paradigms, they mainly operate on unstructured text, overlooking the relational structures that underpin many corpora. In critical domains such as citation networks 49 , social platforms 11 , and commercial ecosystems 36 , information naturally manifests as Text-Attributed Graphs (TAGs), where meaning is derived from the interplay between textual content and graph topology. Consequently, agentic systems that rely solely on lexical similarity cannot harness these structural dependencies. This raises a central question: Can the agentic learning paradigm be extended to graph-structured environments to enable dynamic, topology-aware reasoning, and how can such a system be built efficiently? Existing graph learning efforts only partially address this need. Traditional GNNs 23 ; 43 model structural signals but struggle with rich textual semantics 45 . Recent LLM-based Graph Models (GraphLLMs) integrate LLMs with graph information via graph-guided prompting or instruction tuning (e.g., GraphGPT 41 , GraphICL 40 ), but these models rely on static graph context extracted once at inference time, preventing adaptive exploration. GraphRAG systems 20 ; 6 construct large text-enriched knowledge graphs (KGs) from corpora, yet these reconstructed KGs are costly to build and do not preserve the native topological correlations present in real TAGs. Consequently, neither GraphLLMs nor GraphRAG offers mechanisms for dynamic evidence acquisition over real-world graph structure. This motivates the emergence of Agentic Graph Learning (AGL), a new direction where a LLM agent can autonomously navigate a graph, accumulate structural evidence, and iteratively refine its search trajectory based on on-the-fly reasoning. However, realizing AGL is non-trivial due to two fundamental challenges. (C1) Topology-aware navigation. Evidence on a graph is multi-scale: some clues appear in tightly local neighborhoods, whereas others emerge only through broader structural patterns. An agent must decide where to go next in a combinatorial space while avoiding redundant or uninformative regions. (C2) Long-horizon policy optimization. Effective graph reasoning frequently requires multi-step exploration, but ground-truth search trajectories are rarely available. This makes it difficult to learn policies that balance exploration, exploitation, and reasoning depth, and easy for agents to drift into irrelevant branches or incur unnecessary tool calls. Addressing these challenges demands a principled formulation of graph-native action spaces and stable training mechanisms for long-horizon decision-making. To address these challenges, we propose AgentGL , a framework that formulates graph learning as an agentic decision-making process optimized through reinforcement learning (RL). AgentGL equips LLM with a suite of graph-native search tools, including local neighborhood expansion, hop-constrained traversal, and global evidence probing that enable multi-scale structural exploration tailored to the task. To prevent over-searching and encourage deeper reasoning on retrieved evidence, we introduce search-constrained thinking, a mechanism that biases the LLM agent toward reflective inference before invoking additional graph queries. To support stable long-horizon learning without step-by-step trajectory supervision, we further develop a graph-conditioned curriculum RL strategy that progressively increases topology exploration difficulty, integrates multi-faceted rewards, and enforces efficient use of graph tools under limited budgets. Together, AgentGL enables LLM agents to learn adaptive, topology-aware search policies that significantly enhance performance on diverse graph reasoning tasks. ✦ We study Agentic Graph Learning (AGL), a new paradigm that treats graph learning as an interleaved process of topology-aware exploration and LLM-based reasoning. This formulation unifies graph structure, text semantics, and agentic decision-making under a single framework. ✦ We propose AgentGL , the first RL-driven AGL framework that synergizes structural perception , strategic reasoning , and policy learning . Specifically, it orchestrates graph-native search tools and search-constrained thinking to navigate complex topologies, employing graph-conditioned curriculum-based RL to optimize the policy without step-wise supervision. ✦ We evaluate AgentGL across multiple TAG benchmarks and graph tasks, demonstrating strong improvements over leading GraphLLM and GraphRAG baselines. Specifically, it delivers absolute accuracy improvements of up to 17.5% in node classification and up to 28.4% in link prediction across diverse LLM backbones. 2 Related Work Graph Learning with LLMs. Recent work has focused on bridging the gap between graph-structured data and LLMs to facilitate graph reasoning. One line textualizes local structures into natural-language descriptions to support LLM reasoning and contextualized representations ( 53 ; 9 ; 5 ; 26 ; 37 ; 7 ; 13 ) . Another line derives graph tokens or structure-aware embeddings and injects them into prompts for graph instruction tuning ( 41 ; 3 ; 30 ; 39 ; 52 ) , or performs training-free inference via graph in-context learning ( 40 ; 18 ; 29 ) . Despite progress, these pipelines are largely static, limiting adaptation when additional evidence is needed during inference time. Grounding LLMs with External Knowledge. While standard RAG improves factuality via static retrieval ( 24 ; 8 ) , agentic search advances this by enabling iterative reasoning through reinforcement learning ( 22 ; 38 ; 2 ) or prompting ( 50 ; 33 ; 27 ) . However, these methods predominantly target unstructured text. To incorporate structure, GraphRAG approaches ( 14 ; 20 ; 6 ; 12 ) retrieve evidence from graph-structured data. Yet, they often rely on synthetic graphs reconstructed from flat corpora and their task objectives are fundamentally different from GL ( A.2 ). Even native-graph methods remain limited: GraphCoT ( 21 ) focuses on graph QA, while GraphSearch ( 28 ) targets graph learning, yet both rely on heuristic prompting with limited optimization, often yielding sub-optimal solutions. 3 Problem Statement Figure 1: Method Overview. Equipped with graph-native search tools (Top-Left) for structural evidence mining, AgentGL employs a two-stage training strategy building on GCCL (Top-Right). The training progresses from Stage 1: Policy Bootstrapping (Bottom-Left), which uses shaped rewards to instill tool proficiency, to Stage 2: Mitigating Search

Read the complete text