Graph-Augmented Large Language Model Agents: Current Progress and Future Prospects

Yixin Liu, Guibin Zhang, Kun Wang, Shiyuan Li, Shirui Pan · 2025

Read Graph-Augmented Large Language Model Agents: Current Progress and Future Prospects by Yixin Liu, Guibin Zhang, Kun Wang, Shiyuan Li, Shirui Pan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-21407.txt.

Introduction

Yixin Liu and co-authors survey a fast growing field in a 2025 paper: language model agents backed by graphs. These agents can browse the web, write code, and steer robots, yet they often plan poorly, forget over time, and juggle tools badly. Graphs, with their linked nodes, can add the structure such tasks need.

The survey sorts past work by job: graphs for planning, for memory, and for tool use. For teams of agents, it shows how graphs help with order, speed, and trust. The authors close with open problems, from graphs that adapt on the fly to systems that blend text, images, and sound. Their aim is a road map for the field.

Catalog record

CREATORYixin Liu, Guibin Zhang, Kun Wang, Shiyuan Li, Shirui Pan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-21407

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Graph-Augmented Large Language Model Agents: Current Progress and Future Prospects Yixin Liu, Guibin Zhang, Kun Wang, Shiyuan Li, Shirui Pan Abstract Autonomous agents based on large language models (LLMs) have demonstrated impressive capabilities in a wide range of applications, including web navigation, software development, and embodied control. While most LLMs are limited in several key agentic procedures, such as reliable planning, long-term memory, tool management, and multi-agent coordination, graphs can serve as a powerful auxiliary structure to enhance structure, continuity, and coordination in complex agent workflows. Given the rapid growth and fragmentation of research on G raph-augmented L LM A gents (GLA), this paper offers a timely and comprehensive overview of recent advances and also highlights key directions for future work. Specifically, we categorize existing GLA methods by their primary functions in LLM agent systems, including planning, memory, and tool usage, and then analyze how graphs and graph learning algorithms contribute to each. For multi-agent systems, we further discuss how GLA solutions facilitate the orchestration, efficiency optimization, and trustworthiness of MAS. Finally, we highlight key future directions to advance this field, from improving structural adaptability to enabling unified, scalable, and multimodal GLA systems. We hope this paper can serve as a roadmap for future research on GLA and foster a deeper understanding of the role of graphs in LLM agent systems. 1 Introduction The emergence of large language models (LLMs), such as GPT-4 Achiam et al. 2023 , Gemini Team et al. 2024 , and DeepSeek Liu et al. 2024a , has brought about a paradigm shift in the design of autonomous agent systems Wang et al. 2024 ; Guo et al. 2024 ; Xi et al. 2025 . By leveraging LLMs as central reasoning engines, a new generation of LLM-based autonomous agents (LLM agents for short) has demonstrated promising capabilities in understanding natural language instructions, executing multi-step tasks, and coordinating with external tools or services Zhang et al. 2025a ; Wu et al. 2024a ; Zhai et al. 2024 . The emergence of LLM agents enables them to tackle challenges once considered beyond the reach of artificial intelligence, opening doors to novel applications across a broad range of fields, such as software development Manish 2024 , scientific research M. Bran et al. 2024 , financial analysis Yu et al. 2024 , etc. Figure 1: LLM agent framework and multi-agent system. Despite the impressive language understanding and reasoning capabilities of LLMs, they are insufficient on their own to support all key functionalities required in autonomous agent systems. As shown in Figure 1 , while LLMs serve as powerful cores for agent systems to interpret perceptions and make high-level decisions, they must be complemented with dedicated modules for planning , memory , and tool using , where LLMs may not perform reliably or efficiently. Firstly , LLMs may perform unreliable task planning due to their tendency to hallucinate and limited understanding of multi-step dependencies Wu et al. 2024b . Secondly , LLMs struggle to maintain long-term memory efficiently in agent systems, primarily due to their stateless architecture and the constraints of a limited context window Fan et al. 2024 . Thirdly , LLMs are inherently difficult to manage and invoke large toolsets due to their limited capacity for accurate selection, tool disambiguation, and consistent reasoning over unfamiliar or similar tools Liu et al. 2024b . Moreover , when we extend a single agent to multi-agent systems , how to manage inter-agent communication and coordination remains an open question for LLMs Guo et al. 2024 . Figure 2: Different graphs in LLM agent systems. To address these limitations, researchers have increasingly turned to graphs as a complementary infrastructure to organize, enhance, and interpret the modules and execution flows of LLM agents, giving rise to an emerging research direction termed G raph-augmented L LM A gents (GLA) Liu et al. 2024b ; Zhuge et al. 2024 ; Zhang et al. 2025f . Unlike the sequential language data on which LLMs are grounded, graphs are expressive and general-purpose data structures that naturally encode complex relationships among entities, tasks, tools, or agents. Within an LLM agent system, graphs can serve as tool managers (e.g., tool graphs, see Figure 2 (a)), task decomposition frameworks (e.g., task or workflow graphs, see Figure 2 (b)), external knowledge stores (e.g., knowledge graphs, see Figure 2 (c)), or communication infrastructures (e.g., agent coordination graphs, see Figure 2 (d)), and beyond Wu et al. 2024b ; Liu et al. 2024b ; Zhang et al. 2025f ; Anokhin et al. 2024 . Compared to purely LLM-based solutions, GLA provides a range of benefits. ❶ Reliability . Graphs ground the reasoning, memory, and knowledge of LLM agents on structured and factual data, reducing hallucinations and improving the reliability of agent systems Anokhin et al. 2024 . ❷ Efficiency . Graphs support efficient information access and management by representing information in a compact, structured, and query-friendly form. Moreover, lightweight graph neural networks enable the training and deployment of auxiliary models over graph structures with minimal computational overhead Luo et al. 2025b . ❸ Interpretability . The explicit structure of graphs enhances explainability by revealing how information, tasks, and control signals propagate through the agent system, clarifying the rationale behind decisions and actions. ❹ Flexibility . Graphs promote modularity and reusability, allowing agents to generalize better across tasks by reusing graph-structured information, including but not limited to knowledge, memory, workflow, and communication patterns. Figure 3: Graphs for planning in LLM agent system. Despite GLA remaining an emerging research direction, there has been, to date, no comprehensive taxonomy or review article on this line of work. To fill the gap, this paper aims to provide a comprehensive overview of existing studies on GLA and offer insights into future opportunities and challenges in this emerging area. Specifically, we first discuss how graphs can augment individual modules within the LLM agent framework , including planning and reasoning, memory and knowledge organization, and tool management. Then, we explore how graphs address unique challenges in LLM-based multi-agent systems , particularly in designing collaborative workflows, ensuring safety, and optimizing efficiency. Finally, we highlight the key future directions, including dynamic and continual graph learning, unified graph abstractions for full-stack agent systems, multimodal graphs for multimodal agents, and large-scale multi-agent system simulation. We hope this article provides useful insights for ML and NLP researchers exploring structured representations in agent systems, graph learning practitioners seeking new applications, and system designers aiming to build more interpretable and collaborative LLM agent systems. 2 Graph-Augmented LLM Agent System Framework Apart from the LLM central agent, the framework of an LLM agent system (as shown in Figure 1 (a)) is composed of three critical components: ❶ planning module , responsible for decomposing tasks into actionable steps and reasoning for the task requirements; ❷ memory module , which stores and retrieves contextual knowledge and/or historical memory to support task finishing; and ❸ tool using module , which enables the agent to interact with external APIs or environments to complete tasks beyond its internal capabilities. In each of these components, graphs play a critical role, taking on different forms and functions depending on the requirements of the specific module. In this section, we detail the ways in which graphs support

Read the complete text