GraphMaster: Automated Graph Synthesis via LLM Agents in Data-Limited Environments

Enjun Du, Xunkai Li, Tian Jin, Zhihan Zhang, Rong-Hua Li, Guoren Wang · 2025

Read GraphMaster: Automated Graph Synthesis via LLM Agents in Data-Limited Environments by Enjun Du, Xunkai Li, Tian Jin, Zhihan Zhang, Rong-Hua Li, Guoren Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-00711.txt.

Introduction

Du and five co-authors breed graph data with a crew of tongue-model agents in this twenty twenty-five paper. Big graph models starve for lack of vast, rich graph sets to drill on. Past breed tricks shift shape yet leave node words thin and dull.

Inside, four agent roles run the breed loop as a team with set jobs. One leads, one reads, one lifts, and one grades each new graph in turn. The loop hones each graph till its words and shape both hold true. Thin-cut forms of six known sets test the crew in data-poor terms. The crew beat past breed tools by wide gaps on those sets.

Catalog record

CREATOREnjun Du, Xunkai Li, Tian Jin, Zhihan Zhang, Rong-Hua Li, Guoren Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE124 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-00711

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

GraphMaster: Automated Graph Synthesis via LLM Agents in Data-Limited Environments Enjun Du, Xunkai Li, Tian Jin, Zhihan Zhang, Rong-Hua Li, Guoren Wang Abstract The era of foundation models has revolutionized AI research, yet Graph Foundation Models (GFMs) remain constrained by the scarcity of large-scale graph corpora. Traditional graph data synthesis techniques primarily focus on simplistic structural operations, lacking the capacity to generate semantically rich nodes with meaningful textual attributes—a critical limitation for real-world applications. While large language models (LLMs) demonstrate exceptional text generation capabilities, their direct application to graph synthesis is impeded by context window limitations, hallucination phenomena, and structural consistency challenges. To address these issues, we introduce GraphMaster —the first multi-agent framework specifically designed for graph data synthesis in data-limited environments. GraphMaster orchestrates four specialized LLM agents (Manager, Perception, Enhancement, and Evaluation) that collaboratively optimize the synthesis process through iterative refinement, ensuring both semantic coherence and structural integrity. To rigorously evaluate our approach, we create new data-limited “Sub” variants of six standard graph benchmarks, specifically designed to test synthesis capabilities under realistic constraints. Additionally, we develop a novel interpretability assessment framework that combines human evaluation with a principled Grassmannian manifold-based analysis, providing both qualitative and quantitative measures of semantic coherence. Experimental results demonstrate that GraphMaster significantly outperforms traditional synthesis methods across multiple datasets, establishing a strong foundation for advancing GFMs in data-scarce environments. A Preprint 1 Introduction In the era of foundation models, unprecedented advances in natural language processing and computer vision have been enabled by massive training corpora [ 2 , 7 ] . Graph Foundation Models (GFMs) [ 23 , 20 ] represent a promising frontier for AI in graph-structured data, yet their development faces a critical bottleneck: the scarcity of large-scale, diverse graph datasets.Unlike text and image domains where data collection is relatively straightforward, gathering and annotating graph data often requires specialized expertise and significant resources. This data quantity constraint has become the primary challenge for training robust GFMs, particularly as model size increases and demands exponentially more training examples for optimal performance. Graph data synthesis offers a strategic solution to this fundamental constraint by automatically generating new graph samples that maintain both semantic richness and structural validity. Existing synthesis approaches, however, face substantial limitations. Edge-level operations [ 44 , 46 ] manipulate existing connections but cannot create novel nodes or patterns. Node-level mixing techniques like GraphMixup [ 40 ] generate synthetic nodes by interpolating features but often produce semantically inconsistent attributes, particularly with textual features. Graph-level synthesis methods such as G-Mixup [ 14 ] create entirely new graphs but struggle to balance global structure with local semantic coherence. The core limitation across these traditional methods is their inability to simultaneously preserve meaningful semantics while generating structurally valid expansions—a deficiency particularly pronounced when handling text-attributed graphs (TAGs) where both connectivity patterns and textual node features must remain coherent. Large language models have demonstrated remarkable capabilities in understanding and generating text [ 15 , 9 ] , suggesting potential for synthesizing text-attributed graphs. However, directly applying LLMs encounters several critical challenges: standard context windows cannot process entire graphs with numerous textual nodes [ 3 ] ; LLMs excel at semantic understanding but struggle to maintain structural consistency [ 10 ] ; and without proper coordination, they tend to produce inconsistent or hallucinated content that fails to capture the intricate balance between topology and semantics [ 25 ] . Furthermore, in realistic scenarios with limited available data, LLMs have insufficient examples to learn complex graph patterns [ 19 ] . To address these challenges, we propose GraphMaster , a novel multi-agent framework specifically designed for graph synthesis in data-limited environments. GraphMaster decomposes the complex synthesis task into specialized sub-tasks handled by four collaborative LLM-powered agents, each targeting specific challenges: (1) The Manager Agent coordinates the overall process and determines optimal synthesis strategies based on current graph characteristics, orchestrating the complex synthesis workflow; (2) The Perception Agent analyzes graph structure and employs advanced sampling to identify representative subgraphs processable within LLM context constraints, directly addressing the context window limitations; (3) The Enhancement Agent generates new nodes and edges with consistent semantics and structure, mitigating hallucination by maintaining coherence with existing graph elements; and (4) The Evaluation Agent assesses quality based on both semantic coherence and structural integrity, providing feedback for iterative improvement to ensure structural and semantic consistency. This decomposition enables targeted solutions for each challenge that a single-pass LLM approach cannot address. Through this collaborative, iterative process, these specialized agents overcome the limitations of both traditional methods and direct LLM applications. The multi-agent architecture enables GraphMaster to effectively balance semantic richness with structural validity—producing high-quality synthetic graph data even with limited training examples. By introducing modular reasoning (through task decomposition), semantic control (via specialized agent expertise), and iterative optimization (through feedback cycles), GraphMaster achieves synthesis capabilities beyond what single-pass approaches can deliver. Our contributions can be summerized as follows: • New perspective for LLM-based TAG Synthesis : we first propose a novel multi-agent framework from the RAG perspective to synthesize TAG under data-limited environment. By integrating context retrieval with iterative feedback, this new perspective enables both semantic richness and structural fidelity. • Groundbreaking Benchmark : We introduce a standardized “Data-limited” variant testbed for text-attributed graph synthesis and develop a dual-perspective interpretability assessment—combining expert human evaluation with Grassmann manifold-based analysis—to provide reproducible comparisons and deep semantic-structural insights. • State-of-the-Art Performance : Extensive experiments on multiple datasets and GNN architectures demonstrate that our method consistently outperforms existing baselines, setting a new benchmark for data-limited TAG synthesis. 2 Background Methods 2.1 Classic Graph Data Synthesis Methods Traditional graph data synthesis methods [ 6 ] address data scarcity through various approaches. Edge-level operations [ 44 ] modify topology by adding or deleting connections. Node-level techniques like GraphSMOTE [ 43 ] generate new nodes through minority class interpolation. Graph-level methods such as G-Mixup [ 14 ] create entirely new graph instances via graphon interpolation. Interpolation-based approaches [ 33 , 32 ] combine hidden representations to enhance model robustness. Despite their diversity, these methods primarily focus on structural manipulations without generating semantically meaningful textual attributes. 2.2 LLM-based Multi-Agent Systems for Data Generation Recent LLM-powered multi-agent frameworks demonstrate capabilities for complex data generation tasks. General collaboration systems like Self-Instruct [ 34 ] and distributed simulation platforms [ 26 ] establish architectures for coordinated AI systems. In graph contexts, approaches like GoG [ 37 ] and LLM-based social simulations [ 16 ] leverage semantic understanding for graph-related tasks. However, specific applications for text-attributed graph synthesis in data-limited environments remain largely unexplored. 2.3 Problem Formulation: Graph Data Synthesis Text-Attributed Graphs. We formally define a text-attributed graph (TAG) as \mathcal{G}=(\mathcal{V},\,\mathcal{E},\,\mathcal{X},\mathcal{Y}) , where \mathcal{V}=\{v_{1},v_{2},\ldots,v_{N}\} is a set of N nodes, \mathcal{E}\subseteq\mathcal{V}\times\mathcal{V} is the set of edges with corresponding adjacency matrix \mathcal{A}\in\{0,1\}^{N\times N} , \mathcal{X}=\{x_{1},x_{2},\ldots,x_{N}\} is the set of textual features with each x_{i} corresponding to node v_{i}\in\mathcal{V} , and \mathcal{Y}=\{y_{1},y_{2},\ldots,y_{N}\} represents the set of node labels where y_{i}\in\{1,2,\ldots,C\} for C distinct classes. Knowledge Extraction. Given the context length constraints of LLMs, we define a knowledge extraction function \Phi:\mathcal{G}\rightarrow\mathcal{K} that samples a representative subgraph as: \mathcal{K}=\Phi(\mathcal{G})=(\mathcal{V}_{k},\mathcal{E}_{k},\mathcal{X}_{k},\mathcal{Y}_{k}), (1) where \mathcal{V}_{k}\subset\mathcal{V} , \mathcal{E}_{k}=\{(v_{i},v_{j})\in\mathcal{E}\mid v_{i},v_{j}\in\mathcal{V}_{k}\} , and \mathcal{X}_{k},\mathcal{Y}_{k} are the corresponding text attributes and labels. The extraction function \Phi employs specialized sampling strategies

Read the complete text