PromptGNN-sim: Deep Fusion and Alignment of GNN and LLMs for Text-Attributed Graph Learning

Zhifei Hu, Alexandra I. Cristea · 2026

Read PromptGNN-sim: Deep Fusion and Alignment of GNN and LLMs for Text-Attributed Graph Learning by Zhifei Hu, Alexandra I. Cristea (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-30291.txt.

Introduction

Zhifei Hu and Alexandra Cristea fuse graph neural networks with large language models so the two truly interact. Text-attributed graphs pair node text with network structure. Citation networks are the classic example of the format. Current fusion pipelines flow one way, from structure to text or back. Shallow, unidirectional mixing underperforms on sparse or shifted graphs. Their framework, PromptGNN-sim, makes the exchange bidirectional.

A graph attention network first selects neighborhoods using structure and text similarity together. That structural context dynamically generates rich prompts for the language model. Prompts include the node's text summary, label categories, and neighbor keywords. Bidirectional contrastive learning and cross-attention train both components jointly. Six public datasets, including Cora, Pubmed, and WikiCS, host the evaluation. Transfer across tasks and datasets tests the claimed robustness. Sparse perturbations probe performance when links are missing. The framework beats classical, language-only, and recent fusion baselines.

Catalog record

CREATORZhifei Hu, Alexandra I. Cristea
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.30291

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

PromptGNN-sim: Deep Fusion and Alignment of GNN and LLMs for Text-Attributed Graph Learning Zhifei Hu, Alexandra I. Cristea Abstract Text-Attributed Graphs (TAGs), which integrate rich textual semantics with graph structural information, play a critical role in graph learning tasks. However, current fusion approaches suffer from a fundamental limitation: they treat textual and structural modalities as separate inputs in a shallow, unidirectional pipeline. This one-way information flow prevents a deep, interactive exchange between modalities, leading to suboptimal performance, particularly in challenging scenarios with sparse connectivity and when generalizing across different graphs. To overcome these limitations, we introduce PromptGNN-sim, a novel bi-directional structure-semantic fusion framework that enables deep, symbiotic collaboration between GNNs and LLMs. At its core, PromptGNN-sim leverages a Graph Attention Network (GAT) to perform semantically-aware neighborhood selection, combining structural attention with textual similarity. This GNN-derived structural context is then used to dynamically generate rich, structure-aware prompts for an LLM, which explicitly include the target node’s textual summary, label categories, and representative keywords from semantically similar neighbors. Unlike traditional methods, our framework incorporates bi-directional cross-modal contrastive learning and cross-attention mechanisms during training to jointly optimize both GNN and LLM components for enhanced performance and robustness. We conduct comprehensive experiments on six public datasets, including Cora, Pubmed, and WikiCS, evaluating both task performance and robustness under cross-task transfer, cross-dataset generalisation, and sparse perturbations. Results show that PromptGNN-sim significantly outperforms classical GNNs, LLMs, and recent state-of-the-art GNN–LLM fusion methods in terms of accuracy, generalisation, and robustness. This work not only introduces an effective framework for deep GNN–LLM collaboration but also lays a solid foundation for future research on truly interactive multi-modal graph learning. 1 Introduction Text-Attributed Graphs (TAGs) have become a key paradigm for modeling complex relational data enriched with rich textual semantics. In TAGs, each node is associated with unstructured text describing its attributes, while edges capture diverse, often heterogeneous relationships representing various interactions or dependencies. Such graphs are common in domains like academic citation networks [ 6 , 36 ] , where publications are connected by citations and described by abstracts; social media platforms [ 43 , 10 ] , reflecting user interactions alongside textual content such as posts and comments; and product knowledge bases [ 12 ] , which integrate product relations with descriptive reviews. By jointly leveraging graph topology and textual information, TAGs enable effective representation learning for downstream tasks including node classification, link prediction, and recommendation [ 7 , 30 , 41 ] . This combined modeling exploits the complementary strengths of graph structure—providing relational inductive biases [ 14 , 35 ] —and textual semantics, which offer dense, high-dimensional contextual cues. However, effectively integrating structural and textual modalities in TAGs remains challenging due to their intrinsic differences and the complexities of real-world data [ 36 ] . Graph connectivity encodes discrete relational patterns that are often sparse, incomplete, or noisy—such as missing citations in academic networks or spurious links on social platforms—reducing the reliability of purely structural signals [ 34 ] . Textual attributes also vary substantially in quality, style, and length across nodes and domains, complicating semantic understanding and transfer [ 17 , 31 ] . Existing approaches predominantly employ shallow fusion techniques, like embedding concatenation or late fusion, which treat modalities independently and limit the learning of deep interactive representations [ 45 , 12 ] . Such simplistic strategies often underperform in realistic settings characterized by noisy inputs, sparse connectivity, and domain shifts [ 41 , 17 ] , resulting in degraded robustness, generalization, and adaptability. In addition, neighborhood aggregation typically depends solely on structural adjacency, neglecting semantic relevance [ 16 ] , which further weakens model resilience in dynamic or corrupted graphs [ 34 , 3 ] . The challenges are compounded by the dynamic nature of many TAGs, whose structure and textual content evolve over time [ 26 , 42 ] . This evolution demands fusion frameworks that are adaptive and robust to temporal changes [ 24 , 27 ] . Critically, systematic investigations into how fusion strategies impact model robustness, generalization, and resistance to perturbations such as data sparsity, adversarial noise, and domain shifts remain limited [ 3 , 31 , 17 ] . Addressing these gaps requires unified frameworks that enable deep, bidirectional fusion of graph structural and textual information, fully leveraging their complementary strengths [ 41 ] . To address these challenges, we propose PromptGNN-SIM , a framework enabling deep, bi-directional fusion of graph structure and textual semantics via collaboration between GNNs and LLMs. At its core, a Graph Attention Network (GAT) integrates structural attention with textual similarity for semantically-aware neighbor selection. This structural context dynamically guides prompt generation for the LLM, incorporating node summaries, label categories, and keywords from relevant neighbors. Unlike prior methods, we jointly optimize GNN and LLM components using contrastive learning and cross-attention to achieve robust, interactive alignment. We focus on three research questions( RQs ):(1)How can graph structure and semantic similarity be effectively incorporated into dynamic prompt generation for early-stage modality fusion?(2) How can bi-directional cross-modal attention be designed to facilitate rich interactions between textual semantics and graph structure for improved node representations?(3)How does the proposed framework enhance robustness and generalization across different real-world scenarios?Based on these questions, we highlight our main contributions: • Dynamic prompting mechanism. We propose a structure-aware dynamic prompting framework that adaptively integrates node texts with selectively filtered neighborhood information based on semantic similarity and structural attention, enabling effective early fusion for node classification and link prediction on text-attributed graphs. • Bi-directional cross-modal attention. We design a dual attention module that facilitates mutual interaction between textual and structural modalities, effectively capturing complementary signals and enhancing node representations. • Contrastive learning for prompt-text alignment. We introduce a multi-view contrastive objective to align raw node texts with dynamically generated prompts, encouraging robust and view-invariant semantic representations. • Extensive evaluation on robustness and transferability. Experiments on six real-world datasets demonstrate the framework’s strong generalization across domains and robustness to structural noise and input perturbations, validating its effectiveness under diverse and challenging conditions. 2 Formalization In this section, we provide formal definitions of TAGs, describe two key tasks—node classification and link prediction—and summarize core modeling principles based on large language models and graph neural networks on TAGs. Text-Attributed Graphs. We study Text-Attributed Graphs (TAGs), defined as \mathcal{G}=(\mathcal{V},\mathcal{E},\mathcal{X}) , where \mathcal{V} is the node set, \mathcal{E} the edge set, and \mathcal{X} the associated node texts. Each node v_{i} has a token sequence \mathbf{X}_{i} . While \mathcal{E} captures graph structure, \mathcal{X} encodes semantic content. We address node classification, learning f:\mathcal{V}\to\mathcal{Y} from partial labels, and link prediction, estimating s:\mathcal{V}\times\mathcal{V}\to\mathbb{R} to infer edges. Joint modelling of structure and text remains challenging. Graph Neural Networks. Graph Neural Networks (GNNs) follow a message-passing framework where node representations \mathbf{h}_{i}^{(k)} at layer k are updated by aggregating neighbor information and applying a nonlinear transformation \sigma(\cdot) [ 14 , 34 ] . \mathbf{h}_{i}^{(k)}=\sigma\left(\mathrm{AGGREGATE}\left(\left\{\mathbf{h}_{j}^{(k-1)}:j\in\mathcal{N}(i)\right\};\mathbf{W}^{(k)}\right)\right), (1) Here, \mathbf{h}_{j}^{(k-1)} is the neighbor j ’s feature from the previous layer, \mathbf{W}^{(k)} a learnable weight matrix, and \mathcal{N}(i) the neighbors of node i . The aggregation function varies across GNNs, including mean, sum, max pooling,etc. [ 7 , 35 , 30 ] . Large Language Models (LLMs) and Language Models (LMs). For each node i with textual attribute x_{i} ,

Read the complete text