STAR: Semantic-Tuned and Tail-Adaptive Retriever for Graph-Augmented Generation

Shuai Li, Chen Huang, Duanyu Feng, Wenqiang Lei, See-Kiong Ng · 2026

Read STAR: Semantic-Tuned and Tail-Adaptive Retriever for Graph-Augmented Generation by Shuai Li, Chen Huang, Duanyu Feng, Wenqiang Lei, See-Kiong Ng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18765.txt.

Introduction

Shuai Li and four co-authors propose STAR, a 2026 retriever for graph generation. Graph retrieval methods often ignore sparse semantics in graphs, producing two biases. STAR pairs token-level interaction learning against Semantic Shortcut Bias with path-weighted contrastive learning against Long-Tail Path Bias. Cross-attention and hard path mining model query and path jointly; tail-adaptive weighting optimizes training. Across benchmarks, STAR beats baselines by retrieval gains of 1 point 8 percent and answering gains of 2 point 2 percent.

Catalog record

CREATORShuai Li, Chen Huang, Duanyu Feng, Wenqiang Lei, See-Kiong Ng
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52111
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.18765

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

STAR: Semantic-Tuned and Tail-Adaptive Retriever for Graph-Augmented Generation Shuai Li, Chen Huang, Duanyu Feng, Wenqiang Lei, See-Kiong Ng Abstract . To augment Large Language Models (LLMs) for multi-hop question answering, a mainstream solution within Graph Retrieval Augmented Generation (GraphRAG) leverages lightweight retrievers to efficiently extract information from a given Knowledge Graph (KG). However, existing methods often overlook the inherent challenge of sparse semantic information in graphs. Specifically, our experiments reveal that these methods produce biased retrieval Semantic Shortcut Bias and Long-Tail Path Bias, leading to inadequate semantic modeling and limited GraphRAG effectiveness. To address these issues, we propose STAR, a semantic-tuned and tail-adaptive retriever for GraphRAG. STAR integrates two key learning paradigms: token-level interaction learning and path-weighted contrastive learning. The former employs a cross-attention architecture and a hard path mining mechanism to jointly model the query and path, thereby mitigating the Semantic Shortcut Bias. The latter introduces a tailored contrastive learning objective that utilizes tail-adaptive path weighting, designed to optimize the training process and ease the Long-Tail Path Bias. Extensive experiments demonstrate that STAR consistently outperforms baselines, achieving average retrieval performance gains of 1.8% and LLM QA performance improvements of 2.2% across all benchmark datasets. Our code is available at https://anonymous.4open.science/r/STAR-C583 . 1. Introduction Traversing a Knowledge Graph (KG) to retrieve nodes has emerged as a prominent method (i.e., GraphRAG) to enhance Large Language Model (LLM) performance in complex, multi-hop reasoning tasks ( 9 ; 20 ) , thereby mitigating hallucinations in web applications ( 23 ) . While prompting a LLM for graph traversal presents an alternative, it is generally associated with substantially increased invocation expenditures and diminished retrieval efficacy ( 13 ; 27 ; 17 ) . In response, employing lightweight modules for retrieving the relevant path on the graph (we term it as Lightweight Retriever ) is gaining increasing attention ( 12 ; 33 ) , marking a seminal shift within GraphRAG research. Figure 1 . Illustrations of semantic shortcut, where a retriever prefers a semantically similar but incorrect relation. Unlike document-oriented retrieval’s rich textual semantics for user queries, lightweight GraphRAG retrievers face the inherent challenge of sparse semantic information in graph. These semantics are often limited to node names (e.g., London ) or sequential path information (e.g., { London, place_of_birth, Charlie Chaplin, place_of_burial, … }). Consequently, a central research objective for lightweight GraphRAG retrievers is to effectively encode richer semantic information from the graph, ensuring accurate traversal for LLM enhancement. To this end, lightweight retriever development has progressed through several stages. Specifically, early approaches applied traditional graph algorithms, such as Breadth-First Search (BFS), for graph traversal ( 15 ; 8 ) , while subsequent studies introduced neural networks like Multi-Layer Perceptrons (MLPs) as scoring functions to model query–path semantic similarity on KGs ( 9 ) . While efficient, these methods offer only a shallow semantic understanding. Consequently, the current dominant paradigm employs Pre-trained Language Models (PLMs) to capture the nuanced semantics embedded within the graph ( 1 ; 19 ; 12 ) , utilizing PLMs as dual encoders, independently encoding the user query and each graph path to optimize their similarity. Despite showing performance improvements, these existing methods still overlook the sparse semantic nature of KGs, leading to unsatisfactory semantic modeling and, consequently, limited system effectiveness. In particular, 1) Semantic Shortcut Bias . The inherent sparse semantic nature of KGs demands a more fine-grained understanding between user queries and graph paths from lightweight retrievers, enabling better utilization of the graph’s available information. Existing methods, by independently encoding queries and paths as isolated wholes to then force similarity learning. This prevents the crucial token-level interactions required for fine-grained logical understanding. Taking Figure 1 for example, given the query ‘ What country does David Luiz play for? ’, since ‘ play for ’ implies club membership, it necessitates to search for the team first (i.e., the relation sports.pro_athlete.teams ) before retrieving the country. However, current methods often rely on superficial semantic similarities. They tend to match ‘ David Luiz ’ with people.person and ‘ country ’ with nationality , directly selecting the logically incorrect relation people.person.nationality . We refer to this error as Semantic Shortcut Bias . This highlights the need for models to perform token-by-token comprehension between query and path to discern subtle contextual differences. 2) Long-Tail Path Bias . The practical usage of semantic information within KGs often exhibits a sparse, highly skewed distribution in user queries. This means a few path types dominate in frequency within many training datasets, while the vast majority appear rarely (Figure 2 ). This frequency-based semantic sparsity introduces an additional challenge for retriever learning. We experimentally show that ignoring this issue causes retrievers to become experts on these common ‘head’ paths but consistently fail on the far more numerous ‘tail’ paths (cf. Section 3 ). This implies compromised robustness and reduced performance on queries that necessitate less frequent paths. Figure 2 . Long-tail distribution of path frequencies. To address these biases,we propose the S emantic-tuned and T ail- A daptive R etriever for GraphRAG ( STAR ), featuring token-level interaction learning and path-weighted contrastive learning to ease the two biases, respectively. Specifically, instead of separately encoded representations, retriever should jointly model the query and path to capture their mutual information, which manifests as token-level interactions. To achieve this, STAR moves beyond separate query-path modeling by employing a single-tower PLM-based architecture. This architecture employs cross-attention to facilitate token-level interactions, thereby capturing fine-grained relational semantics between queries and candidate paths. Then, we follow the idea of hard data mining ( 25 ; 26 ; 10 ) and enhance STAR to learn to distinguish between correct paths and semantically similar yet incorrect distractors (i.e., hard-to-distinguish paths). Subsequently, STAR optimizes this architecture through path-weighted contrastive learning, employing a customized graph context to weight each training path, thereby emphasizing rare, long-tail paths. To further enhance this. As such, STAR offers a unified retrieval solution that captures fine-grained query-path interactions to ease the semantic shortcut, while its path-weighted learning paradigm enhances robustness to skewed long-tail distributions in web-sourced KGs. To evaluate the effectiveness of STAR, we conduct extensive experiments across various benchmark datasets, all derived from web-sourced knowledge graphs that simulate real-world Web interactions. Results demonstrate that STAR consistently outperforms baselines, achieving average retrieval performance gains of 1.8% and LLM QA performance improvements of 2.2% across all evaluated datasets. Further ablation analysis reveals that STAR’s success is attributable to a 50.0% reduction in errors related to the semantic shortcut bias and a 14.1 reduction in those regarding the long-tail path bias. Additionally, we find that STAR is robust across different backbones and LLMs, and adjusting the beam search width further enhances its performance, offering flexibility for diverse applications. In summary, our main contributions are as follows: • We identify and diagnose two critical biases in modern PLM-based lightweight retriever for GraphRAG, leading to unsatisfactory semantic modeling and GraphRAG effectiveness. • We propose STAR, featuring token-level interaction learning and path-weighted contrastive learning to ease the two biases. • We conduct extensive experiments showing STAR achieves state-of-the-art results on web-sourced benchmarks, with analysis confirming it effectively mitigates both identified biases. 2. Related Works Our research is closely tied to the development of lightweight retrievers for GraphRAG, aiming to

Read the complete text