PathISE : Learning Informative Path Supervision for Knowledge Graph Question Answering
Shengxiang Gao, Chao Lei, Jey Han Lau, Jianzhong Qi · 2026
Read PathISE : Learning Informative Path Supervision for Knowledge Graph Question Answering by Shengxiang Gao, Chao Lei, Jey Han Lau, Jianzhong Qi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-10791.txt.
Introduction
Shengxiang Gao and colleagues give PathISE, a plan for learning useful path hints for knowledge graph question answering. Training good find models tends to need top-notch middle hints such as question-tied paths or subgraphs, which cost much time and funds to get.
PathISE brings in a light transformer-based guess tool that rates how much a link path tells, to build fake path-level hints from answer-level tags alone. These hints are boiled down into a language-model path maker, whose made paths are tied to the knowledge graph to give tight proof for step-by-step answer thought. Wide tests on three sets show PathISE hitting top or best question answering scores, with reuse hints that lift old models. It needs no dear language-model-tuned hints.
Catalog record
| CREATOR | Shengxiang Gao, Chao Lei, Jey Han Lau, Jianzhong Qi |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 63104 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.10791
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
PathISE : Learning Informative Path Supervision for Knowledge Graph Question Answering Shengxiang Gao, Chao Lei, Jey Han Lau, Jianzhong Qi Abstract Knowledge Graph Question Answering (KGQA) aims to answer user questions by reasoning over Knowledge Graphs (KGs). Recent KGQA methods mainly follow the retrieval-augmented generation paradigm to ground Large Language Models (LLMs) with structured knowledge from KGs. However, training effective models to retrieve question-relevant evidence from KGs typically requires high-quality intermediate supervision signals, such as question-relevant paths or subgraphs, which are time- and resource-intensive to obtain. We propose PathISE , a novel framework for learning high-quality intermediate supervision from answer-level labels. PathISE introduces a lightweight transformer-based estimator that estimates the informativeness of relation paths to construct pseudo path-level supervision. This supervision is then distilled into an LLM path generator, whose generated paths are grounded in the KG to provide compact evidence for inductive answer reasoning. ExtensiveISE experiments on three KGQA benchmarks show that PathISE achieves competitive or state-of-the-art KGQA performance, and provides reusable supervision signals that can enhance existing KGQA models, without relying on costly LLM-refined supervision signals. Our source code is available at https://anonymous.4open.science/r/PathISE-2F87 . 1 Introduction Knowledge Graph Question Answering (KGQA) aims to answer users’ natural language questions by reasoning over Knowledge Graphs (KGs) [ 16 , 31 ] . Modern large-scale KGs, such as Freebase [ 1 ] , Wikidata [ 36 ] , and WikiMovies [ 32 ] , store abundant factual knowledge in structured formats. KGQA provides a user-friendly interface for accessing such knowledge [ 9 ] , and has been widely applied in various domains, including search engines [ 5 ] , fact-checking [ 7 ] , and recommender systems [ 37 ] . Recent advances in Large Language Models (LLMs) have opened new opportunities for KGQA. Pretrained on large-scale corpora, LLMs such as GPT-4 [ 30 ] , Gemini [ 4 ] , LLaMA [ 8 ] , and Qwen [ 42 ] possess extensive world knowledge and strong capabilities in natural language understanding and generation. With advanced generalizability and in-context learning abilities, LLMs have achieved strong performance across a wide range of natural language processing tasks [ 41 , 39 ] , including summarization [ 15 ] , code generation [ 17 ] , and question answering [ 43 ] . These capabilities make LLMs a promising backbone for KGQA, where they can interpret complex questions, plan reasoning over structured knowledge, and generate answers in natural language. A prominent line of KGQA research augments LLMs with KG knowledge through Retrieval-Augmented Generation (RAG) [ 18 ] , commonly referred to as KG-RAG. Existing KG-RAG methods [ 19 , 29 , 44 , 25 , 34 , 6 , 22 ] retrieve question-relevant KG components (e.g., entities, triples, paths, or subgraphs), and incorporate them into the generation context. By grounding reasoning with structured KG knowledge, these approaches reduce hallucinations and improve answer faithfulness [ 31 ] . The effectiveness of KG-RAG methods largely depends on whether the retrieved KG components provide sufficient and relevant information for answering the question [ 19 , 25 ] . Therefore, state-of-the-art (SOTA) KG-RAG methods typically train graph retrievers or path generators to obtain question-relevant KG knowledge. Graph retrievers score and rank KG components, such as triples or subgraphs, whereas path generators produce relation paths as plans for fetching KG evidence. However, training such models typically requires intermediate supervision, such as supporting triples, reasoning paths, or subgraphs. This exposes a fundamental challenge: the lack of high-quality intermediate supervision signals . Obtaining these annotations is time- and resource-intensive, making intermediate supervision rarely available in practice [ 9 , 22 , 20 ] . This has motivated recent KGQA research to explore alternative training paradigms without annotated intermediate supervision. A common alternative is to train retrievers or generators using weakly supervised paths [ 19 , 24 , 25 , 27 ] , where all paths connecting the entities mentioned in the question to the ground-truth answers in the training samples are treated as positive intermediate supervision signals. Although this strategy is straightforward to implement, the example in Figure 1 illustrates that many of these weakly supervised paths are spurious paths , namely paths that are irrelevant to the underlying reasoning process despite being connected to the ground-truth answer. These spurious paths introduce noise into the supervision signals, thereby degrading retrieval accuracy and ultimately compromising reasoning correctness. To reduce the noise introduced by spurious paths, recent studies [ 44 , 40 , 23 ] use LLMs to refine intermediate paths for training models. In these studies, LLMs are instructed to select question-relevant informative paths from weakly supervised path candidates, or to search for informative paths through step-by-step reasoning over the KG. The resulting LLM-refined paths are then used as intermediate supervision signals for training models, thereby substantially reducing the noise in intermediate supervision. However, constructing LLM-refined supervision typically requires extensive LLM calls across training instances, which introduces substantial computational costs and limits scalability for large-scale KGQA datasets (analyzed in Section 5.3 ). Figure 1 : An illustration of supervision signals for models in KG-RAG: (a) A training sample with input question (yellow box), question entity (blue box), and ground-truth answer (orange box). (b) Existing KG-RAG models trained with weakly supervised signals include spurious paths , i.e., incorrect/irrelevant paths that reach the ground-truth answer. (c) Our PathISE framework uses a novel MIL estimator to identify informative paths , yielding more precise path-level supervision. To address the lack of informative and computationally scalable supervision signals in KGQA, we introduce PathISE ( Path -level I nformative S upervision E stimation), a novel framework for learning informative path-level intermediate supervision from answer-level labels. Instead of training models with noisy paths or relying on LLM-refined supervision, PathISE treats paths as latent intermediate supervision and estimates their informativeness through a Multiple Instance Learning (MIL) paradigm. The resulting high-informativeness paths serve as pseudo path-level supervision, mitigating the noise introduced by spurious paths without requiring costly LLM interventions. PathISE instantiates this idea with a lightweight transformer-based MIL estimator. The estimator scores candidate relation paths according to their estimated utility for answering a given question, and selects high-scoring paths as pseudo path-level supervision. This pseudo supervision can be applied to KGQA models that rely on intermediate supervision, including graph retrievers and path generators. In this work, we use it to train an LLM-based relation path generator , enabling the generator to produce more precise and informative relation paths from a question and its entities. At inference time, the generated paths are grounded in the KG to retrieve compact KG evidence, which is then provided to an LLM to support KG-grounded inductive reasoning without fine-tuning. The main contributions of this work are summarized as follows: • We propose PathISE , a novel framework for learning high-quality path-level intermediate supervision from answer-level labels, avoiding both noisy supervision from spurious paths and costly LLM-based supervision refinement. • We introduce a lightweight transformer-based MIL estimator that learns relation path informativeness from answer-level labels to constructs high-quality path-level supervision. • We conduct extensive experiments on three KGQA benchmarks and show PathISE achieves strong performance compared with SOTA baselines. Further experiments demonstrate the applicability of PathISE -estimated supervision for enhancing existing KGQA models. 2 Related Work KGQA.