A Stepwise-Enhanced Reasoning Framework for Large Language Models Based on External Subgraph Generation

Xin Zhang, Yang Cao, Baoxing Wu, Xinyi Chen, Kai Song, Siying Li · 2025

Read A Stepwise-Enhanced Reasoning Framework for Large Language Models Based on External Subgraph Generation by Xin Zhang, Yang Cao, Baoxing Wu, Xinyi Chen, Kai Song, Siying Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-23356.txt.

Introduction

Xin Zhang and co-authors propose SGR, a framework that steadies large language model reasoning by grounding each step in a knowledge graph. Models answering complex questions often absorb noisy or irrelevant material during generation and drift into confident errors. SGR's response is to build a small external subgraph tailored to the query, pulling relevant entities and relations from a knowledge base before the model starts reasoning.

The model then works through the problem step by step over that structured subgraph, rather than free-associating over raw text. Several reasoning paths are generated and finally integrated into one answer. Across multiple benchmark datasets, the framework consistently beat strong baselines, which the authors attribute to the subgraph filtering out noise and giving each inference step explicit factual footing. The work is aimed at question answering and other tasks where deep, verifiable logical inference matters more than fluency.

Catalog record

CREATORXin Zhang, Yang Cao, Baoxing Wu, Xinyi Chen, Kai Song, Siying Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2512-23356

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Stepwise-Enhanced Reasoning Framework for Large Language Models Based on External Subgraph Generation Xin Zhang, Yang Cao, Baoxing Wu, Xinyi Chen, Kai Song, Siying Li Abstract Large Language Models (LLMs) have achieved strong performance across a wide range of natural language processing tasks in recent years, including machine translation, text generation, and question answering. As their applications extend to increasingly complex scenarios, however, LLMs continue to face challenges in tasks that require deep reasoning and logical inference. In particular, models trained on large scale textual corpora may incorporate noisy or irrelevant information during generation, which can lead to incorrect predictions or outputs that are inconsistent with factual knowledge. To address this limitation, we propose a stepwise reasoning enhancement framework for LLMs based on external subgraph generation, termed SGR. The proposed framework dynamically constructs query relevant subgraphs from external knowledge bases and leverages their semantic structure to guide the reasoning process. By performing reasoning in a step by step manner over structured subgraphs, SGR reduces the influence of noisy information and improves reasoning accuracy. Specifically, the framework first generates an external subgraph tailored to the input query, then guides the model to conduct multi step reasoning grounded in the subgraph, and finally integrates multiple reasoning paths to produce the final answer. Experimental results on multiple benchmark datasets demonstrate that SGR consistently outperforms strong baselines, indicating its effectiveness in enhancing the reasoning capabilities of LLMs. 1 Introduction In recent years, the rapid development of large language models (LLMs) has marked an important milestone in the evolution of artificial intelligence. Through pretraining on massive text corpora, these models are able to generate fluent and high quality textual outputs ( 2 ) . In addition, with further supervised fine tuning, they can effectively adapt to a wide range of downstream natural language processing tasks ( 16 ) . However, despite their strong performance in text generation, LLMs still face clear limitations when applied to complex reasoning scenarios. In particular, although LLMs excel at producing fluent text, they often struggle to maintain logical consistency, which can lead to outputs that deviate from real world facts. Moreover, due to their large number of parameters, the reasoning process of LLMs lacks transparency and interpretability ( 8 ) . To address these challenges, an effective approach is to introduce external knowledge sources, such as knowledge graphs (KGs), into LLMs. Knowledge graphs explicitly represent structured factual knowledge, which can complement the inherent limitations of LLMs ( 9 ) . Previous studies have explored the use of KGs as auxiliary knowledge sources to enhance LLM reasoning capabilities ( 11 ; 24 ) . These methods typically inject KG derived information into the LLM by constructing prompts or providing additional contextual inputs, thereby strengthening the model reasoning process. Beyond knowledge graph augmentation, recent studies have explored combining large language models with symbolic or structural representations to improve systematic generalization and interpretability ( 22 ; 21 ; 18 ) . However, most existing approaches with KG injection rely on fixed or manually designed prompt templates, and they do not fully exploit the structural information contained in knowledge graphs ( 10 ; 23 ) . Based on this observation, we propose a stepwise enhanced reasoning framework for LLMs with external subgraph generation, abbreviated as SGR. The proposed framework leverages schema based subgraph generation from knowledge graphs to accurately extract knowledge relevant to the query. By dynamically constructing external subgraphs, SGR guides LLMs to perform step by step reasoning, thereby reducing the influence of noisy information and improving reasoning accuracy. Furthermore, the framework integrates direct reasoning and combined reasoning strategies to produce the final enhanced reasoning output. Experimental results on multiple benchmark datasets demonstrate that the proposed method achieves superior performance compared to existing approaches. The main contributions of this work can be summarized as follows. • We propose a novel stepwise enhanced reasoning framework that improves the reasoning capability of LLMs by integrating external subgraph generation. The proposed method significantly enhances the ability of LLMs to handle complex multi step reasoning tasks. • We design an interpretable knowledge enhanced reasoning process that improves the transparency and interpretability of LLM reasoning. The reasoning paths and outputs are traceable and verifiable. • Extensive experiments on multiple benchmark datasets validate the effectiveness of the proposed framework and demonstrate its advantage over existing methods. 2 Related Work Knowledge graphs store large amounts of external world knowledge in a structured triple format and are widely used in knowledge representation and reasoning ( 12 ) . In early studies, researchers explored methods for integrating structured knowledge into neural models ( 15 ) . Recent work has focused on enhancing LLMs by injecting KG based knowledge during training or inference, which improves performance across various tasks ( 6 ) . Beyond static knowledge graphs, temporal knowledge graphs have been studied to capture the dynamic evolution of entities and relations over time, enabling more expressive reasoning under temporal constraints ( 19 ; 20 ; 17 ) . However, directly embedding KG knowledge into LLM parameters often leads to increased training costs and reduced flexibility ( 1 ) . To address this issue, recent studies have proposed retrieving relevant knowledge from KGs during inference and using it as additional context for LLMs ( 11 ; 5 ) . These methods can be broadly categorized into retrieval enhanced methods and collaborative enhancement methods. 2.1 Retrieval Enhanced Models The core idea of retrieval enhanced models is to retrieve relevant information from a knowledge source and provide it as input to the language model, thereby assisting the model in generating the final answer ( 11 ) . Jiang et al. proposed a structured reasoning retrieval framework called StructGPT, which integrates iterative reading then reasoning mechanisms ( 10 ) . Related approaches further explore multi hop retrieval and reasoning over structured knowledge to improve answer accuracy ( 4 ; 3 ) . Figure 1: Pipeline of SGR framework. However, retrieval enhanced methods still face several limitations in practical applications. First, the retrieved information may not fully cover the structured reasoning paths provided by the knowledge graph, which can result in incomplete reasoning chains ( 4 ) . Second, excessive retrieved information may introduce noise and overwhelm the model, thereby degrading reasoning performance ( 7 ) . Finally, if the retrieved knowledge contains errors or redundancies, it may negatively affect the final reasoning results ( 14 ) . 2.2 Collaborative Enhanced Models Collaborative enhanced models focus on designing an interaction mechanism between large language models and knowledge graphs. In this paradigm, the language model and the knowledge graph jointly participate in the reasoning process to generate final answers ( 25 ; 26 ) . These methods typically first generate an initial reasoning result using the language model, then leverage the knowledge graph to verify or refine the intermediate reasoning outcomes, and finally produce the enhanced answer. 25 proposed a KG enhanced reasoning framework in which the language model first performs reasoning on a given query, followed by knowledge validation and correction using the knowledge graph. Through iterative interactions between the language model and the knowledge graph, the system gradually improves reasoning accuracy. In contrast to retrieval enhanced models, collaborative enhanced models emphasize bidirectional interaction between the language

Read the complete text