Large Language Models Meet Knowledge Graphs for Question Answering: Synthesis and Opportunities
Chuangtao Ma, Yongrui Chen, Tianxing Wu, Arijit Khan, Haofen Wang · 2025
Read Large Language Models Meet Knowledge Graphs for Question Answering: Synthesis and Opportunities by Chuangtao Ma, Yongrui Chen, Tianxing Wu, Arijit Khan, Haofen Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20099.txt.
Introduction
Ma, Chen, Wu, Khan, and Wang wrote in twenty twenty-five a survey of combining large language models with knowledge graphs for question answering. Language models answer fluently but can reason poorly, use stale facts, and invent details. Knowledge graphs store facts as linked nodes, which can ground those answers. Recent systems mix the two in many different ways. The survey proposes a taxonomy sorted by question type and by the graph's role. It compares leading methods on strengths, limits, and graph needs.
The authors match each approach to the challenges of complex questions. They summarize progress, scoring metrics, and benchmark data sets across the field. Open problems and chances for new work close the survey. The map should help builders pick the right blend for their task. It also shows where hybrid systems still fall short.
Catalog record
| CREATOR | Chuangtao Ma, Yongrui Chen, Tianxing Wu, Arijit Khan, Haofen Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 59 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-20099
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Large Language Models Meet Knowledge Graphs for Question Answering: Synthesis and Opportunities Chuangtao Ma, Yongrui Chen, Tianxing Wu, Arijit Khan, Haofen Wang Abstract Large language models (LLMs) have demonstrated remarkable performance on question-answering (QA) tasks because of their superior capabilities in natural language understanding and generation. However, LLM-based QA struggles with complex QA tasks due to poor reasoning capacity, outdated knowledge, and hallucinations. Several recent works synthesize LLMs and knowledge graphs (KGs) for QA to address the above challenges. In this survey, we propose a new structured taxonomy that categorizes the methodology of synthesizing LLMs and KGs for QA according to the categories of QA and the KG’s role when integrating with LLMs. We systematically survey state-of-the-art methods in synthesizing LLMs and KGs for QA and compare and analyze these approaches in terms of strength, limitations, and KG requirements. We then align the approaches with QA and discuss how these approaches address the main challenges of different complex QA. Finally, we summarize the advancements, evaluation metrics, and benchmark datasets and highlight open challenges and opportunities. 1 Introduction Question answering (QA) plays a fundamental role in artificial intelligence, natural language processing, information retrieval, and data management areas since it has a wide range of applications, such as text generation, chatbots, dialog generation, web search, entity linking, natural language query, fact-checking, etc. The pre-trained language models (PLMs) and recent LLMs have shown superior performance in several QA tasks such as KBQA (Knowledge bases QA), KGQA (Knowledge graph QA), CDQA (Closed domain QA), etc. However, PLM and LLM-based methods are incapable of handling complex QA scenarios due to the following limitations. (1) Limited complex reasoning capability: LLMs encapsulate very limited reasoning capability since they have been pre-trained with the tasks of predicting the next word in a text sequence. (2) Lack of up-to-date and domain-specific knowledge: LLMs are incapable of generating accurate and up-to-date responses for domain-specific QA because they have been pre-trained on the data and knowledge with a cutoff date. (3) Tendency to generate hallucinated content: LLMs usually generate hallucinated content due to the lack of factual verification and logical consistency checking. Challenges. Retrieval augmented generation (RAG) ( Mao et al., 2021 ) was proposed for open-domain QA by retrieving the relevant contexts from large documents, and several techniques, such as graph neural networks (GNNs) ( Li et al., 2025b ) , have been investigated to enhance the retrieval coverage from passages. Although RAG-based QA can generate better responses in comparison to NoRAG-based QA, it still has limited capability for knowledge reasoning and understanding user interactions during complex QA. Complex QA usually involves knowledge interactions and fusion among data across modalities and sources, and an excellent understanding of complex queries and user interactions, whereas the RAG-based QA suffers a lot from the following technical challenges. (1) Knowledge conflicts: Conflicts occur due to the fusion of inconsistent and overlapping knowledge between LLMs and external sources in RAG-based QA that may further tend to generate inconsistent answers. (2) Poor relevance and quality of retrieved context: The accuracy of the generated answers in RAG-based QA largely depends on the relevance and quality of the retrieved context, where irrelevant context leads to incorrect results. (3) Lack of iterative and multi-hop reasoning: RAG-based QA struggles to generate accurate and explainable answers for questions requiring global and summarized contexts due to a lack of iterative. The emergence of synthesizing LLMs+KGs provides a unique opportunity to address the above challenges and limitations of LLMs for knowledge-intensive tasks, e.g., complex QA ( Ma et al., 2025a ) . The graph retrieval augmented generation (GraphRAG) ( Zhang et al., 2025 ; Peng et al., 2024 ; Han et al., 2024 ) and knowledge graph retrieval augmented generation (KG-RAG) ( Sanmartin, 2024 ; Yang et al., 2024 ) have demonstrated the strengths of unifying LLMs with KGs for complex QA. These GraphRAG and KG-RAG based QA approaches introduce several modules, such as knowledge integration and fusion, reasoning guidelines, and knowledge validation and refinement, to mitigate the above challenges. Motivation. In recent years, a rapidly increasing number of works on synthesizing LLMs and KGs for QA have been conducted to achieve complex QA under open-domain and long-context settings. This survey aims to address the aforementioned limitations by outlining the recent progress in integrating LLMs with KGs for complex QA, summarizing technical advances, and identifying open challenges and future research opportunities. Our survey differs from the existing surveys ( details in Appendix § A.1 ), it provides a comprehensive overview of the recent advancements of QA from the perspective of the roles of KGs when synthesizing LLMs and KGs for complex QA. Taxonmy. We categorize the methodology of synthesizing LLMs and KGs and complex QA from different perspectives, and a structured taxonomy ( details in Appendix § B ) is given in Figure 1 . The taxonomy from different perspectives aims to highlight the alignments between various LLM+KG approaches and different complex QA by discussing how the LLM+KG approaches with different roles of KG can address the challenges of complex QA. Notably, these categories, divided from different perspectives, are non-exclusive, where a work might be classified into multiple categories from different perspectives. {forest} Figure 1: A Structured Taxonomy of Synthesizing LLMs and KGs for QA. Contributions. Considering the popularity and mainstream adoption of both LLMs and KGs, and their wide applications in QA, our survey is timely. The contributions of this work are summarized below. (1) We introduce the structured taxonomy that categorizes state-of-the-art (SOTA) works on synthesizing LLMs+KGs for QA. (2) We review the SOTA works on synthesizing LLMs and KGs for QA in various categories and discuss the recent advanced topics in this field. (3) We create the alignments between various approaches in synthesizing LLMs and KGs and complex QA, and highlight how these approaches address the specific challenges of different complex QA; (4) We discuss the current challenges and opportunities in synthesizing LLMs and KGs for QA. The online resources of this survey are available on Github 1 1 1 https://github.com/machuangtao/LLM-KG4QA . 2 Complex QA Complex QA usually involves question decomposition, knowledge fusion among data across modalities and sources, where complex knowledge reasoning is required to generate accurate answers. The methodology in synthesizing LLMs and KGs for complex QA has been exploited as follows. 2.1 Multi-document QA Multi-document QA refers to the QA over contexts from multiple documents, while efficiently and effectively retrieving the relevant knowledge from multiple contexts is the main technical challenge. To reduce the retrieval latency and improve the quality of the retrieved context for multi-document QA, KGP ( Wang et al., 2024d ) introduces an LLM-based graph traversal agent for retrieving relevant knowledge from KG. Similarly, CuriousLLM ( Yang and Zhu, 2025 ) integrates a knowledge graph prompting, reasoning-infused LLM agent, and graph traversal agent to augment LLMs for multi-document QA. VisDom ( Suri et al., 2024 ) introduces a novel multimodal RAG for multi-document question answering by integrating and fusing the multi-modal knowledge and leveraging the (Chain-of-thought) CoT-based reasoning. 2.2 Multi-modal QA Multi-modal QA refers to the QA over multi-modal data, and visual QA (VQA) is one of the typical multi-modal QA. To retrieve the most relevant knowledge from the external KG for enhancing VQA,