KG2QA: Knowledge Graph-enhanced Retrieval-Augmented Generation for Communication Standards Question Answering
Zhongze Luo, Weixuan Wan, Qizhi Zheng, Yanhong Bai, Jingyun Sun, Jian Wang, Dan Wang · 2025
Read KG2QA: Knowledge Graph-enhanced Retrieval-Augmented Generation for Communication Standards Question Answering by Zhongze Luo, Weixuan Wan, Qizhi Zheng, Yanhong Bai, Jingyun Sun, Jian Wang, Dan Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-07037.txt.
Introduction
Zhongze Luo, Weixuan Wan, and co-authors build a question answering system for communication standards that leans on a knowledge graph, in work from twenty twenty-five. Standards pile up fast, and expert consultation is slow. Their system grounds a tuned language model in structured facts.
The team built over sixty-five hundred question pairs from international recommendations and fine tuned a mid sized model, which then far outscored its base form. A graph of nearly fourteen thousand entities and relations was drawn from the texts with model help. In the pipeline, the tuned model pulls graph facts before answering. A judge model rated the grounded answers better on five counts. A web platform and API ship with the system.
Catalog record
| CREATOR | Zhongze Luo, Weixuan Wan, Qizhi Zheng, Yanhong Bai, Jingyun Sun, Jian Wang, Dan Wang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 47 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-07037
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
KG2QA: Knowledge Graph-enhanced Retrieval-Augmented Generation for Communication Standards Question Answering Zhongze Luo, Weixuan Wan, Qizhi Zheng, Yanhong Bai, Jingyun Sun, Jian Wang, Dan Wang Abstract There are many types of standards in the field of communication. The traditional consulting model has a long cycle and relies on the knowledge and experience of experts, making it difficult to meet the rapidly developing technological demands. This paper combines the fine-tuning of large language models with the construction of knowledge graphs to implement an intelligent consultation and question-answering system for communication standards. The experimental results show that after LoRA tuning on the constructed dataset of 6,587 questions and answers in the field of communication standards, Qwen2.5-7B-Instruct demonstrates outstanding professional capabilities in the field of communication standards on the test set. BLEU-4 rose from 18.8564 to 66.8993, and evaluation indicators such as ROUGE also increased significantly, outperforming the fine-tuning effect of the comparison model Llama-3-8B-Instruct. Based on the ontology framework containing 6 entity attributes and 10 relation attributes, a knowledge graph of the communication standard domain containing 13,906 entities and 13,524 relations was constructed, showing a relatively good query accuracy rate. The intelligent consultation and question-answering system enables the fine-tuned model on the server side to access the locally constructed knowledge graph and conduct graphical retrieval of key information first, which is conducive to improving the question-answering effect. The evaluation using DeepSeek as the Judge on the test set shows that our RAG framework enables the fine-tuned model to improve the scores at all five angles, with an average score increase of 2.26%. And combined with web services and API interfaces, it has achieved very good results in terms of interaction experience and back-end access, and has very good practical application value. Keywords: Large language models; LoRA fine-tuning; domain-limited knowledge graph; retrieval-augmented generation; communication standards 1 Introduction The rapid advancement of technology in the communication sector has led to an exponential increase in communication standards. Traditionally, consulting these standards requires significant expertise and manual intervention, often involving extensive periods for information retrieval and interpretation. Such conventional methods are inefficient and unable to keep pace with rapid technological developments, necessitating smarter, more automated approaches for consulting and knowledge management. Recent developments in artificial intelligence, particularly Large Language Models, have demonstrated remarkable capabilities in understanding and generating human-like text across general domains [ 37 ] . However, their performance in specialized fields, like communication standards, remains limited due to the sparse representation of specialized terminologies and domain-specific knowledge in pre-training datasets. To address this limitation, fine-tuning methodologies such as Low-Rank Adaptation have been employed, significantly enhancing the semantic comprehension and contextual accuracy of LLMs in niche areas [ 5 , 6 , 42 ] . Complementing LLMs, knowledge graphs offer a structured approach to represent complex, interconnected domain-specific knowledge [ 7 , 8 ] . Particularly in narrowly defined domains, such as communication standards, domain-specific knowledge graphs facilitate efficient and precise information retrieval. By constructing a carefully designed ontology structure and leveraging LLMs for entity and relationship extraction, high-accuracy knowledge graphs can be established, markedly improving retrieval performance [ 38 , 39 ] . In this paper, we proposed a novel integration framework, termed KG2QA, which combines domain-specific knowledge graphs and fine-tuned LLMs using Retrieval-Augmented Generation methodologies. Our approach enhances intelligent consulting services by achieving precise and swift query responses, enriched by structured domain-specific knowledge. Experimental results demonstrate substantial improvements in query accuracy, response speed, and overall user interaction experience compared to traditional and general-purpose AI consulting methods. In summary, the main contributions are as follows: 1) Perform efficient domain adaptation of LLMs using LoRA fine-tuning for communication standards QA tasks. 2) Construct a structured knowledge graph for communication standards based on LLM-assisted triple extraction. 3) Develop a RAG-based question answering system integrating the fine-tuned LLM with the domain-specific knowledge graph. 4) Provide a fully open-sourced, reproducible pipeline for domain-specific QA in communication standards. Figure 1: The overall architecture of KG2QA 2 Related Works 2.1 Domain-specific large language models Since the emergence of Chat-GPT [ 19 ] , large language models have witnessed a development boom in recent years. They can help researchers carry out their work more efficiently and have demonstrated unprecedented performance in many fields. Several of the most frequently used large language models for general domains at present, such as Deepseek [ 16 ] , Gemini [ 17 ] , Llama [ 18 ] , etc., can play important roles in multiple fields such as natural language processing tasks, reasoning, medical applications, ethics, education, natural sciences and social sciences, and agent applications. Although there have been the development of large models for limited fields in recent years [ 9 ] , especially in fields such as Chinese law [ 14 ] and medicine [ 20 ] , which have shown considerable potential and advantages, no large language model has been developed for the specific field of communication standards, in order to bring users a more personalized and professional consulting experience in the field of communication standards. In the field of 6G communication, Jiang et al. [ 1 ] proposed a multi-agent system named CommLLM. By integrating the capabilities of retrieval, planning, evaluation and reflection, it significantly enhanced the application potential of large language models in 6G communication, and its effectiveness was verified through the case of a semantic communication system. However, the research results of this team are only limited to 6G networks and are not applicable to all communication standards. 2.2 Domain-specific Knowledge graphs Knowledge graph is a structured knowledge representation method that can effectively represent the relationships between entities through nodes and edges [ 7 ] . In the past, the application fields of knowledge graphs were mostly in the open domain [ 21 ] . The knowledge graphs in the open domain mainly use the world’s common knowledge to describe the types of real-world entities that occur frequently and their relationships. In recent years, as the problems dealt with by researchers have become more diverse, complex and vertical, part of the interest in the research field of knowledge graphs has shifted from the open domain to specific domains [ 22 , 23 ] . In recent years, knowledge graphs have been widely applied in multiple fields [ 11 ] . Especially in domain-specific applications, knowledge graphs can provide rich semantic information to help models better understand and generate text. Such as forestry knowledge graphs [ 13 ] , law knowledge graphs [ 10 ] , and educational knowledge graphs [ 11 ] . These knowledge graphs typically describe entities and their relationships within a specific domain. Yu et al. [ 3 ] constructed a knowledge graph in the legal field, providing rich knowledge support for the task of generating legal texts by integrating legal provisions, cases and related literature. The knowledge graph of the limited domain is different from the knowledge graph of the open domain [ 24 , 25 ] . Its focus is not on depicting the complex relationships among entities in a wide domain, but on the structured expression of knowledge within a specific domain. A complete confined domain knowledge graph can help complete tasks such as knowledge discovery, intelligent decision support, and professional question answering within