ProKG-Dial: Progressive Multi-Turn Dialogue Construction with Domain Knowledge Graphs
Yuanyuan Liang, Xiaoman Wang, Tingyu Xie, Lei Pan · 2025
Read ProKG-Dial: Progressive Multi-Turn Dialogue Construction with Domain Knowledge Graphs by Yuanyuan Liang, Xiaoman Wang, Tingyu Xie, Lei Pan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-01869.txt.
Introduction
Yuanyuan Liang and three co-authors present a 2025 paper on building multi-turn dialogue data for specialist chatbots. Large language models handle general talk well but lack precision in fields like medicine. Training them needs quality domain dialogues, which are costly to write by hand or simulate. Their framework, ProKG-Dial, builds dialogues from a domain knowledge graph, a structured web of facts and relations.
The framework first splits the graph into tight topic clusters. For each cluster it grows a question-and-answer chain around a chosen entity, then filters for quality. Tested on a medical graph, the dialogues scored well on diversity, coherence, and coverage of the graph. A base model fine-tuned on the data beat several baselines in automatic and human judging. The authors present the method as a cheaper route to specialized conversational systems.
Catalog record
| CREATOR | Yuanyuan Liang, Xiaoman Wang, Tingyu Xie, Lei Pan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-01869
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ProKG-Dial: Progressive Multi-Turn Dialogue Construction with Domain Knowledge Graphs Yuanyuan Liang, Xiaoman Wang, Tingyu Xie, Lei Pan Abstract Current large language models (LLMs) excel at general NLP tasks but often lack domain-specific precision in professional settings. Building a high-quality, domain-specific multi-turn dialogue dataset is essential for developing specialized conversational systems. However, existing methods—such as manual annotation, simulated human-LLM interactions, and role-based LLM dialogues—are resource-intensive or suffer from limitations in dialogue quality and domain coverage. To address these challenges, we introduce ProKG-Dial , a progressive framework for constructing knowledge-intensive multi-turn dialogue datasets using domain-specific knowledge graphs (KGs). ProKG-Dial leverages the structured nature of KGs to encode complex domain knowledge and relationships, providing a solid foundation for generating meaningful and coherent dialogues. Specifically, ProKG-Dial begins by applying community detection to partition the KG into semantically cohesive subgraphs. For each subgraph, the framework incrementally generates a series of questions and answers centered around a target entity, ensuring relevance and coverage. A rigorous filtering step is employed to maintain high dialogue quality. We validate ProKG-Dial on a medical knowledge graph by evaluating the generated dialogues in terms of diversity, semantic coherence, and entity coverage. Furthermore, we fine-tune a base LLM on the resulting dataset and benchmark it against several baselines. Both automatic metrics and human evaluations demonstrate that ProKG-Dial substantially improves dialogue quality and domain-specific performance, highlighting its effectiveness and practical utility. A : I’m evaluating my investment portfolio , but recent interest rate hikes have me concerned. How might this affect my bond holdings ? B : Rising interest rates typically cause bond prices to fall, especially for long-duration bonds . Have you considered shifting towards shorter maturities to reduce interest rate risk ? A : That makes sense. What about equity investments —should I be worried about volatility in the financial sector ? B : Volatility can be higher in that sector during rate hikes. Diversifying into defensive stocks or sectors less sensitive to rate changes, like utilities or consumer staples , might help balance your risk. A : Understood. Also, my advisor suggested increasing my exposure to emerging market equities . Given the current geopolitical tensions and currency fluctuations , is this advisable? B : Emerging markets offer growth potential but come with higher political and currency risks . It’s important to evaluate your risk tolerance and consider hedging strategies or limiting allocation accordingly. A : Thanks, that helps clarify. Lastly, should I adjust my asset allocation to account for inflation expectations ? B : Yes, inflation can erode real returns. Incorporating inflation-protected securities or commodities may help preserve purchasing power. Regularly reviewing your portfolio in light of macroeconomic trends is key. A : Got it. I’ll discuss these adjustments with my advisor. Thanks for your insights! Figure 1: An example of a domain-specific multi-turn dialogue in finance, where green represents the user’s questions, blue the responses, and red highlights key domain terms. 1 Introduction Multi-turn dialogue is an interactive process that involves multiple rounds, where the user asks questions and receives responses from the model in each round. As shown in 1 , the interaction between the user and the model can focus on a specific domain, such as the financial field, with multiple rounds of question-and-answer exchanges. In each round, the model provides targeted responses and adjusts its strategy based on the preceding information. Current LLMs possess powerful general-purpose natural language processing capabilities, enabling them to efficiently perform tasks such as text generation, question answering, and language translation [ 11 , 31 ] . However, when handling professional conversations in specific domains, they may encounter knowledge gaps or generate responses that lack precision [ 13 , 19 ] . This is primarily because these models are typically trained on extensive general-purpose corpora, with insufficient coverage of in-depth specialized knowledge in specific fields. For instance, conversations in domains such as medicine, law, or finance often involve technical terminology, complex reasoning, and domain-specific background knowledge [ 26 ] . General-purpose language models may struggle to accurately understand users’ intentions or generate responses that meet industry standards. Moreover, domain-specific dialogues often exhibit continuity and contextual dependency, requiring the model to retain and utilize prior information to respond appropriately to subsequent questions [ 3 ] . However, general models may lose context in multi-turn conversations, leading to responses that lack coherence or logical consistency. Therefore, to build a conversational system that truly meets the needs of specialized domains, it is essential to collect and construct multi-turn dialogue datasets specific to the target domain. Currently, three common methods are used to construct multi-turn dialogue datasets: first, manual annotation; second, dialogues between humans and LLMs in simulated scenarios; and third, assigning different roles to multiple LLMs to engage in conversations on specific topics [ 6 ] . The first two methods require domain experts, which not only demands substantial human and material resources but also incurs significant time costs. While these approaches ensure a certain level of professionalism, their applicability and efficiency are limited by their dependence on expert knowledge. The third method, while not reliant on domain experts, faces challenges in effectively controlling dialogue quality. Without sufficient supervision mechanisms, it becomes difficult to guarantee the accuracy and professionalism of the content. Furthermore, all three methods share a common limitation: they struggle to ensure that the generated data comprehensively covers the knowledge of a specific domain, which results in gaps in both the breadth and depth of knowledge within the dialogue data. Additionally, the agent’s responses often become overly long and complex, increasing the cognitive load on the user [ 12 ] . In some specialized fields, KGs are commonly used to model complex data relationships, integrate information, and perform knowledge reasoning, such as in healthcare, finance, recommendation systems, and search engines [ 19 , 4 ] . These fields often involve large amounts of specialized knowledge and complex structured information, which require the powerful capabilities of KGs to effectively organize and reason about information [ 33 , 24 ] . KGs serve as a surrogate for expert knowledge by encoding domain expertise into structured triples, thus replacing part of the manual effort typically required for dialogue design. To address these limitations, we leverage domain-specific KGs as structured alternatives to manual expertise. KGs encode rich domain knowledge through entities and relationships, enabling automatic guidance for dialogue generation and reducing dependence on human effort. By modeling the semantics of professional fields, KGs help large language models produce accurate, coherent, and knowledge-grounded multi-turn dialogues while significantly lowering human and material costs. Building on this, we propose a framework for constructing knowledge-intensive multi-turn dialogue datasets driven by domain-specific KGs, enhancing professionalism, coverage, and reasoning quality to improve domain-specific conversational systems. The process begins with community partitioning of the domain KG to identify subgraphs of tightly connected entities and relations [ 16 , 5 ] . This step divides the KG into smaller, cohesive regions, facilitating focused analysis on relevant areas. Community partitioning not only uncovers potential domain features but also reveals latent relationships, providing a precise foundation for downstream analysis and question generation. Within each subgraph, a target entity is selected as a starting point, and an incremental approach generates a series of closely related questions and answers