SocraticKG: Knowledge Graph Construction via QA-Driven Fact Extraction
Sanghyeok Choi, Woosang Jeon, Kyuseok Yang, Taehyeong Kim · 2026
Read SocraticKG: Knowledge Graph Construction via QA-Driven Fact Extraction by Sanghyeok Choi, Woosang Jeon, Kyuseok Yang, Taehyeong Kim (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-10003.txt.
Introduction
Sanghyeok Choi, Woosang Jeon, Kyuseok Yang, and Taehyeong Kim build webs of facts from raw text. A fact web links things by typed ties. Such webs back search and smart tools. AI built webs face a hard trade off.
Cast the net wide and the web breaks into loose bits. Pull it tight too soon and facts are lost. The team made SocraticKG to ease that trade. It first turns a text into pairs of asks and replies. Those pairs lay out the sense of the text. Only then does it pull out the typed ties. The step keeps more facts while the web stays joined.
Catalog record
| CREATOR | Sanghyeok Choi, Woosang Jeon, Kyuseok Yang, Taehyeong Kim |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 46 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-10003
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SocraticKG: Knowledge Graph Construction via QA-Driven Fact Extraction Sanghyeok Choi, Woosang Jeon, Kyuseok Yang, Taehyeong Kim Abstract Constructing Knowledge Graphs (KGs) from unstructured text provides a structured framework for knowledge representation and reasoning, yet current LLM-based approaches struggle with a fundamental trade-off: factual coverage often leads to relational fragmentation, while premature consolidation causes information loss. To address this, we propose SocraticKG, an automated KG construction method that introduces question-answer pairs as a structured intermediate representation to systematically unfold document-level semantics prior to triple extraction. By employing 5W1H-guided QA expansion, SocraticKG captures contextual dependencies and implicit relational links typically lost in direct KG extraction pipelines, providing explicit grounding in the source document that helps mitigate implicit reasoning errors. Evaluation on the MINE benchmark demonstrates that our approach effectively addresses the coverage-connectivity trade-off, achieving superior factual retention while maintaining high structural cohesion even as extracted knowledge volume substantially expands. These results highlight that QA-mediated semantic scaffolding plays a critical role in structuring semantics prior to KG extraction, enabling more coherent and reliable graph construction in subsequent stages. 1 Introduction Figure 1: The overall architecture of the SocraticKG framework. Given unstructured text, the method first generates atomic QA pairs through 5W1H-guided questioning, then extracts triples from these QA pairs, and finally canonicalizes the triples to produce a cohesive knowledge graph. As large language models (LLMs) are widely used in knowledge-intensive applications, concerns surrounding factual reliability, interpretability, and grounding have become more pronounced ( 20 ; 19 ) . While Retrieval-Augmented Generation (RAG) addresses these concerns by anchoring models to external sources, it often struggles with fragmented contexts and shallow integration of complex facts ( 22 ; 16 ) . In response, Knowledge Graphs (KGs) have re-emerged as a complementary solution, providing a structured and verifiable backbone for explicit knowledge representation and reasoning ( 31 ; 32 ) . However, the reliance on manual curation has historically limited the availability of domain-specific KGs, thereby motivating growing interest in automated construction methods that can scale to diverse and large-scale text sources ( 33 ) . Recent advances in LLMs have enabled more semantically grounded approaches to knowledge graph construction, moving beyond rule-based pattern matching toward methods that leverage neural reasoning to interpret unstructured text ( 41 ) . Current approaches address the construction challenge through different strategies. Some methods focus on capturing explicit factual mentions in a single pass, extracting triples directly from text ( 7 ; 34 ; 39 ) . Others adopt consolidation-centric strategies, organizing extracted facts around pre-identified entity structures to improve graph coherence ( 40 ; 37 ; 35 ; 26 ) . However, these approaches face a persistent challenge: fully externalizing the narrative logic of source documents into structured graphs. The resulting knowledge graphs often struggle with a fundamental tension between factual coverage and structural coherence. Graphs may contain many facts but remain fragmented with weak semantic connectivity, or they may be well-organized yet incomplete, having filtered out contextual nuances that do not conform to predefined structures. At the core of this challenge lies the difficulty of balancing comprehensive information extraction with meaningful connectivity across the graph. To address this limitation, we draw inspiration from how humans naturally process and organize information from text. Rather than attempting to extract structured knowledge in a single step, human comprehension is fundamentally interrogative: readers construct understanding by progressively clarifying salient concepts through active inquiry ( 17 ; 1 ) . This process of interrogative learning serves as a natural scaffold for organizing complex information. Question-Answering (QA), in particular, facilitates focused attention and explicit articulation of relationships that might otherwise remain implicit in direct extraction ( 36 ) . Building on this insight, we propose SocraticKG (SoKG), a method that treating QA not merely as a retrieval mechanism, but as a structured intermediate representation that systematically unfolds document-level semantics prior to graph construction ( 15 ; 10 ) . SoKG employs a structured interrogative framework based on the 5W1H framework ( who , what , when , where , why , and how ) to generate document-grounded QA pairs that capture key concepts, relationships, and contextual dependencies. This QA-mediated expansion articulates implicit connections and contextual nuances in explicit natural language format. The resulting intermediate representation facilitates more consistent and complete triple extraction by providing well-defined semantic units rather than requiring simultaneous resolution of semantics and structure. These extracted triples are then unified through a canonicalization process ( 26 ) that resolves surface-form variations and consolidates the graph into a coherent structure. We evaluate our proposed method on the MINE (Measure of Information in Nodes and Edges) benchmark ( 26 ) , a recently proposed benchmark designed to measure factual recoverability from automatically constructed knowledge graphs. Our results demonstrate that SocraticKG consistently outperforms state-of-the-art counterparts across multiple LLM backbones, achieving superior factual retention while producing more densely connected and less fragmented graphs. By reconciling factual coverage with structural coherence, SoKG provides a scalable approach for high-fidelity KG construction and more reliable structured reasoning. In summary, we make the following contributions in this work: • We propose SocraticKG, a QA-mediated method for knowledge graph construction that formalizes question-answering as a semantic scaffold for unfolding document narratives and explicitly articulating implicit connections prior to structural extraction. • We introduce 5W1H-guided QA expansion as a systematic approach for surfacing latent dependencies typically overlooked in direct extraction, thereby improving factual coverage while reducing implicit reasoning errors. • We demonstrate that our approach mitigates structural fragmentation and information loss, achieving superior factual retention and recoverability across various LLMs. 2 Related Work 2.1 Direct Triple Extraction Knowledge Graph (KG) construction has evolved from conventional Open Information Extraction (OpenIE) ( 13 ; 14 ) to modern approaches that extract triples directly via LLMs ( 7 ; 5 ; 39 ) . While OpenIE is constrained by surface linguistic patterns ( 28 ) , such direct extraction methods leverage LLM reasoning capabilities to bridge semantic gaps without explicit intermediate representations. However, this direct extraction approach often limits the model to capturing surface-level, explicit mentions while overlooking the latent logical ties that bind them. As noted by 41 ; 25 , this approach often yields shallow factual coverage, often producing fragmented subgraphs that lack the connectivity required for effective graph-based reasoning. 2.2 Consolidation-Centric Strategies To address the fragmentation issues, various pipelines emphasize structural coherence through post-extraction consolidation. These entity-first approaches organize extracted facts by first identifying key entities, then structuring relations around this pre-established entity framework. GraphRAG ( 12 ) builds a global index of entities and relationships partitioned into hierarchical communities for query-focused summarization, whereas KGGen ( 26 ) emphasizes clustering-based canonicalization of entities and relations to produce compact and reusable knowledge graphs. Similarly, CLARE ( 18 ) anchors its relational extraction on initial entity identification to ensure semantic precision within consolidated text. Despite their effectiveness in organizing triples, these consolidation-focused strategies strategies can act as a representational bottleneck ( 38 ) . When entity sets are fixed early in the pipeline, relations or contextual dependencies that do not conform to the initial entity structure may be excluded. This sequencing effectively prioritizes structural utility over factual density, potentially under-representing the document’s latent relations. 2.3 Transform-Then-Extract Approaches To reduce extraction complexity, various approaches employ