GenIC: An LLM-Based Framework for Instance Completion in Knowledge Graphs

Amel Gader, Alsayed Algergawy · 2025

Read GenIC: An LLM-Based Framework for Instance Completion in Knowledge Graphs by Amel Gader, Alsayed Algergawy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-24036.txt.

Introduction

Amel Gader and Alsayed Algergawy complete knowledge graphs with language models in a 2025 paper. A knowledge graph stores facts as triples of head, relation, and tail. Instance completion starts from a lone head entity and must guess both the relation and the tail. Modern graphs carry text descriptions and type labels for entities, which hold clues that older methods ignore.

Their framework, GenIC, works in two steps. First it predicts which properties an entity should have, treated as a multi-label sorting task. Then it generates the missing tail as a sequence task. Language models read the descriptions and learn schema patterns to guide both steps. Tests on three data sets beat existing baselines. Code is shared openly.

Catalog record

CREATORAmel Gader, Alsayed Algergawy
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-24036

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

GenIC: An LLM-Based Framework for Instance Completion in Knowledge Graphs Amel Gader, Alsayed Algergawy Abstract Knowledge graph completion aims to address the gaps of knowledge bases by adding new triples that represent facts. The complexity of this task depends on how many parts of a triple are already known. Instance completion involves predicting the relation-tail pair when only the head is given (h, ?, ?). Notably, modern knowledge bases often contain entity descriptions and types, which can provide valuable context for inferring missing facts. By leveraging these textual descriptions and the ability of large language models to extract facts from them and recognize patterns within the knowledge graph schema, we propose an LLM-powered, end-to-end instance completion approach. Specifically, we introduce GenIC: a two-step Gen erative I nstance C ompletion framework. The first step focuses on property prediction, treated as a multi-label classification task. The second step is link prediction, framed as a generative sequence-to-sequence task. Experimental results on three datasets show that our method outperforms existing baselines. Our code is available at https://github.com/amal-gader/genic . [email protected] [email protected] keywords Knowledge Graph Completion Instance Completion Large Language Models 1 Introduction Knowledge graphs are integral to various downstream applications, including question answering [ chakraborty2021introduction ] [ saxena2020improving ] , recommender systems [ guo2020survey ] , and more recently, enhancing the predictions and interpretability of large language models [ pan2024unifying ] . Given their critical role in these applications, improving the quality of knowledge graphs is crucial. A key metric for evaluating this quality is completeness. Unfortunately, all knowledge graphs suffer from varying degrees of incompleteness. For instance, in Wikidata , one of the largest knowledge bases, only 0.5% of football players have a high completeness rate (>96% average completeness) [ balaraman2018recoin ] . This issue has led to a plethora of research initiatives focused on the task of knowledge graph completion. Knowledge graph completion comprises four main related tasks: Link prediction which involves predicting either the tail entity or the head entity when given the relation and one other component (i.e predicting the tail given the head and relation (h, r, ?) or predicting the head given the relation and tail (?, r, t)). Relation prediction focuses on identifying the relation between a given head and tail entity (h, ?, t). Whereas instance completion takes on a greater challenge by predicting both the relation and the tail entity given only the head (h, ?, ?). More recently a new task entitled Triple set prediction [ zhang2024start ] has emerged, aiming to achieve the ultimate goal of fully automating knowledge graph completion by predicting entire triples (?, ?, ?) without any predefined components or predicates. In this paper, we focus on the task of instance completion, which treats a fact or triplet as an instance. In this context, the given head entity serves as an incomplete sentence that we aim to complete. We argue that the instance completion task is a realistic and practical approach, as it requires only one known component of the triplet. This makes it particularly useful for entities with few connections or sparse associated facts. Our primary goal is to leverage the rich textual information embedded within knowledge graphs, such as descriptions and entity types, by transforming the instance completion task into a natural language processing problem. Specifically, we take the first step to solve this task using, as the foundation, pre-trained language models. Our method adopts a two-step pipeline: first, property prediction is treated as a multi-label classification problem, and second, link prediction is modeled as a sequence-to-sequence task, following the approach of [ xie2022discrimination ] . 2 Related Work Knowledge Graph completion seeks to enhance knowledge bases by adding missing facts. Numerous studies have addressed this task through various approaches, including link prediction, relation prediction, and instance completion. A growing body of research leverages pretrained large language models to tackle KG completion. In the following, we provide a brief overview of related work, focusing specifically on instance completion, as well as recent work that employs LLMs to enrich KGs. 2.1 Instance Completion The task of instance completion involves associating a relation-tail pair with a given head entity. One notable approach for this task is RETA [ rosso2021reta ] , which predicts relation-tail pairs for a head entity in two steps. First, a filter identifies potential relation-tail candidate pairs by leveraging schema information from knowledge graphs, generating possible triplet-type combinations and their frequencies. In the second step, these predicted triplets are ranked using schema patterns and structural information through a language embedding model. OKELE [ cao2020open ] is another instance completion solution, comprising three steps. It begins with an attention-based GNN model for property prediction, followed by link prediction using external web sources. Lastly, a probabilistic approach is employed for fact verification. Unlike our method, which focuses on internal entity linking within the knowledge base, OKELE enriches knowledge by incorporating external web data. 2.2 LLMs for Knowledge Graphs KG-BERT [ yao2019kg ] was the first to approach triple plausibility as a sequence classification task using pretrained language models. It has been applied to tasks such as triple classification, relation prediction, and link prediction, achieving state-of-the-art results. However, KG-BERT requires negative sampling and ranks all entities to identify the best candidates, which is computationally expensive and resource-intensive. To address these limitations, GenKG [ xie2022discrimination ] generates only the top-k candidate entities through entity-aware hierarchical decoding, significantly reducing computational overhead. KEPLER [ wang2021kepler ] proposes a unified model that combines the rich textual information from knowledge graphs with their structural and relational facts. It achieves this by jointly training a knowledge embedding model and a masked language model, optimizing both objectives simultaneously. KG-LLM [ shu2024knowledge ] leverages large language models to enhance multi-hop link prediction by transforming knowledge graph paths into natural language prompts. These prompts describe the sequence of relations between interconnected nodes in the graph. By following the provided instructions, the model infers the interrelations and identifies missing links, effectively predicting paths between entities based on the structure of the knowledge graph. For further exploration of large language model (LLM)-enhanced knowledge graphs, we refer the reader to this relevant survey [ pan2024unifying ] . 3 Method 3.1 Overview of the proposed approach A knowledge graph \mathcal{G}=(\mathcal{E},\mathcal{R},\mathcal{F},\mathcal{C},\mathcal{D}) is a knowledge structured representation consisting of entities, relations, and facts. Each fact f\in\mathcal{F} is a triplet in the form (h,r,t)\in\mathcal{E}\times\mathcal{R}\times\mathcal{E} , where h (head) and t (tail) are elements from the set of entities \mathcal{E} and r (relation) is an element from the set of relations \mathcal{R} . Entities can be associated with a type or class c\in\mathcal{C} and a textual description d\in\mathcal{D} , where \mathcal{C} and \mathcal{D} represent the sets of categories and descriptions corresponding to the entities within the knowledge graph. Traditional knowledge graph embedding models do not make advantage of \mathcal{C} and \mathcal{D} , our goal in this paper is to leverage this information through pretrained language models to solve the instance completion task. A straightforward approach to solving the instance completion problem is to evaluate all possible relation-tail combinations for a given head. The number of candidates for each head theoretically scales with |\mathcal{R}|\times|\mathcal{E}| , where |\mathcal{R}| represents the number of relations and |\mathcal{E}| the number of entities in

Read the complete text