Comparison of Metadata Representation Models for Knowledge Graph Embeddings
Shusaku Egami, Kyoumoto Matsushita, Takanori Ugai, Ken Fukuda · 2025
Read Comparison of Metadata Representation Models for Knowledge Graph Embeddings by Shusaku Egami, Kyoumoto Matsushita, Takanori Ugai, Ken Fukuda (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-21804.txt.
Introduction
Shusaku Egami and co-authors compare in 2025 three ways to write extra context into knowledge graphs, asking which serves embedding based link guessing best. Rich graphs add context such as source and time to plain facts, but the same facts can be encoded by reification, by singleton properties, or by a starred triple style. Past scoring setups could not compare the three fairly.
The team defines a fair new task and a frame that keeps each encoding's shape in the learned space. Tests on two data types show one encoding shines on simple graphs and another lags. On complex graphs the gap nearly vanishes. The results guide how to store rich facts for prediction tools.
Catalog record
| CREATOR | Shusaku Egami, Kyoumoto Matsushita, Takanori Ugai, Ken Fukuda |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-21804
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Comparison of Metadata Representation Models for Knowledge Graph Embeddings Shusaku Egami, Kyoumoto Matsushita, Takanori Ugai, Ken Fukuda Abstract Hyper-relational Knowledge Graphs (HRKGs) extend traditional KGs beyond binary relations, enabling the representation of contextual, provenance, and temporal information in domains, such as historical events, sensor data, video content, and narratives. HRKGs can be structured using several Metadata Representation Models (MRMs), including Reification (REF), Singleton Property (SGP), and RDF-star (RDR). However, the effects of different MRMs on KG Embedding (KGE) and Link Prediction (LP) models remain unclear. This study evaluates MRMs in the context of LP tasks, identifies the limitations of existing evaluation frameworks, and introduces a new task that ensures fair comparisons across MRMs. Furthermore, we propose a framework that effectively reflects the knowledge representations of the three MRMs in latent space. Experiments on two types of datasets reveal that REF performs well in simple HRKGs, whereas SGP is less effective. However, in complex HRKGs, the differences among MRMs in the LP tasks are minimal. Our findings contribute to an optimal knowledge representation strategy for HRKGs in LP tasks. 1 Introduction A Knowledge Graph (KG) is “a graph of data intended to accumulate and convey knowledge of the real world, whose nodes represent entities of interest and whose edges represent potentially different relations between these entities.” [ 1 ] KGs enable the integration of heterogeneous data and representation of semantic relationships. KGs are essential for the development of intelligent systems as technology for structuring and managing large-scale knowledge. They serve as crucial foundational technologies for advancing artificial intelligence by enhancing knowledge retrieval, reasoning and explainability. General KGs, such as DBpedia and Freebase, are typically structured as triples \langle s,p,o\rangle , consisting of a subject s , predicate p , and object o . However, representing knowledge using only simple triples is difficult in some cases. For example, it is often necessary to represent beyond the binary relations of triples in domains where context, provenance, and temporal information are required, such as historical events, sensor data, video content, and narratives. In this paper, we collectively refer to KGs that represent such information as Hyper-Relational Knowledge Graphs (HRKGs). In HRKGs, metadata such as provenance, context, and time must be associated with triples \langle s,p,o\rangle . Several metadata representation models (MRMs) have been proposed for this purpose, including RDF Reification 1 1 1 https://www.w3.org/TR/rdf11-mt/#reification , Singleton Property [ 2 ] , and RDF-star 2 2 2 https://w3c.github.io/rdf-star/cg-spec/editors_draft.html [ 3 ] . Figure 1 shows MRMs. The choice of MRM in HRKG construction is a key consideration because it affects the data management and downstream tasks. Previous benchmarking studies have evaluated aspects such as query execution time, dataset size, and loading time into triple stores for different MRMs [ 4 , 5 ] , contributing to the appropriate choice of knowledge representation strategies for HRKGs. Figure 1: Example of metadata representation models On the other hand, research on KG embedding methods has rapidly advanced in recent years [ 6 ] , and the incorporation of KG embeddings (KGE) is expected to improve the performance of language models [ 7 ] . In future artificial intelligence systems, KGs are expected to evolve beyond their traditional roles as knowledge bases and serve as modules that enhance the latent spaces of language models. Thus, embedding KGs into latent spaces is an important research topic. Although existing studies have evaluated various KG embedding models for link prediction, few evaluations have focused on MRMs. Consequently, the optimal knowledge representation strategy for KG embeddings remains unclear. To date, there has been no KGE model that can be applied to any MRM (especially RDF-star) [ 8 ] , and there are issues of fairness in the evaluation that we point out in this study; therefore, a comprehensive evaluation is still challenging. When embedding knowledge graphs into latent spaces, it is essential not only to improve the KGE models themselves but also to understand how the knowledge representation method affects the performance of downstream tasks. To address this issue, this study constructs multiple datasets by applying different MRMs to HRKGs and evaluates the accuracy of link prediction (LP) using our proposed KGE method, which can be applied to any MRM, and then analyzes the characteristics of each MRM. Specifically, we focus on RDF Reification, the Singleton Property, and the RDF-star model, as in the previous benchmarking [ 9 ] . We conduct experiments using existing HRKG embedding models to identify the problems of typical LP experiments in MRM comparisons (we call these experiments Evaluation Method Diagnosis: EMD) and define a new experimental task that considers fairness in the evaluation. Furthermore, we propose a framework containing KGE and LP models applicable to all three MRMs and conduct evaluation experiments under the defined task to clarify the characteristics of each MRM. In particular, our study provides new insights into RDF-star embeddings, which have not been thoroughly evaluated in previous studies. Our experimental code is available on GitHub 3 3 3 https://github.com/aistairc/MRM-experiments . The contributions of this study are summarized as follows: 1. Through the EMD, we identified issues related to tasks, embedding models, and datasets when applying conventional link prediction methods to knowledge graphs constructed with different MRMs. 2. We constructed a complex HRKG dataset and designed a fair evaluation task across different MRMs. 3. We developed a framework containing KGE and LP models applicable to all MRMs. 4. We conducted evaluation experiments and analyzed datasets and hyperparameters to reveal the characteristics of each MRM. The remainder of this paper is structured as follows. Section 2 introduces MRMs and related works. Section 3 describes EMD to identify the limitations of existing evaluation setups. Section 4 introduces the link prediction task and presents the proposed framework along with the experimental results. Section 5 analyzes and discusses the experimental results. Finally, Section 6 concludes the paper, including a brief summary and future works. 2 Related Work 2.1 Metadata Representation Model This section introduces MRMs, which are the subject of this study. 2.1.1 Reification RDF Reification ( REF) is an MRM natively supported by RDF, where the subject, predicate, and object of a triple are reified to describe additional information. For example, when providing metadata v , such as provenance, for a standard triple \langle s,p,o\rangle , REF allows the following representation in Turtle 4 4 4 https://www.w3.org/TR/turtle/ syntax. Listing 1: Example of Turtle notation for RDF Reification model ⬇ < statement > rdf : type rdf : Statement ; rdf : subject < s > ; rdf : predicate < p > ; rdf : object < o > ; < metadata > < v > . Because REF utilizes the standard RDF notation, the reified data can be stored in any RDF store. 2.1.2 Singleton Property REF has the disadvantages of increasing the number of triples and lengthening the triple patterns in SPARQL queries. To address this issue, the Singleton Property [ 2 ] (referred to as SGP) was proposed as an MRM. In the SGP, the example in Listing 1 is represented as follows: Listing 2: Example of Turtle notation for Singleton Property model ⬇ < s > < p #1> < o > . < p #1> < singletonPropertyOf > < p > ;