Towards Improving Long-Tail Entity Predictions in Temporal Knowledge Graphs through Global Similarity and Weighted Sampling Journal: TKDD Volume: 1 1 1 1 Price: 15.00 DOI: 00.0000/0000000 DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation e

Mehrnoosh Mirtaheri, Ryan A. Rossi, Sungchul Kim, Kanak Mahadik, Tong Yu, Xiang Chen, Mohammad Rostami · 2025

Read Towards Improving Long-Tail Entity Predictions in Temporal Knowledge Graphs through Global Similarity and Weighted Sampling Journal: TKDD Volume: 1 1 1 1 Price: 15.00 DOI: 00.0000/0000000 DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation e by Mehrnoosh Mirtaheri, Ryan A. Rossi, Sungchul Kim, Kanak Mahadik, Tong Yu, Xiang Chen, Mohammad Rostami (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-18977.txt.

Introduction

Mehrnoosh Mirtaheri and co-authors present a 2025 paper on graphs that change over time. A temporal knowledge graph stores facts with dates, such as who held a post in a given year. Models that fill in missing facts often train on the whole graph at once. Real graphs keep growing, so new items show up with few links. Rare items are hard to predict well.

The team offers a step-by-step training frame for growing graphs. A shared layer can sit on top of any base model. It scores likeness across the whole graph, not just near neighbors. A weighted sampling plan gives rare items more training weight. Tests aim to lift scores for new and sparse items. Graph teams get a plug-in fix rather than a full rebuild. That makes the method easy to try on tools already in use.

Catalog record

CREATORMehrnoosh Mirtaheri, Ryan A. Rossi, Sungchul Kim, Kanak Mahadik, Tong Yu, Xiang Chen, Mohammad Rostami
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE53 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-18977

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Towards Improving Long-Tail Entity Predictions in Temporal Knowledge Graphs through Global Similarity and Weighted Sampling Journal: TKDD Volume: 1 1 1 1 Price: 15.00 DOI: 00.0000/0000000 DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/18/06 CCS: Computing methodologies Learning latent representations CCS: Computing methodologies Knowledge representation and reasoning Mehrnoosh Mirtaheri, Ryan A. Rossi, Sungchul Kim, Kanak Mahadik, Tong Yu, Xiang Chen, Mohammad Rostami Abstract . Temporal Knowledge Graph (TKG) completion models traditionally assume access to the entire graph during training. This overlooks challenges stemming from the evolving nature of TKGs, such as: (i) the model’s requirement to generalize and assimilate new knowledge, and (ii) the task of managing new or unseen entities that often have sparse connections. In this paper, we present an incremental training framework specifically designed for TKGs, aiming to address entities that are either not observed during training or have sparse connections. Our approach combines a model-agnostic enhancement layer with a weighted sampling strategy, that can be augmented to and improve any existing TKG completion method. The enhancement layer leverages a broader, global definition of entity similarity, which moves beyond mere local neighborhood proximity of GNN-based methods. The weighted sampling strategy employed in training accentuates edges linked to infrequently occurring entities. We evaluate our method on two benchmark datasets, and demonstrate that our framework outperforms existing methods in total link prediction, inductive link prediction, and in addressing long-tail entities. Notably, our method achieves a 10% improvement and a 15% boost in MRR for these datasets. The results underscore the potential of our approach in mitigating catastrophic forgetting and enhancing the robustness of TKG completion methods, especially in an incremental training context 1 1 1 Preliminary results of this work are presented in the 2024 ACM on Web Conference ( Mirtaheri et al. 2024 ) . . 1. Introduction Knowledge graphs (KGs) have become foundational tools for structuring and representing multi-relational data, playing a critical role in advancing a wide range of natural language processing (NLP) tasks, such as question answering, information retrieval, and reasoning about complex queries using large language models (LLMs) ( Pan et al. 2023 ) . At their core, KGs encode factual knowledge using a triplet-based schema—comprising subject, relation, and object—that captures relationships between entities in a structured and interpretable manner ( Liang et al. 2022 ) . To capture the temporal dynamics of real-world knowledge, temporal knowledge graphs (TKGs) extend this representation by incorporating time as an additional dimension. This can be broadly categorized into two primary types: semantic KGs, which encode facts valid over time intervals (e.g., roles or attributes that persist), and event-centric TKGs, which capture discrete, timestamped events emphasizing the granularity and recurrence of interactions. Semantic KGs, such as YAGO ( Kasneci et al. 2009 ) , encode facts that persist over specific time intervals—e.g., (Obama, President, United States, 2009–2017) —allowing for reasoning over temporal scopes of entity roles and attributes. In contrast, event-centric TKGs, such as ICEWS ( Boschee et al. 2015 ) , capture discrete events annotated with precise timestamps—e.g., (Obama, meet, Merkel) at distinct dates—emphasizing temporal granularity and the recurrence of interactions. By modeling both enduring relationships and transient events, TKGs offer a more comprehensive framework for understanding how entities and their interactions evolve over time. This temporal dimension is particularly valuable for downstream applications that require temporal reasoning, trend analysis, or historical inference, thereby extending the utility of KGs beyond static knowledge representation. (a) Temporal Knowledge Graph. (b) Incremental updates in the graph. Figure 1 . Illustration of the Temporal Knowledge Graph and its incremental updates. A significant limitation of both traditional knowledge graphs (KGs) and temporal knowledge graphs (TKGs) is their inherent incompleteness, which hampers the effectiveness of downstream tasks such as link prediction, reasoning, and entity alignment. While advances in automatic knowledge extraction have led to improved KG coverage, the issue of missing or incomplete facts remains pervasive and problematic. This limitation is especially pronounced in real-world KGs derived from dynamic and continuously evolving data sources, such as live news streams, social media, or sensor networks. In these scenarios, new facts are generated in real time, often accompanied by a temporal context and introduce previously unseen entities and relations, thereby compounding the challenge of maintaining an up-to-date and coherent KG (Figure 1 ). To address these challenges, a large body of research has focused on knowledge graph completion (KGC) ( Wang et al. 2022 ; Huang et al. 2022 ; Shen et al. 2022 ) , with particular emphasis on temporal KGC methods that model time-aware representations by leveraging historical interaction patterns ( Jin et al. 2019 ; Zhu et al. 2020 ; Sun et al. 2021 ) . These approaches typically encode temporal dependencies and trends to infer plausible missing links across different time steps. However, a major limitation of many existing methods is the unrealistic assumption of full graph observability during training. In practice, this assumption fails to accommodate two key challenges inherent to real-world TKGs: (i) handling shifts in the entity distribution, such as the frequent emergence of new entities or the sporadic reappearance of previously seen ones, and (ii) enabling continual or incremental integration of new facts without catastrophic forgetting of previously acquired knowledge. Addressing these issues is crucial for the development of robust and scalable TKG systems capable of operating in non-stationary, streaming environments. Effective solutions must strike a balance between adaptability to new information and retention of long-term knowledge, calling for methods that support dynamic updates, continual learning, and generalization to previously unseen entities and relations. Conventional TKG completion methods predominantly rely on static embedding tables, where each entity observed during training is assigned a learned vector representation ( Jin et al. 2019 ; Wu et al. 2020 ) . This design introduces an important limitation: entities that are unseen during training cannot be represented, as no pre-initialized embedding exists for them. Consequently, models built on this architecture are unable to make predictions involving such entities at inference time—a drawback in real-world applications, where new entities continuously emerge in evolving temporal data streams. To mitigate this issue, some approaches have incorporated Graph Neural Network (GNN) architectures that aim to dynamically infer embeddings for unseen entities by aggregating information from their temporal neighborhoods. However, the effectiveness of these methods is often constrained by the sparsity and limited connectivity of new entities, which restricts the amount of contextual information available for embedding construction. As a result, inferred embeddings for such entities tend to be noisy or insufficiently informative, leading to suboptimal performance in downstream tasks. Despite the importance of this challenge, only a handful of studies explicitly evaluate their models under an inductive link prediction setting—where test-time queries involve entities that were not present during training ( Han et al. 2020b ; Sun et al. 2021 ) . Even fewer propose architectural innovations specifically designed to enhance representation learning and predictive accuracy for these previously unseen entities. The lack of focus on this inductive generalization capability leaves a critical gap in the development of truly robust and adaptable TKG models capable of operating in open-world environments. The challenges extend beyond the scope of representation learning to

Read the complete text