SAGE: Scale-Aware Gradual Evolution for Continual Knowledge Graph Embedding Conference: Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 3–7, 2025; Toronto, ON, Canada Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining
Yifei Li, Lingling Zhang, Hang Yan, Tianzhe Zhao, Zihan Ma, Muye Huang, Jun Liu · 2025
Read SAGE: Scale-Aware Gradual Evolution for Continual Knowledge Graph Embedding Conference: Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 3–7, 2025; Toronto, ON, Canada Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining by Yifei Li, Lingling Zhang, Hang Yan, Tianzhe Zhao, Zihan Ma, Muye Huang, Jun Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-11347.txt.
Introduction
Yifei Li and six co-authors wrote a 2025 paper on SAGE, a framework for keeping knowledge graph embeddings current as the graph grows. Knowledge graphs store facts as linked entities and relations. Their vector embeddings are usually trained on a frozen snapshot, yet real graphs gain new facts constantly. Retraining from scratch is wasteful, but naive updates forget old knowledge.
SAGE first sizes the embedding space to the scale of each update, expanding dimensions when growth is large. A dynamic distillation step then balances keeping learned knowledge against absorbing new facts. Across seven benchmarks, SAGE beat existing continual methods, improving a key ranking score by 1.38 percent. The authors also evaluate performance across the whole update process, not just at the end. The work targets real-world graphs that change at uneven rates.
Catalog record
| CREATOR | Yifei Li, Lingling Zhang, Hang Yan, Tianzhe Zhao, Zihan Ma, Muye Huang, Jun Liu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-11347
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SAGE: Scale-Aware Gradual Evolution for Continual Knowledge Graph Embedding Conference: Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2; August 3–7, 2025; Toronto, ON, Canada Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 (KDD ’25), August 3–7, 2025, Toronto, ON, Canada DOI: 10.1145/3711896.3737115 ISBN: 979-8-4007-1454-2/2025/08 CCS: Computing methodologies Knowledge representation and reasoning Yifei Li, Lingling Zhang, Hang Yan, Tianzhe Zhao, Zihan Ma, Muye Huang, Jun Liu Abstract . Traditional knowledge graph (KG) embedding methods aim to represent entities and relations in a low-dimensional space, primarily focusing on static graphs. However, real-world KGs are dynamically evolving with the constant addition of entities, relations and facts. To address such dynamic nature of KGs, several continual knowledge graph embedding (CKGE) methods have been developed to efficiently update KG embeddings to accommodate new facts while maintaining learned knowledge. Nonetheless, most existing methods treat updates uniformly, as KGs grow at different rates and scales in real-world applications, these methods often fail to consider the varying scales of updates and lack systematic evaluation throughout the entire update process. In this paper, we propose SAGE, a scale-aware gradual evolution framework for CKGE. Specifically, SAGE firstly determines the embedding dimensions based on the update scales and expands the embedding space accordingly. The Dynamic Distillation mechanism is further employed to balance the preservation of learned knowledge and the incorporation of new facts, enabling stable knowledge evolution over time. We conduct extensive experiments on seven benchmarks, and the results show that SAGE consistently outperforms existing baselines, with a notable improvement of 1.38% in MRR, 1.25% in H@1 and 1.6% in H@10. Furthermore, experiments comparing SAGE with methods using fixed embedding dimensions show that SAGE achieves optimal performance on every snapshot, demonstrating the importance of adaptive embedding dimensions in CKGE. 1. Introduction Knowledge Graph Embedding (KGE) encodes entities and relations in knowledge graphs (KGs) as low-dimensional vectors, preserving their semantics ( Bordes et al. 2013 ; Rossi et al. 2021 ) . These embeddings enable various KG-based applications, such as question answering ( Dong et al. 2023 ) , recommendation ( Wang et al. 2019a ) , and semantic search ( Xiong et al. 2017 ) . However, most KGE methods only focus on static KGs, assuming a fixed graph structure for training, while real-world KGs are dynamically evolving as new entities, relations, and facts are added. For example, DBpedia, a wildely-used KG, has added more than 1 million entities, 2,000 relations, and 20 million triples between 2016 and 2018 ( Lehmann et al. 2015 ) . Such dynamism challenges traditional KGE methods, which require costly and impractical retraining from scratch to handle frequent updates in evolving KGs. To overcome such limitations, continual knowledge graph embedding (CKGE) has emerged to incrementally update KG embeddings by integrating newly added knowledge while preserving learned representations ( Cui et al. 2023 ; Liu et al. 2024a ; Liu et al. 2024b ) . Recent advances in CKGE predominantly focus on mitigating catastrophic forgetting, a persistent training dilemma wherein the acquisition of novel knowledge substantially undermines the integrity of learned representations, through various effective strategies like embedding transfer ( Cui et al. 2023 ) , knowledge distillation ( Liu et al. 2024a ) , and parameter-efficient optimization ( Liu et al. 2024b ) . These methods effectively enhance computational efficiency and maintain semantic consistency across KG updates, avoiding retraining from scratch. Despite their effectiveness, existing methods merely consider the importance of individual facts but ignore the impact of varying update scales of evolving KGs, which can range from minor changes to substantial growth. For instance, in an e-commerce platform, the applied KGs may either grow in frequent but small-scale updates, such as the daily addition of new users, or evolve in large-scale changes when incorporating entirely new marketplaces. This diversity in update scales necessitates CKGE methods to possess dynamic adaptability while ensuring robust preservation of learned knowledge, thereby introducing additional challenges. Motivated by the scaling laws in deep learning which demonstrate that an increase in the number of model parameters requires more data to achieve better performance ( Kaplan et al. 2020 ; Zhang et al. 2024a ; Droppo and Elibol 2021 ) , we investigate the potential connection between KG scale and embedding dimensions. Our preliminary experiments, as illustrated in Figure 1 , reveal that the optimal embedding dimension (marked by red stars) shows a strong correlation with graph size, where achieving peak performance requires progressively larger dimensions as the graph expands. This empirical finding suggests the limited embedding capabilities of CKGE methods that employ fixed embedding dimensions. Given this dimensional bottleneck, it’s essential to design adaptive parameter adjustment strategies that dynamically align embedding dimensions with the evolving KG across different learning stages. Considering existing parameter adjustment approaches, which tend to focus on stage-specific patterns when allocating parameters, such as selectively activating different parts of the model ( Chen and Yang 2024 ; Zhang et al. 2024b ) , their localized design inherently limits knowledge transfer between different learning stages. Thus, addressing these two interconnected challenges - adaptive dimension adjustment and effective cross-stage knowledge transfer - is pivotal to advance CKGE methods. Figure 1. Effect of embedding dimensions on different KG scales. The 3D histogram visualises the embedding performance across different dimensions and scales, with red stars marking the maximum MRR value along the embedding dimensions for each scale. To this end, we propose an S cale- A ware G radual E volution framework, called SAGE , which is designed to dynamically update model parameters to accommodate the continual growth of evolving KGs. By leveraging scalable mechanisms and efficient data utilization, SAGE effectively balances knowledge retention and adaptation in evolving graphs. To begin with, SAGE firstly evaluates the scale of the updated graph and generate footprints to capture the importance and effectiveness of entities and relations, guiding subsequent stages. Then, a lightweight dimension expansion mechanism are proposed for parameter expansion, which utilize existing embeddings as input features for the expanded dimensions. Combined with replaying a small subset of challenging samples, SAGE efficiently preserves semantic consistency between original and expanded representations. To enhance learning efficiency, training is performed exclusively on the newly added triples, guided by the footprints generated in the first step. These footprints dynamically adjust the distillation intensity for old entities and relations, enabling the model to strike a better balance between preserving prior knowledge and integrating new information. Extensive experiments show that our method effectively retains prior knowledge, adapts to new facts, and handles large-scale evolving KGs with minimal data. In summary, our contributions are as follows: • We explore the impact of dynamically growing parameters in CKGE tasks, demonstrating that aligning model capacity with the scale of graph updates enhances continual learning performance. • We introduce SAGE, a framework that adaptively expands its model size to accommodate evolving KGs. Through its light-weighted adaptive update paradigm and two-stage update strategy, SAGE effectively maintains the balance between preserving existing knowledge and incorporating new information. • Through extensive experiments on CKGE datasets with different growth patterns, SAGE achieves competitive results. In particular, SAGE consistently delivers optimal results at nearly every intermediate stage, achieving notable improvements in this aspect compared to existing approaches. To