Knowledge Distillation for Temporal Knowledge Graph Reasoning with Large Language Models
Wang Xing, Wei Song, Siyu Lin, Chen Wu, Zhesi Li, Man Wang · 2026
Read Knowledge Distillation for Temporal Knowledge Graph Reasoning with Large Language Models by Wang Xing, Wei Song, Siyu Lin, Chen Wu, Zhesi Li, Man Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-00202.txt.
Description
Wang Xing leads five coauthors in shrinking temporal knowledge graph reasoners with help from large language models. Such graphs store facts that change over time. Reasoning over them supports smart decision systems. Top models, though, are large and power hungry. That blocks use on small or low power devices. Older compression tricks target static graphs instead.
Their framework uses a large model as the teacher. It guides a small student through distillation. Public knowledge and task specific time data are combined. The student learns both structure and temporal patterns. Its design stays compact and cheap to run. Tests on public benchmarks beat strong baselines. Accuracy, speed, and deployability land in a good balance. For engineers, the work shows time aware distillation is possible. The temporal signal need not be lost in compression.
Catalog record
| CREATOR | Wang Xing, Wei Song, Siyu Lin, Chen Wu, Zhesi Li, Man Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 25 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-00202