Temporal Reasoning over Evolving Knowledge Graphs
Junhong Lin, Song Wang, Xiaojie Guo, Julian Shun, Yada Zhu · 2025
Read Temporal Reasoning over Evolving Knowledge Graphs by Junhong Lin, Song Wang, Xiaojie Guo, Julian Shun, Yada Zhu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-15464.txt.
Introduction
Junhong Lin leads a team that helps language models reason over facts that change over time. Facts can be stored in a knowledge graph, a web of linked items. Most tools treat that web as fixed, yet real facts shift and clash. The team build a system that both reasons over time and keeps the web fresh.
Their reasoner grounds items in both broad and local views, splits a query into routes, and scores answers by time. A second part updates the graph from raw text, settles clashes by trust scores, and tracks trends. Tests on time based question sets show the system beats plain prompts and older graph tools. It also narrows the gap between small and large models.
Catalog record
| CREATOR | Junhong Lin, Song Wang, Xiaojie Guo, Julian Shun, Yada Zhu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-15464
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Temporal Reasoning over Evolving Knowledge Graphs Junhong Lin, Song Wang, Xiaojie Guo, Julian Shun, Yada Zhu Abstract Large language models (LLMs) excel at many language understanding tasks but struggle to reason over knowledge that evolves. To address this, recent work has explored augmenting LLMs with knowledge graphs (KGs) to provide structured, up-to-date information. However, many existing approaches assume a static snapshot of the KG and overlook the temporal dynamics and factual inconsistencies inherent in real-world data. To address the challenge of reasoning over temporally shifting knowledge, we propose EvoReasoner , a temporal-aware multi-hop reasoning algorithm that performs global-local entity grounding, multi-route decomposition, and temporally grounded scoring. Furthermore, to ensure that the underlying KG remains accurate and up-to-date, we introduce EvoKG , a noise-tolerant KG evolution module that incrementally updates the KG from unstructured documents through confidence-based contradiction resolution and temporal trend tracking. We evaluate our approach on temporal QA benchmarks and a novel end-to-end setting where the KG is dynamically updated from raw documents. Our method outperforms both prompting-based and KG-enhanced baselines, effectively narrowing the gap between small and large LLMs on dynamic question answering. Notably, an 8B-parameter model using our approach matches the performance of a 671B model prompted seven months later. These results highlight the importance of combining temporal reasoning with KG evolution for robust and up-to-date LLM performance. Our code is publicly available at github.com/junhongmit/TREK . 1 Introduction Recent years have seen growing interest in combining large language models (LLMs) with knowledge graphs (KGs) to improve factual reasoning and knowledge coverage [ 21 , 15 ] . Generally, this line of research aims to address a core limitation of LLMs: they are trained on static corpora and struggle to adapt to emerging knowledge efficiently. By interacting with structured KGs and utilizing their knowledge, LLMs can better handle complex reasoning tasks and answer queries involving up-to-date or structured knowledge [ 27 , 9 ] . Despite these advances, many existing KG-augmented approaches [ 24 , 4 , 19 , 26 ] rely on a static snapshot of the KG (e.g., downloaded dump of Freebase [ 2 ] and Wikidata [ 25 ] ), overlooking the temporal dynamics of evolving knowledge and factual noise inherent in real-world knowledge. In many cases, temporal metadata is treated as auxiliary information rather than a core signal for inference [ 3 , 31 ] . Our analysis in Figure 1 illustrates the limitations of reasoning over static knowledge graphs in scenarios involving temporally evolving or shifting information. This is demonstrated using a question answering (QA) benchmark [ 32 ] , where most queries require reasoning over either slowly or rapidly changing facts. As further shown in Figure 1 , (1) For questions that require slow-changing facts , the prompting-based method (e.g., IO Prompt) performs well, as internal model knowledge is often sufficient, and the inclusion of noisy or contradictory facts from the evolving KG can degrade performance in static-graph reasoning methods like Plan-on-Graph (PoG) [ 4 ] . (2) For questions that require fast-changing facts , LLMs struggle due to outdated internal knowledge, while graph-based reasoning methods benefit from explicit KG updates. However, these models offer only limited gains, as they lack temporal awareness and are not designed to reason over evolving knowledge. Figure 1: Question answering performance grouped by the required knowledge types in the benchmark [ 32 ] . These limitations stem from two challenges underlying knowledge evolution: 1. Contradiction and Noise in Static Knowledge. KG facts subject to exclusivity constraints (e.g., birth date, primary affiliation) can be contradicted by newly added or conflicting information during updates. This necessitates robust contradiction resolution strategies that account for context, source reliability, and temporal cues, rather than treating all assertions as equally valid. 2. Evolving Trends in Temporal Knowledge. Non-exclusive facts (e.g, jobs, events) naturally evolve over time, yet existing methods frequently overlook temporal ordering, limiting their effectiveness on time-sensitive queries. Nevertheless, addressing these challenges demands more than improved reasoning: it requires a unified solution that jointly performs temporal reasoning and maintains a consistent, evolving knowledge graph. We propose a unified framework that integrates a multi-hop temporal reasoning algorithm with a temporal-aware, noise-tolerant KG evolution mechanism (illustrated in Figure 2 ). Unlike prior works that treat KG retrieval as a static augmentation layer, our approach tightly couples temporal reasoning with dynamic KG construction and updating. It consists of two key components: (i) EvoReasoner , a temporal multi-hop reasoning algorithm that performs multi-route decomposition, global-local entity grounding, and temporal-aware scoring, and (ii) EvoKG , a noise-tolerant KG evolution method that constructs and updates the graph from unstructured documents. EvoKG applies confidence-based contradiction resolution and temporal trend tracking to maintain robustness and consistency over time. In experiments, we evaluate EvoReasoner on temporal question answering (QA) benchmarks and a novel end-to-end setting where EvoKG dynamically updates the KG from raw documents. By integrating missing or updated facts, our framework significantly enhances LLM reasoning, outperforming state-of-the-art KG and LLM-only methods with gains of up to 23.3% in temporal reasoning and 8% in evolving KG tasks. Notably, our approach closes the gap between small and large models . For example, a compact LLaMA 3.1–8B [ 6 ] model, trained in December 2023 and run on a single consumer GPU, improves from 18.6 to 37.0% after KG updates, comparable to directly prompting a much larger 671B DeepSeek-V3 [ 17 ] model (38.3%) trained seven months later. This further highlights the effectiveness of our proposed EvoKG framework in improving the reasoning accuracy of LLMs. Our contributions can be summarized as follows: • Temporal reasoning method. We introduce EvoReasoner , the first method that combines multi-route decomposition, context-informed global search, and temporal-aware local exploration to enhance LLM reasoning over evolving knowledge graphs. Unlike prior work, EvoReasoner enables precise temporal grounding and robust multi-hop inference under ambiguous or time-sensitive conditions, leading to significantly improved reasoning accuracy. • Temporal KG evolution method. We propose EvoKG , a KG construction and update method that resolves factual contradictions and models the temporal progression of non-static facts. This enables the KG to remain accurate and consistent over time, supporting reliable reasoning in dynamic real-world scenarios. • Evaluation across static and temporal dimensions. We evaluate our method on temporal QA benchmarks and a novel end-to-end setting where KGs are updated from raw documents, allowing us to assess the reasoning capability in a temporal setting and how knowledge evolution contributes to downstream QA performance. Our method consistently outperforms both LLM-only and KG-based reasoning baselines across all settings. 2 Preliminaries Definition 1 (Attributed Knowledge Graph) An attributed knowledge graph is a directed graph {\mathcal{G}}=({\mathcal{V}},{\mathcal{E}},{\mathcal{A}},{\mathcal{R}},{\mathcal{P}}) , where each node v\in{\mathcal{V}} and each edge e\in{\mathcal{E}} has a type given by \tau(v):{\mathcal{V}}\rightarrow{\mathcal{A}} and \phi(e):{\mathcal{E}}\rightarrow{\mathcal{R}} , respectively. In addition, each node and edge is associated with a property map \pi:{\mathcal{V}}\cup{\mathcal{E}}\rightarrow{\mathcal{P}} , where {\mathcal{P}} denotes the space of key-value pairs. These property maps allow nodes and edges to store arbitrary attributes in the form of a hashmap. Problem Formulation. Let {\mathcal{G}}_{t}=({\mathcal{V}}_{t},{\mathcal{E}}_{t},\pi_{t}) denote the KG at time t , where \pi_{t} stores attribute metadata for nodes and edges, including temporal information. Each edge e\in{\mathcal{E}}_{t} may be associated with a temporal validity interval [\tau_{\text{start}}(e),\tau_{\text{end}}(e)]\subseteq\mathbb{R}\cup\{\bot\} , where \bot denotes an unknown or open-ended temporal boundary, indicating when the