Time-R1: Towards Comprehensive Temporal Reasoning in LLMs

Zijia Liu, Peixuan Han, Haofei Yu, Haoru Li, Jiaxuan You · 2025

Read Time-R1: Towards Comprehensive Temporal Reasoning in LLMs by Zijia Liu, Peixuan Han, Haofei Yu, Haoru Li, Jiaxuan You (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-13508.txt.

Introduction

Zijia Liu and co-authors train a mid-sized language model to reason about time in depth, in a 2025 paper. Large models handle facts well but stumble on time: they mix up past order, forecast poorly, and rarely invent sound future scenes. Past fixes trained one narrow skill at a time and broke on new ground. The team sought one frame for the whole span of time sense.

Their system, Time-R1, learns in three stages with rewards set by clear rules. It first masters event order in past data, then learns to predict events past its knowledge cutoff. A third stage frees it to craft fresh future scenes with no extra training. The small model beat rivals hundreds of times its size on hard forecast and scene tests. The team also released a large test set built from ten years of news.

Catalog record

CREATORZijia Liu, Peixuan Han, Haofei Yu, Haoru Li, Jiaxuan You
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE88 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-13508

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Time-R1: Towards Comprehensive Temporal Reasoning in LLMs Zijia Liu, Peixuan Han, Haofei Yu, Haoru Li, Jiaxuan You Abstract Large Language Models (LLMs) demonstrate impressive capabilities but lack robust temporal intelligence, struggling to integrate reasoning about the past with predictions and plausible generations of the future. Meanwhile, existing methods typically target isolated temporal skills, such as question answering about past events or basic forecasting, and exhibit poor generalization, particularly when dealing with events beyond their knowledge cutoff or requiring creative foresight. To address these limitations, we introduce Time-R1 , the first framework to endow a moderate-sized (3B-parameter) LLM with comprehensive temporal abilities: understanding, prediction, and creative generation. Our approach features a novel three-stage development path; the first two constitute a reinforcement learning (RL) curriculum driven by a meticulously designed dynamic rule-based reward system. This framework progressively builds (1) foundational temporal understanding and logical event-time mappings from historical data, (2) future event prediction skills for events beyond its knowledge cutoff, and finally (3) enables remarkable generalization to creative future scenario generation without any fine-tuning. Strikingly, experiments demonstrate that Time-R1 outperforms models over 200 times larger, including the state-of-the-art 671B DeepSeek-R1, on highly challenging future event prediction and creative scenario generation benchmarks. This work provides strong evidence that thoughtfully engineered, progressive RL fine-tuning allows smaller, efficient models to achieve superior temporal performance, offering a practical and scalable path towards truly time-aware AI. To foster further research, we also release Time-Bench , a large-scale multi-task temporal reasoning dataset derived from 10 years of news data, and our series of Time-R1 checkpoints. 1 1 1 Our code, the Time-Bench dataset, and Time-R1 model checkpoints are available at the project repository: https://github.com/ulab-uiuc/Time-R1 and via our Hugging Face Collection: https://huggingface.co/collections/ulab-ai/time-r1-682626aea47cb2b876285a16 . 1 Introduction Large Language Models (LLMs) have achieved remarkable success across a spectrum of language understanding, generation, and even some complex reasoning tasks [ 1 , 2 , 3 ] . However, a persistent shortcoming in even the most advanced LLMs is their temporal reasoning ability [ 4 , 5 ] . This encompasses several key capacities [ 6 , 7 , 8 ] : accurately interpreting temporal relationships within their existing knowledge base (such as inferring event times, time differences, event order, and completing temporal entities), predicting the timing of future events based on learned patterns, and creatively generating plausible future events anchored in time. Studies have shown that most LLMs indeed struggle to update or contextualize knowledge under time constraints [ 9 ] ; even frontier models have been observed to perform worse than some smaller models in tasks that require integrating new temporal information [ 10 ] . This suggests a systemic weakness in how current LLMs grasp time. This weakness stems from multiple factors: architectural limitations [ 11 ] , such as the lack of explicit module representation of time; the static nature of their training corpora [ 12 ] , which inevitably become outdated; and the non-chronological training process [ 13 ] , where temporal information across different periods is processed concurrently rather than sequentially, hindering the development of robust logical mappings between events and their corresponding times. Figure 1: Generated outputs from Time-R1 showcasing its capabilities. (Left) Future Event Time Prediction (Stage 2). (Right) Creative Scenario Generation (Stage 3), with output compared to a real-world headline. While existing research aims to enhance temporal reasoning—for instance, Zhao et al. [ 13 ] aligned LLM knowledge to target times, Kim et al. [ 9 ] improved temporal consistency, and Yuan et al. [ 5 ] focused on future event prediction, with other works exploring representation methods [ 14 , 15 ] —these efforts often target isolated skills. They typically fall short of endowing LLMs with unified, comprehensive temporal intelligence that spans past understanding, future prediction, and creative, time-anchored generation, especially for events beyond their knowledge cutoffs [ 13 , 5 ] . In this paper, we aim to bridge this gap by equipping a single 3B-parameter model with comprehensive temporal reasoning capabilities through multi-stage Reinforcement Learning (RL), which has become a powerful framework for improving LLM reasoning. Recent frontior models such as OpenAI-o1 [ 16 ] and DeepSeek-R1 [ 17 ] utilize RL methods like PPO [ 18 ] and GRPO [ 19 ] , proving effectiveness to learn complex reasoning capabilities, such as mathematical problem solving and multi-step logical deduction. We build upon Qwen2.5-3B-Instruct, a moderate-sized LLM, and demonstrate that through specialized training it can surpass models over 200× larger (for instance, DeepSeek-R1, a 671B-parameter model) on highly challenging temporal prediction and generation tasks. We propose a three-stage framework with RL and dynamic rewards to progressively establish the model’s unified temporal capabilities, spanning temporal logic, future prediction, and time-anchored scenario generation: (1) Stage 1 - Comprehension : RL fine-tune the model using pre-cutoff data from a cold start on four fundamental temporal tasks – timestamp inference, time-difference estimation, events ordering, and masked time entity completion – to develop powerful logical mappings between events and their corresponding times. (2) Stage 2 - Prediction : Further train the model to predict events occurring after knowledge cutoff, thereby teaching it to utilize general reasoning ability built in Stage 1 to extrapolate trends and anticipate future outcomes. (3) Stage 3 - Generation : Directly have the model generate logical future scenario without fine-tuning, leveraging the capabilities obtained from the first two stages. Through this staged curriculum, the LLM thus progresses from comprehending known temporal facts to skillfully navigating the complexities of the future. This advanced training culminates in robust capabilities for both predicting future event timelines and creatively generating plausible scenarios for unseen future contexts—addressing significant limitations in how current AI handles such challenging forward-looking tasks. Illustrative examples of these advanced future-oriented skills, such as Time-R1’s proficiency in forecasting event dates and generating contextually appropriate news headlines for future dates (as depicted in Figure 1 ), highlight the practical efficacy of our approach. In summary, the key contributions of our work are as follows: (1) Unified Temporal Reasoning in One Model: We introduce the first LLM that exhibits a holistic temporal reasoning ability encompassing logic, prediction, and generation. (2) Small Model, Big Performance: We show that a relatively small 3B model, when fine-tuned with our meticulously designed multi-stage dynamic-reward RL strategy, can match or even exceed the performance of models with hundreds of billions of parameters ( e.g. , the 671B-parameter R1 model) on temporal prediction and generation tasks. (3) Fast Adaptability and Cost Efficiency: Our approach demonstrates that temporal knowledge can be continuously refreshed in a cost-effective manner. A 3B model can be quickly fine-tuned on new data as time progresses, which is infeasible for a hundreds of billion model that would require enormous computational resources (on the order of millions of dollars for fine-tuning). (4) Resources for the Community: To encourage further research in temporal-aware AI, we release Time-Bench , a dataset of over 200,000 examples with explicit temporal annotations covering diverse tasks including timestamp inference, time-gap estimation, event ordering, and temporal entity completion. We also release Time-R1 , a series of high-performing and continuously updatable temporal reasoning model checkpoints, offering a strong foundation for future time-aware LLM development and iterative refinement. 2 Related Work Temporal Reasoning in LLMs. While adept at many

Read the complete text