Temporal Blindness in Multi-Turn LLM Agents: Misaligned Tool Use vs. Human Time Perception
Yize Cheng, Arshia Soltani Moakhar, Chenrui Fan, Kazem Faghih, Parsa Hosseini, Wenxiao Wang, Soheil Feizi · 2025
Read Temporal Blindness in Multi-Turn LLM Agents: Misaligned Tool Use vs. Human Time Perception by Yize Cheng, Arshia Soltani Moakhar, Chenrui Fan, Kazem Faghih, Parsa Hosseini, Wenxiao Wang, Soheil Feizi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2510-23853.txt.
Introduction
Yize Cheng and seven co-authors show that language model agents are temporally blind: they act as if no time passes between messages. In real deployments, hours may elapse while an agent assumes a frozen context. That blindness distorts tool use — the agent either trusts stale context and skips needed tool calls, or distrusts it and repeats calls it already made.
To measure the problem, the team built TicToc, a dataset of multi-turn conversations across seventy-six scenarios with high, medium, and low time sensitivity. Human judges marked whether a tool call or a direct answer was right at each step. Even with timestamps shown, no model matched human time perception better than sixty-five percent in normalized alignment. Simple prompting fixes helped little for most models. Targeted post-training did align decisions better, marking a path toward agents that understand elapsed time the way people do.
Catalog record
| CREATOR | Yize Cheng, Arshia Soltani Moakhar, Chenrui Fan, Kazem Faghih, Parsa Hosseini, Wenxiao Wang, Soheil Feizi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 44 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2510-23853
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Temporal Blindness in Multi-Turn LLM Agents: Misaligned Tool Use vs. Human Time Perception Yize Cheng, Arshia Soltani Moakhar, Chenrui Fan, Kazem Faghih, Parsa Hosseini, Wenxiao Wang, Soheil Feizi Abstract Large language model (LLM) agents are increasingly used in multi-turn conversational settings to interact with and execute tasks in dynamic environments. However, a critical limitation of these agents is their temporal blindness: they, by default, operate with a stationary context, failing to account for the real-world time elapsed between messages. This becomes a significant liability when an agent must decide whether to invoke a tool based on how much time has passed since the last observation or action. Without temporal awareness, agents often either over-rely on previous context (skipping necessary tool calls), or under-rely on it (unnecessarily repeating tool calls). To study this challenge, we constructed TicToc-v1, a diverse test set of multi-turn user–agent message trajectories across 34 scenarios, spanning dynamic environments with high, medium, and low time sensitivity. Each trajectory ends with a user question, where the need for a tool call depends on the amount of time elapsed since the last observation. To give LLMs the information of real-world time elapse, we augment dialogue messages with explicit timestamps, bridging the gap between the static dialogue state and the evolving external world. We then collected human preferences for these samples, creating two subsets: one where humans clearly preferred relying on the previous observation ( prefer-noTool ), and another where they preferred a new tool call ( prefer-Tool ). We evaluated how well LLM tool-calling decisions align with human preferences under varying amounts of elapsed time on TicToc-v1. Our analysis reveals that without time information, most models perform only slightly better than a random guess, with the highest alignment rate being just over 60%. While adding timestamps leads to a slight increase in alignment, particularly for larger models, the improvement is modest, peaking at around 65%. We also show that naive, prompt-based alignment techniques have limited effectiveness. Our findings highlight the need for specific post-training alignment to align multi-turn LLM tool use with human temporal perception. 1 Introduction Large language models (LLMs) have demonstrated remarkable capabilities in instruction following wei2021finetuned ; ouyang2022training ; chung2024scaling and reasoning wei2022chain ; wangself ; yao2023tree ; jaech2024openai ; guo2025deepseek ; muennighoff2025s1 , and are hence increasingly being leveraged as the foundation for sophisticated AI agents, which are commonly referred as LLM agents wangvoyager ; yao2023react ; shinn2023reflexion ; wang2023describe . These agents are designed to operate under dynamic environments and interact with users to execute complex, real-world tasks by leveraging external tools or functions parisi2022talm ; schick2023toolformer ; shen2023hugginggptsolvingaitasks ; song2023restgpt ; mialon2023augmented , such as search engines, APIs, etc. Therefore, a growing body of research has focused on evaluating how agents use tools, with emphasis on measuring the accuracy of tool invocation huang2023metatool ; li2023api ; patilberkeley , diagnosing hallucinated calls zhang2024toolbehonest ; ross2025when2call , and evaluating the robustness to variations in tool descriptions shi2025prompt ; faghih2025gaming . However, we highlight that when it comes to tool-use decisions in multi-turn situations, a critical limitation of models’ default operational paradigm has been overlooked: temporal blindness. Figure 1: Illustrative examples showing the liability of temporal blindness in multi-turn LLM agents, in comparison to human . The first row shows the case of over-reliance , where the model displays over-confidence in outdated context, resulting in erroneous outputs. The second row shows the case of under-reliance , where the model displays excessive caution through repeated tool calls, resulting in unnecessary delays and latency. Temporal blindness refers to the inability of LLM agents to account for the real-world time that elapses between user messages or agent actions. Unlike humans, who naturally factor in the passage of time when reasoning about events, LLM agents typically treat each conversation turn as occurring in a timeless vacuum. By default, these models treat dialogue context as a static, stationary sequence of tokens, ignoring the fact that the external world, which their tools interact with, can be in constant flux. This temporal disconnect leads to a significant liability in tool-calling decisions. An agent may either over-rely on a previous observation that is now outdated, thus skipping a necessary tool call, or unnecessarily repeat a tool call for information that has not changed. This, as exemplified in Figure 1 , leads to either acting on stale information and producing erroneous outputs in the case of over-reliance, or wasting resources and introducing inefficiency and latency through redundant queries in the case of under-reliance. Neither case aligns with how humans make tool call decisions. In practice, humans develop a preference for tool use that is context-sensitive: we generally avoid re-checking stable facts while still knowing when fresh observations are necessary. To systematically investigate this misalignment, we constructed Ti me-aware c onversational To ol- c alling v1 (TicToc-v1), a diverse test set with 700+ multi-turn user-agent message trajectories. TicToc-v1 consists of 34 distinct scenarios, meticulously designed to span environments with high, medium, and low time sensitivity. Each trajectory ends with a user question, where the appropriate action—whether to rely on prior context or to invoke a tool—depends on how much time has elapsed since the previous message. We collected human preferences on these trajectories by asking volunteers, for a given trajectory and time interval: (i) is it clearly acceptable not to call a tool, (ii) is it clearly better to call a tool, or (iii) are they uncertain. Excluding the “uncertain” responses yields two distinct subsets: one in which human judgment favored a new tool call ( prefer-Tool ), and another in which it favored relying on prior context ( prefer-noTool ). We then evaluate a range of contemporary LLMs on TicToc-v1 under two conditions: with and without explicit timestamp augmentation in the dialogue messages. This setup allows us to measure how temporal information influences function-calling decisions and their alignment with human expectations. Our findings reveal that, in the absence of time signals, LLMs perform only marginally above chance in terms of alignment rate, underscoring the temporal blindness issue. However, while adding timestamps produces modest gains, the improvements remain limited. We therefore proceed with experiments using prompt-based alignment techniques, in which the LLM is explicitly prompted to consider temporal information either through a general reminder or few-shot example rules. However, our results show that these prompt-based techniques have limited effectiveness, underscoring the need for post-training alignment to better align multi-turn LLM tool use with human temporal perception. Our core contributions can be summarized as follows: • We identify temporal blindness as a critical limitation of LLM agents in multi-turn interactions, where models fail to account for the passage of real-world time between messages and actions, resulting in either over-reliance or under-reliance on prior context. • We introduce Ti me-aware c onversational To ol- c alling v1 ( TicToc-v1 ), a diverse test set with 700+ multi-turn user-agent trajectories across 34 scenarios that vary in time sensitivity, designed to systematically evaluate how well multi-turn LLMs align tool-calling decisions with human temporal perception. • We evaluate a wide range of contemporary LLMs, showing that without temporal information, alignment with human preferences is only marginally above chance, and that timestamp augmentation with prompt-based mitigations provide limited improvements, underscoring the need for