Large Language Models Lack Temporal Awareness of Medical Knowledge
Zihan Guan, Qiao Jin, Guangzhi Xiong, Fangyuan Chen, Mengxuan Hu, Qingyu Chen, Yifan Peng, Zhiyong Lu, Anil Vullikanti · 2026
Read Large Language Models Lack Temporal Awareness of Medical Knowledge by Zihan Guan, Qiao Jin, Guangzhi Xiong, Fangyuan Chen, Mengxuan Hu, Qingyu Chen, Yifan Peng, Zhiyong Lu, Anil Vullikanti (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-13045.txt.
Description
Guan and eight co-authors build TempoMed-Bench, the first benchmark for temporal awareness of medical knowledge in language models. Medical knowledge evolves as evidence emerges and treatments gain approval, yet most tests ignore time. Models' up-to-date accuracy declines gradually over time rather than dropping sharply at a cutoff, and historical accuracy runs only 25% to 54% of current accuracy. Models also flip inconsistently across neighbouring years, and agentic search tools fail to fix the problem.
Catalog record
| CREATOR | Zihan Guan, Qiao Jin, Guangzhi Xiong, Fangyuan Chen, Mengxuan Hu, Qingyu Chen, Yifan Peng, Zhiyong Lu, Anil Vullikanti |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 95386 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.13045