Harnessing Temporal Databases for Systematic Evaluation of Factual Time-Sensitive Question-Answering in Large Language Models
Soyeon Kim Jindong Wang Xing Xie Steven Euijong Whang · 2025
Read Harnessing Temporal Databases for Systematic Evaluation of Factual Time-Sensitive Question-Answering in Large Language Models by Soyeon Kim Jindong Wang Xing Xie Steven Euijong Whang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-02045.txt.
Description
Kim, Wang, Xie, and Whang build a benchmark that tests whether language models handle facts that change over time. A model that answers with last year's office holder or price is wrong today, yet hand-built tests for such questions scale poorly. Their 2025 benchmark, TDBench, builds question pairs from time-aware databases using database rules and queries.
The team also adds a score for whether the time named in a model's explanation is itself valid, beside plain answer accuracy. Tests on current models show the benchmark can grow large with little human labor. It also covers private, task-specific data rather than only public encyclopedia facts. The authors offer it as a partner to existing time-sensitive test sets.
Catalog record
| CREATOR | Soyeon Kim Jindong Wang Xing Xie Steven Euijong Whang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 90 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-02045