Harnessing Temporal Databases for Systematic Evaluation of Factual Time-Sensitive Question-Answering in Large Language Models

Soyeon Kim Jindong Wang Xing Xie Steven Euijong Whang · 2025

Read Harnessing Temporal Databases for Systematic Evaluation of Factual Time-Sensitive Question-Answering in Large Language Models by Soyeon Kim Jindong Wang Xing Xie Steven Euijong Whang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-02045.txt.

Description

Kim, Wang, Xie, and Whang build a benchmark that tests whether language models handle facts that change over time. A model that answers with last year's office holder or price is wrong today, yet hand-built tests for such questions scale poorly. Their 2025 benchmark, TDBench, builds question pairs from time-aware databases using database rules and queries.

The team also adds a score for whether the time named in a model's explanation is itself valid, beside plain answer accuracy. Tests on current models show the benchmark can grow large with little human labor. It also covers private, task-specific data rather than only public encyclopedia facts. The authors offer it as a partner to existing time-sensitive test sets.

Catalog record

CREATORSoyeon Kim Jindong Wang Xing Xie Steven Euijong Whang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE90 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-02045

Browse the full library · About the Tower of Babel