Time Travel: A Comprehensive Benchmark to Evaluate LMMs on Historical and Cultural Artifacts
Sara Ghaboura, Ketan More, Ritesh Thawkar, Wafa Alghallabi, Omkar Thawakar, Fahad Shahbaz Khan, Hisham Cholakkal, Salman Khan, Rao Muhammad Anwer, Mohamed bin Zayed University of AI, Linköping University, Australian National University, Aalto University · 2025
Read Time Travel: A Comprehensive Benchmark to Evaluate LMMs on Historical and Cultural Artifacts by Sara Ghaboura, Ketan More, Ritesh Thawkar, Wafa Alghallabi, Omkar Thawakar, Fahad Shahbaz Khan, Hisham Cholakkal, Salman Khan, Rao Muhammad Anwer, Mohamed bin Zayed University of AI, Linköping University, Australian National University, Aalto University (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-14865.txt.
Description
Sara Ghaboura and eight co-workers wrote a 2025 paper building a benchmark to test AI models on historical and cultural artifacts. Reading old objects takes expert skill and much time. Their test set holds over ten thousand expert-checked samples. It spans hundreds of cultures across ten broad regions.
Items include manuscripts, artworks, inscriptions and dug-up finds. The set gives a shared yardstick for sorting, reading and understanding such objects. The team ran current multimodal models on it to map strengths and gaps. They aim to make AI a trusted partner for heritage work. Code for the benchmark is shared openly.
Catalog record
| CREATOR | Sara Ghaboura, Ketan More, Ritesh Thawkar, Wafa Alghallabi, Omkar Thawakar, Fahad Shahbaz Khan, Hisham Cholakkal, Salman Khan, Rao Muhammad Anwer, Mohamed bin Zayed University of AI, Linköping University, Australian National University, Aalto University |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 39 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-14865