TimeSeriesExamAgent : Creating Time Series Reasoning Benchmarks at Scale
Malgorzata Gwiazda, Yifu Cai, Mononito Goswami, Arjun Choudhry, Artur Dubrawski, [1ex] Technical University of Munich, Munich, Germany [email protected], [1ex] Auton Lab, School of Computer Science, Carnegie Mellon University, Pittsburgh, US {yifuc, mgoswami, arjuncho, awd}@cs.cmu.edu · 2026
Read TimeSeriesExamAgent : Creating Time Series Reasoning Benchmarks at Scale by Malgorzata Gwiazda, Yifu Cai, Mononito Goswami, Arjun Choudhry, Artur Dubrawski, [1ex] Technical University of Munich, Munich, Germany [email protected], [1ex] Auton Lab, School of Computer Science, Carnegie Mellon University, Pittsburgh, US {yifuc, mgoswami, arjuncho, awd}@cs.cmu.edu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10291.txt.
Description
Gwiazda and four colleagues build scalable time series benchmark methods from forms plus LLM agents. TimeSeriesExam, a multiple-choice benchmark on fake series, tests pattern spotting, noise grasp, likeness study, anomaly finding, and cause and effect. TimeSeriesExamAgent scales the approach, making benchmarks from real data sets in healthcare, finance, and weather. Quality checks find the made benchmarks as diverse as curated ones. LLM scores stay limited in abstract thought and domain uses, showing grasp remains hard.
Catalog record
| CREATOR | Malgorzata Gwiazda, Yifu Cai, Mononito Goswami, Arjun Choudhry, Artur Dubrawski, [1ex] Technical University of Munich, Munich, Germany [email protected], [1ex] Auton Lab, School of Computer Science, Carnegie Mellon University, Pittsburgh, US {yifuc, mgoswami, arjuncho, awd}@cs.cmu.edu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 92349 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.10291