TimeSeriesExamAgent : Creating Time Series Reasoning Benchmarks at Scale

Malgorzata Gwiazda, Yifu Cai, Mononito Goswami, Arjun Choudhry, Artur Dubrawski, [1ex] Technical University of Munich, Munich, Germany [email protected], [1ex] Auton Lab, School of Computer Science, Carnegie Mellon University, Pittsburgh, US {yifuc, mgoswami, arjuncho, awd}@cs.cmu.edu · 2026

Read TimeSeriesExamAgent : Creating Time Series Reasoning Benchmarks at Scale by Malgorzata Gwiazda, Yifu Cai, Mononito Goswami, Arjun Choudhry, Artur Dubrawski, [1ex] Technical University of Munich, Munich, Germany [email protected], [1ex] Auton Lab, School of Computer Science, Carnegie Mellon University, Pittsburgh, US {yifuc, mgoswami, arjuncho, awd}@cs.cmu.edu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10291.txt.

Description

Gwiazda and four colleagues build scalable time series benchmark methods from forms plus LLM agents. TimeSeriesExam, a multiple-choice benchmark on fake series, tests pattern spotting, noise grasp, likeness study, anomaly finding, and cause and effect. TimeSeriesExamAgent scales the approach, making benchmarks from real data sets in healthcare, finance, and weather. Quality checks find the made benchmarks as diverse as curated ones. LLM scores stay limited in abstract thought and domain uses, showing grasp remains hard.

Catalog record

CREATORMalgorzata Gwiazda, Yifu Cai, Mononito Goswami, Arjun Choudhry, Artur Dubrawski, [1ex] Technical University of Munich, Munich, Germany [email protected], [1ex] Auton Lab, School of Computer Science, Carnegie Mellon University, Pittsburgh, US {yifuc, mgoswami, arjuncho, awd}@cs.cmu.edu
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE92349
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.10291

Browse the full library · About the Tower of Babel