Time-MQA: Time Series Multi-Task Question Answering with Context Enhancement
Yaxuan Kong, Yiyuan Yang, Yoontae Hwang, Wenjie Du, Stefan Zohren, Zhangyang Wang, Ming Jin, Qingsong Wen · 2025
Read Time-MQA: Time Series Multi-Task Question Answering with Context Enhancement by Yaxuan Kong, Yiyuan Yang, Yoontae Hwang, Wenjie Du, Stefan Zohren, Zhangyang Wang, Ming Jin, Qingsong Wen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-01875.txt.
Introduction
Yaxuan Kong, Yiyuan Yang, Yoontae Hwang, and five colleagues teach language models to answer questions about time series in this two thousand twenty-five paper. Time series drive finance, healthcare, and energy decisions, yet tools and datasets cluster narrowly on forecasting or anomaly detection. Time-MQA is a unified framework for natural language queries across many time series tasks, from numerical analysis to open-ended questions requiring reasoning. Its core is the TSQA dataset.
TSQA holds about two hundred thousand question-answer pairs built from diverse series covering environment, traffic, and more, at varied lengths. The authors continually pre-trained three open language models, Mistral, Llama-3, and Qwen-2.5 at seven to eight billion parameters, on this dataset. The training measurably improved time series reasoning beyond rote numeric tasks. The dataset, models, evaluation questionnaires, and related materials are all open-sourced to support more intuitive interaction with temporal data.
Catalog record
| CREATOR | Yaxuan Kong, Yiyuan Yang, Yoontae Hwang, Wenjie Du, Stefan Zohren, Zhangyang Wang, Ming Jin, Qingsong Wen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 41 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-01875
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Time-MQA: Time Series Multi-Task Question Answering with Context Enhancement Yaxuan Kong, Yiyuan Yang, Yoontae Hwang, Wenjie Du, Stefan Zohren, Zhangyang Wang, Ming Jin, Qingsong Wen Abstract Time series data are foundational in finance, healthcare, and energy domains. However, most existing methods and datasets remain focused on a narrow spectrum of tasks, such as forecasting or anomaly detection. To bridge this gap, we introduce Time Series Multi-Task Question Answering (Time-MQA), a unified framework that enables natural language queries across multiple time series tasks - numerical analytical tasks and open-ended question answering with reasoning. Central to Time-MQA is the TSQA dataset, a large-scale dataset containing ∼ \sim 200k question-answer pairs derived from diverse time series spanning environment, traffic, etc. This comprehensive resource covers various time series lengths and promotes robust model development. We further demonstrate how continually pre-training large language models (Mistral 7B, Llama-3 8B, and Qwen-2.5 7B) on the TSQA dataset enhanced time series reasoning capabilities, moving beyond mere numeric tasks and enabling more advanced and intuitive interactions with temporal data. The complete TSQA dataset, models, executable codes, user study questionnaires for evaluation, and results have all been open-sourced here 1 1 1 https://huggingface.co/Time-QA . 1 Introduction Time series analysis has long been fundamental to real-world applications in finance, healthcare, energy, and other domains Nie et al. 2024 ; Xu et al. 2023 ; Yang et al. 2021b ; Chen et al. 2024b . Before the emergence of large language models (LLMs), most research in this area focused on numerical analytical tasks such as forecasting and anomaly detection, with methods typically constrained to a single objective. Recently, the community has begun to explore ways to enhance these conventional time series approaches by incorporating LLMs Fons et al. 2024 ; Zhang et al. 2024b ; however, while some efforts do leverage contextual information, they typically focus on a single task, such as forecasting, leaving a gap in broader, multi-task reasoning and inference capabilities Merrill et al. 2024 ; Ansari et al. 2024 ; Frisoni et al. 2024 ; Jin et al. 2024a . To bridge this gap, we propose a unified Time Series Multi-task Question Answering (Time-MQA) framework that integrates diverse tasks with natural language queries. Figure 1: Example of Time-MQA with context enhancement. The LLM answers the user’s questions based on the provided context and the input time series. It can conduct reasoning and handle multiple time series tasks. Time-MQA is crucial for advanced reasoning and inference, as it enables models to interpret temporal data through natural language queries and uncover deeper insights beyond mere classical numeric tasks Chow et al. 2024 ; Xu et al. 2024 . However, there is a notable lack of relevant datasets — specifically, paired language with time series — which severely limits the development of models capable of dialogue and reasoning in this domain Jin et al. 2024b ; Kong et al. 2025 . This significant gap underscores the urgent need for comprehensive resources that integrate multiple time series tasks under a question-answering framework, allowing users to query these tasks in natural language. In this paper, we introduce Time-MQA , a new framework for multi-task time series question answering with context enhancement. As illustrated in Figure 1 , Time-MQA expands beyond numerical analytical tasks by consolidating open-ended questions and classical time series tasks, such as forecasting, into a single framework. Users can pose queries in natural language, enabling a more intuitive and flexible interface for a wide range of time series analyses. To support Time-MQA , we proposed TSQA , a large-scale dataset with approximately 200k question-answer pairs spanning multiple domains, including healthcare, environment, AIOps, machine sensors, finance, energy, traffic, IoT, nature, transport, human activities, and the web. This dataset covers various time series lengths and tasks, ensuring broad coverage and robustness. Notably, TSQA features open-ended reasoning questions with more elaborate text-based explanations. To the best of our knowledge, this is the first large-scale QA dataset in the time series domain that spans multiple domains and tasks, effectively bridging the gap between classical time series analysis and modern LLM-driven approaches. We further demonstrate the utility of the TSQA dataset by employing continual pre-training techniques on representative LLMs such as Mistral 7B Jiang et al. 2023 , Llama-3 8B Dubey et al. 2024 , and Qwen-2.5 7B Yang et al. 2024 . Our experiments reveal that these models trained on the TSQA dataset can effectively acquire time series knowledge and reasoning abilities, enabling more advanced capabilities beyond basic numeric handling of time series data. In summary, our contributions include: • We propose Time-MQA , a multi-task time series question answering framework that leverages contextual enhancement to extend beyond traditional numerical analysis tasks. • We construct TSQA , a dataset comprising \sim 200k question-answer pairs across over twelve domains (e.g., healthcare, finance, and energy) and five tasks (e.g., forecasting, anomaly detection, and open-ended reasoning question answering). • We demonstrate that fine-tuning LLMs on the TSQA dataset equips them with time series–specific knowledge, enabling natural language queries for comprehensive time series analysis. Figure 2: The overview of the proposed Time-MQA framework. 2 Related Works 2.1 Classical Time Series Tasks Time series analysis has been extensively studied in various real-world applications, such as finance, healthcare, climate, electricity, AIOps, and industrial system maintenance Nie et al. 2024 ; Guo et al. 2024 ; Ma et al. 2024 ; Yang et al. 2023a ; Yang et al. 2021a . Classical time series tasks focus on extracting insights from these time series and addressing challenges associated with temporal patterns Fuller 2009 ; Hamilton 2020 . Forecasting is one the most fundamental tasks. It predicts future time points based on historical values and features Lim and Zohren 2021 . Depending on the temporal horizon, forecasting can be categorized into short-term forecasting, which captures immediate fluctuations, and long-term forecasting, which models more complex temporal dependencies Wang et al. 2024b . Common methods include statistical methods (e.g., ARIMA and exponential smoothing) and deep learning-based methods (e.g., RNN, LSTM, Transformer-based architectures) Wen et al. 2022 ; Miller et al. 2024 . Anomaly detection seeks to identify abnormal patterns or deviations from expected behavior in time-series data Zamanzadeh Darban et al. 2024 . Classical approaches rely on statistical models like z-score analysis and dynamic thresholding, while contemporary methods incorporate deep learning-based frameworks, such as autoencoders, transformers, and graph neural networks, to capture complex dependencies and temporal correlations Han et al. 2022 ; Yang et al. 2023b . Imputation addresses the issue of missing or corrupted data in sequence. It is essential for ensuring data integrity in downstream analysis Du et al. 2024 . Traditional imputation techniques, such as interpolation, have been widely employed, whereas deep learning-based methods, such as variational autoencoders (VAE), generative adversarial networks (GANs), and diffusion models, have recently demonstrated promising results in learning complex missing patterns and improving imputation performance Wang et al. 2025 . Beyond these tasks, time series classification/regression, generation, augmentation, and decomposition are also frequently used in real-world scenarios Mohammadi Foumani et al. 2024 ; Wen et al. 2020 ; Zhang et al. 2024a . 2.2 Text-Enhanced Time Series Tasks Recent advancements in time series analysis have demonstrated the potential of incorporating textual information based on LLMs to enhance time series