LLaTiSA : Towards Difficulty-Stratified Time Series Reasoning from Visual Perception to Semantics

Yueyang Ding, HaoPeng Zhang, Rui Dai, Yi Wang · 2026

Read LLaTiSA : Towards Difficulty-Stratified Time Series Reasoning from Visual Perception to Semantics by Yueyang Ding, HaoPeng Zhang, Rui Dai, Yi Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-17295.txt.

Introduction

Ding, Zhang, Dai, Wang, and colleagues sort time-series reasoning into four levels of rising difficulty. Time-series reasoning means reading patterns in data over time. They build HiTSR, a set of 83,000 examples with checked step-by-step reasoning traces. Their model LLaTiSA pairs chart images with precise number tables, learns through a staged curriculum, and holds up well on unfamiliar tasks.

Catalog record

CREATORYueyang Ding, HaoPeng Zhang, Rui Dai, Yi Wang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE108110
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.17295

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LLaTiSA : Towards Difficulty-Stratified Time Series Reasoning from Visual Perception to Semantics Yueyang Ding, HaoPeng Zhang, Rui Dai, Yi Wang Abstract Comprehensive understanding of time series remains a significant challenge for Large Language Models (LLMs). Current research is hindered by fragmented task definitions and benchmarks with inherent ambiguities, precluding rigorous evaluation and the development of unified Time Series Reasoning Models (TSRMs). To bridge this gap, we formalize Time Series Reasoning (TSR) via a four-level taxonomy of increasing cognitive complexity. We introduce HiTSR , a hi erarchical t ime s eries r easoning dataset comprising 83k samples with diverse task combinations and verified Chain-of-Thought (CoT) trajectories. Leveraging HiTSR , we propose LLaTiSA , a strong TSRM that integrates visualized patterns with precision-calibrated numerical tables to enhance the temporal perception of Vision-Language Models (VLMs). Through a multi-stage curriculum fine-tuning strategy, LLaTiSA achieves superior performance and exhibits robust out-of-distribution generalization across diverse TSR tasks and real-world scenarios. Our code is available at https://github.com/RainingNovember/LLaTiSA . 1 Introduction Time series data serve as a fundamental modality for capturing the temporal dynamics of complex systems, underpinning a wide range of critical applications, including medical diagnostics Xie et al. 2025a , financial valuation Xu et al. 2025 , and industrial condition monitoring Wang et al. 2025b . Interpreting real-world temporal dynamics necessitates Time Series Reasoning (TSR): deriving a comprehensive understanding of time series by grounding analysis in numerical evidence, perceiving salient patterns, and incorporating contextual information to support challenging tasks such as decision-making or forecasting. Figure 1: (a) Illustration of the four-level TSR taxonomy and HiTSR dataset. Each incorporates a simple TSR case with increasing difficulties. (b) A brief introduction to HiTSR datasets, containing three levels of TSR scenarios with diverse subtasks. Recent studies have demonstrated that Large Language Models (LLMs) can be effective for time-series understanding Xie et al. 2025b and provide interpretable reasoning to further enrich traditional time series analysis Zhang et al. 2025a . Despite these advancements, building unified TSRMs faces two critical bottlenecks: (1) The lack of a formalized taxonomy for reasoning tasks. Existing suites like TSQA Kong et al. 2025 or BEDTime Sen et al. 2025 either present a mapping of traditional analytical tasks (e.g., forecasting and classification) to text formats or focus on realizing scenario-agnostic series patterns. In contrast, domain-specific datasets like Engine-QA Wang et al. 2025b and Heartcare-Bench Xie et al. 2025a tend to be numerically-insensitive, primarily relying on the semantic relationships between multiple series. (2) Reliability deficits in existing benchmarks. Beyond insufficient contextual information, current benchmarks are often hampered by semantic ambiguities in label definitions and low-fidelity question-answer pairs Guan et al. 2025 . To facilitate the systematic development and rigorous assessment of TSRMs, it is essential to formalize unified definitions of TSR and construct reliable benchmarks that comprehensively model capabilities across diverse scenarios. Building on the aforementioned limitations, we posit that cultivating reliable TSR capabilities mirrors a multi-stage cognitive process: transitioning from point-level numerical grounding to series-level perception, facilitating high-level semantic interpretation, and ultimately enabling context-aware generation. Guided by this philosophy, we formalize a systematic taxonomy that decomposes TSR into four levels of increasing complexity (L1-L4), as shown in Figure 1 (a). Leveraging this taxonomy, we introduce HiTSR ( Figure 1 (b)), a hi erarchical t ime s eries r easoning dataset comprising 83k samples that span the foundational TSR tasks across the first three levels (L1-L3). All samples in HiTSR are constructed with unambiguous ground truths and verifiable reasoning chains. This paper focuses on levels L1-L3, since we find that even advanced TSRMs struggle significantly on these foundational tasks 1 1 1 We analyze these findings in Sections A.1 and D . , suggesting that mastering these fundamental stages is a prerequisite for reliable time-series reasoning and remains an immediate challenge. Recent works have shown that Vision Language Models (VLMs) can excel in basic TSR tasks by relying exclusively on time series visualizations Zhang et al. 2025a ; Sen et al. 2025 . However, such vision-centric approaches frequently struggle with numerical reasoning tasks that require precise value-based evidence. Inspired by Wei et al. 2025 , which utilizes visual tokens to represent textual information efficiently, we introduce a robust VLM-based TSRM named L arge L anguage a nd Ti me S eries A ssistant ( LLaTiSA ). LLaTiSA is designed to bridge the gap between qualitative visual intuition and quantitative numerical precision. By employing a three-stage curriculum fine-tuning strategy aligned with our proposed L1-L3 hierarchy, LLaTiSA demonstrates that TSR benefits from incremental cognitive grounding and high-fidelity Chains-of-Thought (CoT). In summary, our contributions are summarized as follows: • A cognitive taxonomy and unified dataset. We formalize a four-level cognitive taxonomy (L1-L4) that captures the progressive nature of temporal understanding. Based on this, we introduce HiTSR , a large-scale, high-fidelity TSR dataset of over 83k samples spanning L1-L3, featuring diverse task settings and verified reasoning chains. • A numerically-enhanced TSRM. We propose LLaTiSA , a VLM-based TSRM that bridges qualitative perception and quantitative precision. LLaTiSA is trained via a three-stage curriculum aligned with our L1-L3 hierarchy to build robust reasoning capabilities progressively. • Empirical validation of multi-stage reasoning. Extensive experiments demonstrate that LLaTiSA consistently outperforms proprietary models and various open-source baselines. Furthermore, our model exhibits superior generalization to out-of-distribution (OOD) scenarios across existing benchmarks. 2 Related Works 2.1 Time Series Reasoning Datasets Recently released multimodal time series datasets adopt various types of TSR tasks. For general question-answering, early efforts like TSQA Kong et al. 2025 and TRQA Jing et al. 2025 explore LLMs’ potential in question-answering and traditional time series analysis tasks. SciTS Wu et al. 2025 introduces a benchmark specifically designed for scientific time series analysis across a wide range of scientific domains. RATs40k Yang et al. 2025b transforms classical time series anomaly detection from discriminative into a reasoning-intensive task and annotates samples with explanatory reasoning. TimeMMD Liu et al. 2024a is tailored for the context-aware time series forecasting task. MMTS-Bench Yin et al. 2026 provides a multi-dimensional task classification taxonomy, yet it overlooks evaluating models’ basic numerical read-out and combining diverse semantics of real scenarios. In addition to insufficient context, current benchmarks are further hampered by semantic ambiguities in label definitions and low-fidelity question-answer pairs Guan et al. 2025 . Moreover, most of the datasets focus on either pattern description or complex reasoning scenarios such as forecasting, and overlook evaluating models’ basic ability of read-out numerical values. Our findings suggest that current models even struggle with finding point-level numerical evidence, suffering from overthinking or hallucinations with longer time horizons. 2.2 Time Series Reasoning Models Understanding time series via language models generally mostly follows three encoding paradigms: (i) direct serialization into text tokens, (ii) visual rendering as plots for VLMs, and (iii) the integration of dedicated time-series encoders to construct Time-Series Multimodal Large Language Models (TS-MLLMs). TimeOmni-1 Guan et al. 2025 and Time-R1 Luo et al. 2025 employ textual inputs for context-aware forecasting. ChatTS Xie et al. 2025b and ITFormer Wang et al. 2025b incorporate an MLP-based and a Q-former Li et al. 2023 style time series encoder to perform multivariate TSR tasks, respectively. TimeMaster Zhang et al. 2025a enables VLMs to perform interpretable classification based on visualized time series. While recent studies point out that TSRMs struggle with

Read the complete text