TriTS: Time Series Forecasting from a Multimodal Perspective

Xiang Ao · 2026

Read TriTS: Time Series Forecasting from a Multimodal Perspective by Xiang Ao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-16748.txt.

Introduction

Ao proposes TriTS, a cross-modal framework projecting time series into time, frequency and two-dimensional vision spaces. Long-term forecasting struggles because real signals carry entangled dynamics that a purely one-dimensional view misses. Period-Aware Reshaping plus Visual Mamba bridges the gap at linear cost, modelling cross-period links as textures. A Multi-Resolution Wavelet Mixing module splits non-stationary signals into trend and noise for time-frequency localization. A streaming linear branch anchors stability, and fusion lets TriTS adapt across contexts with state-of-the-art results.

Catalog record

CREATORXiang Ao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE34568
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.16748

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

TriTS: Time Series Forecasting from a Multimodal Perspective Xiang Ao Abstract Time series forecasting plays a pivotal role in critical sectors such as finance, energy, transportation, and meteorology. However, Long-term Time Series Forecasting (LTSF) remains a significant challenge because real-world signals contain highly entangled temporal dynamics that are difficult to fully capture from a purely 1D perspective. To break this representation bottleneck, we propose TriTS, a novel cross-modal disentanglement framework that projects 1D time series into orthogonal time, frequency, and 2D-vision spaces.To seamlessly bridge the 1D-to-2D modality gap without the prohibitive O ⁡ ( N 2 ) O(N^{2}) computational overhead of Vision Transformers (ViTs), we introduce a Period-Aware Reshaping strategy and incorporate Visual Mamba (Vim). This approach efficiently models cross-period dependencies as global visual textures while maintaining linear computational complexity. Complementing this, we design a Multi-Resolution Wavelet Mixing (MR-WM) module for the frequency modality, which explicitly decouples non-stationary signals into trend and noise components to achieve fine-grained time-frequency localization. Finally, a streaming linear branch is retained in the time domain to anchor numerical stability. By dynamically fusing these three complementary representations, TriTS effectively adapts to diverse data contexts. Extensive experiments across multiple benchmark datasets demonstrate that TriTS achieves state-of-the-art (SOTA) performance, fundamentally outperforming existing vision-based forecasters by drastically reducing both parameter count and inference latency. 1 Introduction Time series forecasting plays an indispensable role in energy load scheduling, meteorological disaster early warning, financial transactions, and other critical fields 21 ; 26 ; 1 ; 10 ; 16 . As prediction windows expand from short-term to long-term, models are required to infer future trends by capturing complex long-range dependencies from massive historical data. However, real-world time series are inherently complex, featuring highly entangled components such as global trends, complex seasonality, and non-stationary local mutations.In recent years, the forecasting paradigm has advanced from early Recurrent Neural Networks (RNNs) 18 ; 8 and Transformer-based architectures 22 ; 25 ; 15 towards a broader cross-modal representation perspective. Recognizing the representation bottleneck of analyzing signals solely in the 1D time domain, researchers have sought to project time series into alternative modalities. Frequency-domain methods 30 ; 27 isolate periodic patterns, while pioneering vision-based approaches (e.g., VisionTS 2 , VisionTS++ 19 ) have demonstrated that folding 1D signals into 2D ”temporal images” can successfully leverage the powerful structural perception capabilities of vision foundation models, achieving remarkable cross-domain transferability.Despite these advances, existing cross-modal bridging strategies still suffer from severe computational and representational limitations. First, in the vision domain, current methods predominantly rely on standard Vision Transformer (ViT) architectures. The self-attention mechanism inherently dictates a quadratic computational complexity ( O(N^{2}) ) with respect to the sequence length 5 , leading to prohibitive memory consumption and inference latency when processing ultra-long historical windows. Second, in the frequency domain, methods relying on the Fast Fourier Transform (FFT) utilize global basis functions, making it exceedingly difficult to accurately localize the transient mutations and non-stationary shifts prevalent in real-world data. Consequently, current models often either sacrifice computational efficiency for global context or lose fine-grained temporal resolution.To overcome the representation bottlenecks of single modalities and dismantle the computational barriers of cross-modal forecasting, this paper proposes TriTS, a unified cross-modal disentanglement framework that seamlessly synergizes time, frequency, and vision modalities. Rather than simply concatenating different models, TriTS fundamentally rethinks time series as a multimodal entity, routing specific signal characteristics to their most natural processing domains.Specifically, to bridge the 1D-to-2D modality gap without the heavy burden of ViTs, TriTS introduces a novel vision pathway integrating Period-Aware Reshaping with Visual Mamba (Vim) 31 . By utilizing the selective scanning mechanism of the bidirectional State Space Model (SSM), the Vim-Encoder treats periodic variations as 2D visual textures, efficiently capturing cross-period global dependencies with linear ( O(N) ) computational complexity. For the frequency modality, we propose a Multi-Resolution Wavelet Mixing (MR-WM) module to replace traditional global FFTs. Through multi-level wavelet decomposition, this module provides physical priors by explicitly decoupling non-stationary signals into trend and detail components, achieving precise time-frequency localization. Finally, to mitigate distribution shifts and anchor numerical stability, we deploy a streaming Exponential Moving Average (EMA) linear model 20 in the time domain. These three orthogonal, yet complementary, representations are dynamically aggregated via a scale-aware gating mechanism, adapting robustly to diverse datasets.Extensive experiments on multiple benchmark datasets demonstrate that TriTS achieves state-of-the-art performance. Crucially, compared to existing vision-based forecasters, TriTS drastically reduces parameter count and inference latency, redefining the efficiency baseline for multimodal time series analysis.The main contributions of this paper are summarized as follows: 1. We propose TriTS, a novel cross-modal disentanglement framework that projects 1D time series into time, frequency, and 2D-vision spaces. By dynamically fusing these orthogonal perspectives, TriTS effectively resolves the information loss and representation bottlenecks inherent in single-modality methods. 2. We pioneer the integration of Visual Mamba (Vim) into time series forecasting via a 1D-to-2D modality bridging strategy. By leveraging bidirectional State Space Models, we break the O(N^{2}) computational bottleneck of traditional vision-based forecasters, enabling efficient global texture capture in ultra-long sequences. 3. We introduce a frequency-domain encoder based on Multi-Resolution Wavelet Mixing (MR-WM) to address the limitations of FFTs in handling non-stationary mutations. This module achieves hierarchical decoupling of trends and noise, significantly enhancing the accurate localization of local anomalies and complex seasonality. 2 Related work 2.1 Time domain Deep learning-based time series forecasting has evolved from early Recurrent Neural Networks (RNNs) 18 ; 8 to the currently dominant Transformer architectures. Models such as LogTrans 14 , Autoformer 25 , and Fedformer 30 introduced various attention mechanisms to capture long-range dependencies. Recently, PatchTST 15 and iTransformer 12 significantly improved performance by adopting patch-based processing and inverted channel attention, respectively. However, the quadratic computational complexity of the self-attention mechanism remains a bottleneck for handling ultra-long sequences. In response, simple yet effective linear models like DLinear 28 and TimeMixer 23 have emerged, challenging the necessity of complex architectures. While linear models are efficient, they often lack the capacity to capture complex non-linear dynamics and global semantic contexts compared to deep models. Our work integrates a streaming linear branch to preserve the robustness of linear trends while leveraging other modalities for complex feature extraction. 2.2 Frequency domain Frequency domain analysis offers a unique perspective for capturing periodic patterns in time series. Several studies have attempted to combine deep learning with frequency transforms 30 ; 9 ; 27 . However, FFT-based methods and global filters rely on global basis functions, making them less effective at capturing local non-stationary variations and transient anomalies. In contrast, wavelet-based methods such as WPMixer 13 and FDNet 9 provide superior time-frequency localization capabilities. Specifically, WPMixer utilizes wavelet packet decomposition to disentangle multi-scale features, enabling the model to capture fine-grained details that are often missed by global frequency transforms. Building on this, TriTS adopts a multi-resolution wavelet mixing strategy to explicitly disentangle trend and noise components, further addressing the limitations of global frequency operations in non-stationary environments. 2.3 Vision domain Inspired by the immense success of computer vision 3 ; 7 ; 17 , recent research explores transforming time series into image-like formats to leverage powerful vision backbones. TimesNet 24 transforms 1D time series into 2D tensors based on multiple periods, utilizing 2D convolutional kernels to capture intra-period and inter-period variations, effectively

Read the complete text