Channel-wise Retrieval for Multivariate Time Series Forecasting
Junhyeok Kang \sthanks Corresponding author, Jun Seo, Soyeon Park, Sangjun Han, Seohui Bae, Hyeokjun Choe, Soonyoung Lee · 2026
Read Channel-wise Retrieval for Multivariate Time Series Forecasting by Junhyeok Kang \sthanks Corresponding author, Jun Seo, Soyeon Park, Sangjun Han, Seohui Bae, Hyeokjun Choe, Soonyoung Lee (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-05543.txt.
Introduction
Kang and six colleagues predict multi-series futures by fetching past segments per series, not one shared set for all. Their CRAFT pipeline first trims the candidate pool with a sparse time-domain link graph, then ranks by frequency-domain match. On seven public test sets it beats top rivals with usable run speed.
Catalog record
| CREATOR | Junhyeok Kang \sthanks Corresponding author, Jun Seo, Soyeon Park, Sangjun Han, Seohui Bae, Hyeokjun Choe, Soonyoung Lee |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 19479 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.05543
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Channel-wise Retrieval for Multivariate Time Series Forecasting Junhyeok Kang \sthanks Corresponding author, Jun Seo, Soyeon Park, Sangjun Han, Seohui Bae, Hyeokjun Choe, Soonyoung Lee Abstract Multivariate time series forecasting often struggles to capture long-range dependencies due to fixed lookback windows. Retrieval-augmented forecasting addresses this by retrieving historical segments from memory, but existing approaches rely on a channel-agnostic strategy that applies the same references to all variables. This neglects inter-variable heterogeneity, where different channels exhibit distinct periodicities and spectral profiles. We propose CRAFT ( C hannel-wise r etrieval- a ugmented f orecas t ing), a novel framework that performs retrieval independently for each channel. To ensure efficiency, CRAFT adopts a two-stage pipeline: a sparse relation graph constructed in the time domain prunes irrelevant candidates, and spectral similarity in the frequency domain ranks references, emphasizing dominant periodic components while suppressing noise. Experiments on seven public benchmarks demonstrate that CRAFT outperforms state-of-the-art forecasting baselines, achieving superior accuracy with practical inference efficiency. † † address: LG AI Research, Republic of Korea 1 Introduction Multivariate time series forecasting plays a pivotal role in various real-world applications, including demand prediction, traffic management, and weather forecasting. [ 4 , 9 , 5 ] . A central challenge lies in capturing long-range temporal dependencies, since conventional models rely on fixed-length lookback windows that confine the receptive field to recent history and often miss distant yet informative signals [ 18 , 16 , 22 ] . Retrieval-augmented forecasting has recently emerged as a promising remedy [ 2 , 13 , 8 , 7 , 6 ] . By retrieving relevant historical segments from external memory, models can effectively extend their horizon and incorporate long-range information without enlarging model capacity. However, most existing retrieval-augmented methods adopt a channel-agnostic strategy in which a single multivariate segment is retrieved from memory and shared across all variables [ 2 , 8 ] . In other words, once a reference segment is selected, every channel is forced to use the same retrieved timeline, regardless of its individual characteristics. This design neglects inter-variable heterogeneity, in which different variables often exhibit distinct characteristics. A reference that is highly informative for one channel may be irrelevant for another, resulting in suboptimal retrieval. Figure 1 illustrates this contrast: channel-agnostic retrieval ( green ) applies the same multivariate reference across all variables, whereas channel-wise retrieval ( red ) allows each channel to retrieve its own relevant references. Figure 1: Comparison of retrieval strategies. In channel-agnostic retrieval, all variables use the same retrieved multivariate segment. In channel-wise retrieval (ours), each variable independently retrieves its own references, respecting heterogeneity across variables. In this regard, we propose CRAFT, a framework that performs channel-wise retrieval, where each variable independently retrieves its own historical references. This design explicitly addresses heterogeneity by matching each channel with references that reflect its spectral characteristics, such as dominant periodic patterns. A naive implementation, however, would require every variable to search exhaustively across the entire memory, resulting in prohibitive complexity. To ensure efficiency, we adopt a two-stage retrieval pipeline. In the first stage, a sparse relation graph is constructed in the time domain to precompute inter-variable similarities and restrict each channel to a compact set of related candidates. In the second stage, these candidates are ranked by spectral similarity in the frequency domain, which emphasizes dominant periodic components while suppressing high-frequency noise. This enables variable-specific retrieval at scale, avoiding the expense of exhaustive search. Our contributions are summarized as follows: • We introduce the channel-wise retrieval paradigm for multivariate time series forecasting, where each variable independently retrieves its own references instead of sharing a common segment. • We design a two-stage retrieval mechanism for efficient inference: a sparse relation graph prunes unrelated variables, and spectral similarity identifies variable-specific references. • We validate CRAFT on seven public benchmarks, demonstrating superior forecasting performance compared to state-of-the-art baselines. 2 Related Work Multivariate Time Series Forecasting. Multivariate time series forecasting has been studied extensively, with early approaches based on statistical models such as ARIMA [ 15 ] and VAR [ 24 ] , and more recent advances leveraging deep neural networks including RNNs [ 14 ] , CNNs [ 19 ] , and Transformer-based architectures [ 20 , 12 , 23 ] . While these methods have shown strong performance, they are fundamentally limited by fixed-length lookback windows, which confine the receptive field to recent history and often fail to capture long-range dependencies without significantly increasing model size. Retrieval-Augmented Time Series Forecasting. Retrieval-augmented forecasting has emerged as a promising alternative, extending context by retrieving relevant historical segments from memory. RAFT [ 2 ] , for example, demonstrates that incorporating retrieved trajectories can substantially improve long-horizon forecasting by effectively accessing information beyond the local window. However, existing retrieval-augmented methods [ 3 , 21 ] typically employ a channel-agnostic strategy, where a single retrieved segment is uniformly applied across all variables. This overlooks the heterogeneity among variables—each with its own periodicity, seasonality, and dynamics—and can lead to mismatched retrieval and degraded forecasting performance. 3 Method 3.1 Problem Definition Given a multivariate time series \mathbf{X}_{t-T+1:t}\in\mathbb{R}^{T\times C} , where T is the history length and C is the number of variables, multivariate time series forecasting aims to predict the future horizon \mathbf{Y}_{t+1:t+H}\in\mathbb{R}^{H\times C} of length H . The prediction is made based on a lookback window \mathbf{X}_{t-L+1:t}\in\mathbb{R}^{L\times C} with L\ll T . In the retrieval-augmented paradigm, the model additionally has access to a memory \mathcal{M}=\{(\mathbf{K}_{m},\mathbf{V}_{m})\}_{m=1}^{M} , where \mathbf{K}_{m}\in\mathbb{R}^{L\times C} is a past lookback window (key) and \mathbf{V}_{m}\in\mathbb{R}^{H\times C} its future horizon (value). At inference, the model retrieves relevant references from \mathcal{M} to extend the available context beyond the lookback window. 3.2 Overall Framework Figure 2: Overall procedure of CRAFT. Each query variable first selects related candidates through a precomputed sparse relation graph, then retrieves variable-specific references from historical memory using spectral similarity. Unlike channel-agnostic approaches that retrieve a single multivariate segment and apply it uniformly to all variables, CRAFT performs channel-wise retrieval , where each variable independently selects references tailored to its own characteristics. A direct implementation of this idea would require each variable to compare against the entire memory, which is computationally prohibitive. As illustrated in Fig 2 , to make channel-wise retrieval feasible, CRAFT employs a two-stage pipeline: (1) a sparse relation graph in the time domain prunes unrelated variables and restricts retrieval to a compact set of candidates, and (2) spectral similarity in the frequency domain ranks these candidates and identifies variable-specific references. This design enables variable-level retrieval that is both accurate and efficient. 3.3 Channel-wise Retrieval for Multivariate Time Series 3.3.1 Knowledge Base Construction The first step of CRAFT is to construct a channel-wise knowledge base from the memory \mathcal{M} . Naively comparing every variable pair across all samples would be quadratic in C and infeasible. To address this, we precompute inter-variable similarities and retain only the most relevant neighbors for each variable. For each variable i , its trajectories across all training samples are concatenated into \mathbf{z}_{i}\in\mathbb{R}^{N\cdot L} , where N is the number of memory samples. Cosine similarity is used to measure inter-variable relations: \text{sim}(i,j)=\frac{\mathbf{z}_{i}^{\top}\mathbf{z}_{j}}{\|\mathbf{z}_{i}\|\,\|\mathbf{z}_{j}\|}. (1) Each variable i is connected to its top- M most similar variables, forming a sparse relation graph \mathcal{G} . This graph prunes unrelated variables and