CPiRi: Channel Permutation-Invariant Relational Interaction for Multivariate Time Series Forecasting
Jiyuan Xu, Wenyu Zhang, Xin Jing, Shuai Chen, Shuai Zhang, Jiahao Nie · 2026
Read CPiRi: Channel Permutation-Invariant Relational Interaction for Multivariate Time Series Forecasting by Jiyuan Xu, Wenyu Zhang, Xin Jing, Shuai Chen, Shuai Zhang, Jiahao Nie (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-20318.txt.
Introduction
Jiyuan Xu and five colleagues present CPiRi, a method for forecasting many related time series at once. Existing methods split into two camps. Channel-dependent models learn links between series but can overfit their order, so they adapt poorly when channels are added or shuffled. Channel-independent models treat each series alone, which is flexible but misses cross-links.
CPiRi is built to be invariant to channel permutation while still modeling relational interaction between channels. That pairing aims at both flexibility and accuracy. It matters for sensor networks and finance feeds, where the set and order of series change often.
Catalog record
| CREATOR | Jiyuan Xu, Wenyu Zhang, Xin Jing, Shuai Chen, Shuai Zhang, Jiahao Nie |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-20318
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
CPiRi: Channel Permutation-Invariant Relational Interaction for Multivariate Time Series Forecasting Jiyuan Xu, Wenyu Zhang, Xin Jing, Shuai Chen, Shuai Zhang, Jiahao Nie Abstract Current methods for multivariate time series forecasting can be classified into channel-dependent and channel-independent models. Channel-dependent models learn cross-channel features but often overfit the channel ordering, which hampers adaptation when channels are added or reordered. Channel-independent models treat each channel in isolation to increase flexibility, yet this neglects inter-channel dependencies and limits performance. To address these limitations, we propose CPiRi , a channel permutation invariant (CPI) framework that infers cross-channel structure from data rather than memorizing a fixed ordering, enabling deployment in settings with structural and distributional co-drift without retraining. CPiRi couples spatio-temporal decoupling architecture with permutation-invariant regularization training strategy : a frozen pretrained temporal encoder extracts high-quality temporal features, a lightweight spatial module learns content-driven inter-channel relations, while a channel shuffling strategy enforces CPI during training. We further ground CPiRi in theory by analyzing permutation equivariance in multivariate time series forecasting. Experiments on multiple benchmarks show state-of-the-art results. CPiRi remains stable when channel orders are shuffled and exhibits strong inductive generalization to unseen channels even when trained on only half of the channels, while maintaining practical efficiency on large-scale datasets. The source code is released at JasonStraka/CPiRi . 1 Introduction Figure 1: Conceptual overview of the CPiRi framework. Top: channel-dependent models often overfit to channel order, leading to performance collapse in channel permutation invariance (CPI) tests. Middle: channel-independent models lack cross-channel interaction. Bottom: CPiRi resolves this by (1) using a frozen encoder for robust temporal feature extraction, and (2) training a channel permutation-equivariant spatial module with a channel shuffling strategy to learn generalizable, content-based relationships, ensuring both high accuracy and near-invariant robustness under channel shuffling. Multivariate time series forecasting (MTSF) is critical in domains like finance and transportation, where modeling inter-channel relationships is essential ( 28 ) . Research in this area has largely bifurcated into two paradigms with a paradoxical trade-off: channel-independent (CI) and channel-dependent (CD) models ( 21 ) . CD models, spanning architectures from graph neural networks (GNNs) to Transformers, explicitly model relational interactions across channels. Despite their sophisticated designs, many exhibit a critical limitation: they overfit to the static positional configurations of training data rather than learning semantic relationships. As illustrated in Fig. 1 , these models memorize channel order instead of content-driven dependencies. Consequently, they suffer catastrophic degradation when encountering channel permutations or new channels during inference, which are common scenarios in real-world dynamic systems and typical of structural co-drift in real deployments (e.g., sensor networks or evolving financial metrics). This positional rigidity fundamentally undermines their robustness and adaptability. Conversely, CI models (e.g., DLinear ( 27 ) , PatchTST ( 19 ) ) process channels independently, ensuring robustness against noise and channel heterogeneity ( 21 ) . However, they ignore cross-channel interactions, sacrificing the core advantage of multivariate analysis and limiting forecasting performance. This dichotomy presents a fundamental dilemma: CD models capture essential interactions but lack adaptability, while CI models ensure robustness at the cost of relational reasoning. To address this, we posit that models should achieve channel permutation invariance (CPI), i.e. maintaining performance regardless of channel ordering or additions, without compromising interaction modeling. To validate this need, we introduce a CPI diagnostic: models genuinely understanding channel relationships should exhibit stability under channel shuffling. Our tests reveal alarming fragility in state-of-the-art (SOTA) CD models. For instance, on PEMS-08 (Sec. 4.2 ), Informer’s error increases by >400% under channel shuffling, confirming reliance on positional memorization rather than relational reasoning. The ultimate goal of MTSF is not merely to pass a permutation test but to develop models that are both accurate and generalizable. The CPI diagnostic serves as a crucial litmus test that exposes index- and topology-dependence, a failure mode that blocks deployment under co-drift. In this paper, we propose CPiRi ( C hannel P ermutation- I nvariant R elational I nteraction), a novel framework that models cross-channel dependencies in a CPI manner while synergizing CI and CD strengths. CPiRi integrates two core innovations: spatio-temporal decoupling based model architecture and permutation-invariant regularization based training strategy. The architecture consists of a frozen pre-trained temporal encoder and a lightweight, trainable spatial module. The encoder extracts channel-specific features independently, preserving CI advantages (robustness, noise immunity). The spatial module then models relational interactions across channels using only content-based cues, eliminating positional bias. This decoupling isolates temporal learning from relational reasoning, enabling the model to inherit CI stability while capturing CD interactions. The permutation-invariant regularization based training strategy employs dynamic channel shuffling during training, which removes positional shortcuts and forces the spatial module to learn content-driven relational reasoning. By exposing the model to diverse channel configurations, it acquires a meta-skill for generalizable interaction modeling, ensuring CPI without sacrificing accuracy. Our contributions are as follows: • The CPiRi framework, resolving the CI-CD trade-off via channel permutation-invariant relational interaction. • A spatio-temporal decoupled architecture combining a frozen temporal encoder (CI) and content-aware spatial module (CD). • A permutation-invariant regularization strategy using channel shuffling to enforce content-driven relational reasoning. • SOTA results on benchmarks with: negligible degradation under channel shuffling; strong inductive generalization to unseen channels (e.g., trained on only half the channels) without retraining; and improved robustness in low-data regimes, where the regularization strategy is most beneficial. 2 Related Work Channel-dependent models. CD approaches represent the mainstream of MTSF research. However, early methods like GNNs (e.g., MTGNN ( 24 ) ) learn rigid, static graphs, while subsequent Transformer-based models (e.g., Crossformer ( 29 ) ) often overfit to channel order by treating channels as a fixed sequence. While many recent studies propose sophisticated architectures to improve robustness or generalization, such as through adaptive hypergraphs ( 4 ) , channel-aligned transformers ( 25 ) , dual unmixing structures ( 31 ) , context-aware transformers ( 8 ) , or by focusing explicitly on latent space generalization ( 5 ) , they tend to add model complexity without resolving the fundamental positional dependency. Furthermore, recent large models like Timer-XL ( 17 ) are ill-suited for typical MTSF tasks. They demand extensive pre-training and are computationally expensive, leading to poor performance on smaller datasets and practical scaling issues due to memory constraints. The framework of CPiRi, while primarily designed for CPI, offers a critical side-benefit: it resolves this dilemma by avoiding the need for massive data and complex spatial pre-training, making it a more practical and effective solution. Channel-independent models. CI approaches, exemplified by DLinear ( 27 ) and the SOTA PatchTST ( 19 ) , prioritize robustly modeling each channel’s temporal patterns independently. While efficient and inherently permutation-invariant, their fundamental limitation is the neglect of cross-channel dynamics. A new frontier involves large foundation models like Chronos-Bolt ( 2 ) and Sundial ( 18 ) . These models are often discussed in the broader context of applying large model concepts to time series analysis ( 10 ) and are trained on diverse datasets ( 20 ) , with some proposing novel objectives like predicting curve shapes ( 6 ) . However, our work is one of the first to effectively integrate a powerful, pre-trained univariate foundation model (Sundial) into a multivariate task. By using Sundial as a frozen feature extractor, CPiRi isolates the