Unicorn: Scaling High-Dimensional Time Series Forecasting via Universal Correlation Modeling
Haochen Yuan, Yichen Song, Yunbo Wang, Xiaokang Yang · 2026
Read Unicorn: Scaling High-Dimensional Time Series Forecasting via Universal Correlation Modeling by Haochen Yuan, Yichen Song, Yunbo Wang, Xiaokang Yang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30376.txt.
Introduction
Haochen Yuan, Yichen Song, Yunbo Wang and Xiaokang Yang introduce Unicorn, a tool for training on many time-series sets. Solo models scale well but miss links across channels, while Linked models are strong but stuck in one size. At Unicorn's core is a codebook of latent prototypes that splits link modeling from channel names. By mapping mixed channels into one shared latent space, Unicorn learns link patterns across fields. Tests show Unicorn beats leading forecasters, most of all in few-shot transfer, pointing to time-series base models.
Catalog record
| CREATOR | Haochen Yuan, Yichen Song, Yunbo Wang, Xiaokang Yang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61566 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30376
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Unicorn: Scaling High-Dimensional Time Series Forecasting via Universal Correlation Modeling Haochen Yuan, Yichen Song, Yunbo Wang, Xiaokang Yang Abstract Modern time series architectures face a fundamental trade-off: channel-independent models scale well with increasing data volume but ignore critical inter-channel dependencies, while channel-dependent models are expressive but remain “dimension-bounded”, struggling to generalize across heterogeneous datasets. To bridge this gap, we introduce Unicorn (Universal Correlation Network), a framework for scalable, multi-dataset pretraining on high-dimensional time series. At the core of Unicorn is a latent prototype codebook that decouples correlation modeling from specific channel identities. By projecting heterogeneous channels into a shared latent space, UniCorN learns identity-agnostic, reusable interaction patterns that transfer across domains with diverse dimensionalities and semantics. Extensive experiments show that Unicorn significantly outperforms state-of-the-art forecasting architectures, particularly in few-shot transfer scenarios, offering a scalable path toward multivariate time series foundation models. Figure 1: Performance on a 587-stock A-share dataset. The radar chart benchmarks model performance across four key dimensions: efficiency, generalization, scalability, and few-shot adaptability. Scalability is evaluated by the performance delta between full-channel and 25\% channel configurations during finetuning and inference. Few-shot performance is measured by finetuning on a restricted 25\% subset of the training data. 1 Introduction High-dimensional time series forecasting is at the heart of many real-world applications, ranging from financial market analysis to large-scale energy system management and climate modeling. In these domains, systems must jointly reason over hundreds or even thousands of correlated variables ( i.e. , input channels). Despite recent advances in time series foundation models, scaling modern architectures to such high-dimensional settings remains challenging. This challenge arises from the fundamental conflicts between domain scalability and correlation modeling : On one hand, channel-independent (CI) models ( 23 ; 5 ) process each variable independently with shared parameters, which scales well across heterogeneous datasets but discards inter-channel interactions. On the other hand, channel-dependent (CD) models ( 12 ; 38 ) explicitly capture interactions among variables, typically through multi-head attention mechanisms that are inherently tied to specific channel identities and fixed dimensionalities. Despite ignoring inter-channel dependencies, recent empirical studies show that CI models often outperform their CD counterparts in multivariate forecasting tasks ( 23 ) . This seemingly paradoxical result suggests a key limitation of existing CD approaches: by tightly coupling correlation modeling to fixed channel identities, they learn dataset-specific dependencies that fail to generalize. This issue is particularly pronounced in high-dimensional regimes, where correlations are sparse and unevenly observed, making CD models prone to overfitting. For example, in financial markets where the number of sequences is smaller than the number of assets ( M<N ), CD models struggle to distinguish structural signals from noise, while CI models benefit from an implicit data multiplication effect ( M\times N ), yielding stronger generalization. These observations motivate a central hypothesis: the limitation of CD models lies NOT in modeling correlations per se, but in the scale and manner in which they are learned. Building on this insight, we propose Unicorn (Universal Correlation Network), a unified framework that decouples correlation modeling from explicit channel identities to enable scalable pretraining across heterogeneous datasets. Our design starts with a basic assumption: while physical channel identities vary across domains, the underlying interaction laws ( e.g. , similar sector-level co-movements across different stock markets) often present universal properties. Unicorn achieves this with a learnable Latent Prototype Codebook , which functions as a shared set of abstract anchors for the joint modeling of diverse variables. To align heterogeneous channels with these anchors, we introduce a Spectral Global Guidance module that employs frequency-informed features to bridge semantic gaps. Rather than parameterizing direct channel-to-channel interactions, UniCorN routes dependencies through a channel-to-prototype interaction mechanism. By treating prototypes as an intermediate “interaction bottleneck”, the model captures complex relational structures in an identity-agnostic manner, effectively bridging the gap between cross-domain scalability and expressive inter-channel correlation modeling. Extensive experiments demonstrate that Unicorn significantly outperforms state-of-the-art CI foundation models, including TimesFM ( 5 ) and Kronos ( 23 ) , as well as specialized CD architectures. We empirically demonstrate that Unicorn effectively mitigates the overfitting issues of CD methods and shows strong scaling effects as the pretraining data volume increases. 2 Problem Formalization We consider multi-dataset pretraining for high-dimensional time series forecasting. Given an input sequence \mathbf{X}\in\mathbb{R}^{C\times I} spanning a lookback window of length I across C variables (channels), our objective is to predict the future values \mathbf{Y}\in\mathbb{R}^{C\times O} for a horizon of length O . This high-dimensional setting poses two fundamental challenges: First, standard CD models incur O(C^{2}) complexity. When C is large ( e.g. , hundreds or thousands) and exceeds temporal observations ( C>I ), these models suffer from parameter explosion and severe overfitting. Second, in large-scale pretraining, C varies across datasets ( C\in\{C_{1},C_{2},\dots\} ). Fixed-dimension interaction matrices ( \mathbb{R}^{C\times C} ) are incompatible with joint training on heterogeneous channel sets. 3 Related Work Multivariate time series forecasting is commonly organized around channel independent (CI) and channel dependent (CD) paradigms. CI methods model each variate separately, which often improves robustness and scalability under heterogeneous short-term dynamics ( 19 ; 18 ; 21 ; 11 ; 37 ) . Representative CI models include TiDE ( 4 ) , Non-stationary Transformers ( 15 ) , TEMPO ( 2 ) , PDF ( 24 ) , and SparseTSF ( 22 ) . While CD methods explicitly exploit inter-channel dependencies, direct coupling often degrades generalization ( 28 ; 25 ; 39 ; 34 ; 26 ) . Existing CD research can be broadly categorized into three primary directions. First, sequential and probabilistic models, such as DeepAR ( 7 ) , GRU-D ( 3 ) , and TimeGrad ( 20 ) , capture correlations by sharing global temporal dynamics. Second, graph-based methods, such as MTGNN ( 32 ) , explicitly model relational structures to facilitate information propagation across channels. Finally, attention- or mixing-based architectures directly aggregate variate-level representations, including iTransformer ( 13 ) , Crossformer ( 36 ) , TimeMixer ( 27 ) , and a range of related approaches ( 40 ; 17 ; 31 ; 38 ; 30 ) . More recent methods, such as TimeBridge ( 12 ) , further incorporate cointegration-aware attention to model long-term dependencies, while SOFTS ( 10 ) introduces an efficient aggregate-redistribute mechanism for scalable cross-variate modeling. Time series foundation models aim at strong zero-shot and few-shot performance across domains with large-scale pretraining on massive time series data. Typical architectures include decoder-only ( 5 ; 39 ; 16 ; 33 ; 14 ; 1 ) , encoder-only ( 9 ; 29 ) , and encoder-decoder models ( 8 ) . TimesFM ( 5 ) and Kronos ( 23 ) are designed with CI architectures that process multivariate inputs without explicitly modeling inter-channel dependencies. While they can handle datasets with varying channel dimensions, they do not differentiate between channels during pretraining, focusing solely on temporal dependencies. Unlike TimesFM and Kronos, our method overcomes this limitation through domain-invariant prototype interaction, enabling channel-dependent modeling and multi-dataset pretraining simultaneously, which makes it particularly well-suited for high-dimensional forecasting. 4 Method To enable domain scalability, Unicorn is founded upon a guiding principle: inter-channel dependencies should be modeled in a shared latent interaction space rather than via explicit channel-to-channel parameterization. The core idea is