Moirai 2.0: When Less Is More for Time Series Forecasting
Chenghao Liu Taha Aksu Juncheng Liu Xu Liu Hanshu Yan Quang Pham Silvio Savarese Doyen Sahoo Caiming Xiong Junnan Li Salesforce AI Research https://github.com/SalesforceAIResearch/uni2ts https://huggingface.co/Salesforce/moirai-2.0-R-small · 2025
Read Moirai 2.0: When Less Is More for Time Series Forecasting by Chenghao Liu Taha Aksu Juncheng Liu Xu Liu Hanshu Yan Quang Pham Silvio Savarese Doyen Sahoo Caiming Xiong Junnan Li Salesforce AI Research https://github.com/SalesforceAIResearch/uni2ts https://huggingface.co/Salesforce/moirai-2.0-R-small (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-11698.txt.
Introduction
Chenghao Liu and nine co-authors present Moirai 2.0, a time series foundation model rebuilt around the idea that simpler can forecast better. Trained on a fresh corpus of thirty-six million series, it uses a decoder-only design with quantile forecasting, which predicts ranges rather than single points, and multi-token prediction for speed.
Compared with its predecessor, masked-encoder training, multi-patch inputs, and mixture outputs are all dropped. Ablations credit the decoder backbone and recursive multi-quantile decoding for most of the gains. On the Gift-Eval benchmark the smaller, simpler model ranks among the top pretrained systems, a useful data point in debates about scaling time series models.
Catalog record
| CREATOR | Chenghao Liu Taha Aksu Juncheng Liu Xu Liu Hanshu Yan Quang Pham Silvio Savarese Doyen Sahoo Caiming Xiong Junnan Li Salesforce AI Research https://github.com/SalesforceAIResearch/uni2ts https://huggingface.co/Salesforce/moirai-2.0-R-small |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-11698
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Moirai 2.0: When Less Is More for Time Series Forecasting Chenghao Liu Taha Aksu Juncheng Liu Xu Liu Hanshu Yan Quang Pham Silvio Savarese Doyen Sahoo Caiming Xiong Junnan Li Salesforce AI Research https://github.com/SalesforceAIResearch/uni2ts https://huggingface.co/Salesforce/moirai-2.0-R-small Abstract We introduce Moirai 2.0, a decoder-only time-series foundation model trained on a new corpus of 36M series. The model adopts quantile forecasting and multi-token prediction, improving both probabilistic accuracy and inference efficiency. On the Gift-Eval benchmark, it ranks among the top pretrained models while achieving a strong trade-off between accuracy, speed, and model size. Compared to Moirai 1.0, Moirai 2.0 replaces masked-encoder training, multi-patch inputs, and mixture-distribution outputs with a simpler decoder-only architecture, single patch, and quantile loss. Ablation studies isolate these changes—showing that the decoder-only backbone along with recursive multi-quantile decoding contribute most to the gains. Additional experiments show that Moirai 2.0 outperforms larger models from the same family and exhibits robust domain-level results. In terms of efficiency and model size, Moirai 2.0 is twice as fast and thirty times smaller than its prior best version, Moirai 1.0-Large, while also performing better. Model performance plateaus with increasing parameter count and declines at longer horizons, motivating future work on data scaling and long-horizon modeling. We release code and evaluation details to support further research. 1 Introduction Time series forecasting underpins capacity planning, anomaly response, and risk management across cloud infrastructure, observability, finance, energy, retail, and healthcare. Unlike text or images, time series exhibit nonstationarity, multi-scale temporal structure, irregular sampling, and incomplete observations, making generalization beyond a single domain both important and challenging. To tackle these, some early attempts on foundation models (FMs) for time series have been proposed and shown some promising results on cross-domain reuse, zero/few-shot adaptation, and unified deployment at scale. Moreover, foundation models for time series have rapidly evolved from early exploratory attempts just a few years ago to becoming a central research direction with significantly growing adoption in industry. Today, the landscape includes dozens of pretrained time series foundation models from both academia and industry. Representative examples from industry include TimesFM [ 9 ] from Google, Chronos/Chronos-Bolt [ 3 ] and Chronos 2 [ 2 ] from Amazon, TOTO [ 8 ] from Datadog, and YingLong [ 32 ] from Alibaba. Community benchmarks from industry, such as Gift-Eval benchmark [ 1 ] and fev-bench [ 29 ] , also have accelerated progress by standarizing datasets, metrics and reporting performance of different models. A clear sign of this progress is that the Gift-Eval benchmark [ 1 ] has already received 25 foundation model submissions since its launch, showing the growing interest from the community. Our previous work, Moirai 1.0 [ 34 ] , was among the first attempts to scale the transformer architecture for time series. It demonstrated that large-scale time-series pretraining can yield strong generalization across domains, while also providing a blueprint for subsequent foundation models. While effective, Moirai 1.0 has also revealed several limitations. Its masked-encoder design led to inefficient data utilization during training, and the multi-patch setup constrained learning across different temporal frequencies. Moreover, while outputting a mixture of distributions was an intuitive way to enhance probabilistic forecasting, it proved empirically less effective in practice and added substantial complexity to both the model design and optimization process. In this work, we introduce Moirai 2.0, a successor model that incorporates several architectural and training refinements. Key improvements include the adoption of quantile-based predictions with a refined loss function, a decoder-only autoregressive architecture, and multi-token prediction strategy with a single patch size, along with additional optimization techniques applied during both pretraining and inference. We have also curated a new pretraining datasets to train this model which includes 36M time series and \sim 295B observations. These changes substantially improve the accuracy and efficiency of our model, making it the best-performing model at the time of its release. As of today, it remains highly competitive, ranking 5th among 37 foundation models (including all size variants) on the Gift-Eval leaderboard, while offering one of the most favorable trade-offs between inference speed, model size, and accuracy. The remainder of this paper is organized as follows. In Section 2 , we provide the background and discuss related work on time series foundation models. Section 3 introduces the architectural design and training strategies behind Moirai 2.0. Section 4 lists the datasets we used to pretrain our new model. Section 5 presents evaluations on the Gift-Eval benchmark, including efficiency comparisons, scaling experiments, and ablation studies. Section 6 outlines the limitations of our current approach and highlights future research directions. Finally, Section 7 summarizes our findings and concludes the paper. 2 Background & Related Work The time series point forecasting task is defined as predicting the future H values given a historical sequence with c values, i.e. let the historical context be Y_{1:c}=\{y_{1},y_{2},...,y_{c}\} the target sequence to predict would be Y_{c+1:c+H}=\{y_{c+1},y_{c+2},...,y_{c+H}\} . The forecasting task can naturally extend to the multivariate setting where one is expected to predict multiple variates simultaneously i.e. Y^{1}_{c+1:c+H},Y^{2}_{c+1:c+H},...Y^{N}_{c+1:c+H} . Moirai 2.0, however, does not support cross-variate forecasting. Instead, we treat multivariate forecasting as a collection of independent univariate tasks. Moirai 2.0 does not only predict point but quantile forecast, where the difference in definition comes at the prediction level. For quantile forecast given the same historical context Y_{1:c} , the target prediction is now the quantile levels for each future time step Q_{c+1:c+H}=\{Q_{c+1},Q_{c+2},...,Q_{c+H}\} where Q_{i}=\{q_{l_{1}}^{i},q_{l_{2}}^{i},...,q_{l_{q}}^{i},\} , l_{1} through l_{q} being the quantile levels. We set the quantile levels as \{0.1,0.2,...,0.9\} . Quantile forecasts offer a principled way to model uncertainty, as they are directly optimized for probabilistic forecasting accuracy. The family of time series forecasting models can be categorized into 3 classes: statistical models, deep-learning models and foundation models. The statistical models work locally and rely solely on historical data statistics to predict future values. Some of the most widely used ones are ETS [ 18 ] , Theta [ 13 ] , and ARIMA [ 5 ] . Deep learning models, in contrast, are often dataset-specific, as each dataset typically requires training a dedicated model. Examples include N-BEATS [ 26 ] , DLinear [ 37 ] , and DeepAR [ 12 ] , which are based on pre-transformer architectures. In contrast, transformer-based approaches such as Autoformer [ 35 ] , Crossformer [ 39 ] , and PatchTST [ 24 ] have also been proposed. In the last few years, the success of foundation models in language and vision has also attracted time series researchers. What initially started as a handful of early attempts [ 14 , 28 , 34 ] has now grown into a rapidly expanding landscape, with more than 25 time series foundation models being publicized in the last 2 years. The architecture and training strategies of time series foundation models vary considerably. Notably, two prominent approaches do not directly rely on transformer architectures: TabPFN-TS [ 17 ] , which employs a Prior-Data Fitted Network (PFN), and TiRex [ 4 ] , which is built on an xLSTM. The majority of other models, however, rely on transformer variants. Within the transformer family, some models adopt an encoder-only design, such as Chronos-2 [ 2 ] , Yinglong [ 32 ] , and the first version of our Moirai [ 34 ]