Foundation models for time series forecasting: Application in conformal prediction
Sami Achour, Yassine Bouher, Duong Nguyen, Nicolas Chesneau · 2025
Read Foundation models for time series forecasting: Application in conformal prediction by Sami Achour, Yassine Bouher, Duong Nguyen, Nicolas Chesneau (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-08858.txt.
Introduction
Sami Achour and co-authors test foundation models for time series forecasting in a paper from two thousand twenty-five. Conformal prediction wraps a forecast in an interval with a stated coverage rate. It needs held-out data for calibration, which competes with training data for classic models.
Foundation models forecast with no task training, so nearly all data can go to calibration. The team compares them with statistical models and gradient boosting inside this setup. When data were scarce, the foundation models gave more reliable intervals, thanks to better raw accuracy. Their calibration was also more stable. The scarcer the data, the bigger the edge. Code is shared for replication.
Catalog record
| CREATOR | Sami Achour, Yassine Bouher, Duong Nguyen, Nicolas Chesneau |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-08858
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Foundation models for time series forecasting: Application in conformal prediction Sami Achour, Yassine Bouher, Duong Nguyen, Nicolas Chesneau Abstract The zero-shot capabilities of foundation models (FMs) for time series forecasting offer promising potentials in conformal prediction, as most of the available data can be allocated to calibration. This study compares the performance of Time Series Foundation Models (TSFMs) with traditional methods, including statistical models and gradient boosting, within a conformal prediction setting. Our findings highlight two key advantages of TSFMs. First, when the volume of data is limited, TSFMs provide more reliable conformalized prediction intervals than classic models, thanks to their superior predictive accuracy. Second, the calibration process is more stable because more data are used for calibration. Morever, the fewer data available, the more pronounced these benefits become, as classic models require a substantial amount of data for effective training. These results underscore the potential of foundation models in improving conformal prediction reliability in time series applications, particularly in data-constrained cases. All the code to reproduce the experiments is available on GitHub . 1 Introduction Accurate forecasting of time series is crucial for informed decision-making and strategic planning in various domains, such as finance Lee et al. 2021a , healthcare Parker et al. 2024a , climate science Abbass et al. 2022a , and retails Carbonneau et al. 2008a . Machine learning approaches, ranging from classical statistical methods (e.g., ARIMA Box & Jenkins 1970a , exponential smoothing Hyndman & Athanasopoulos 2021a ) to tree-based models (e.g., XGBoost Chen & Guestrin 2016a , LightGBM Ke et al. 2017a , CatBoost Dorogush et al. 2018a ) and modern deep learning architectures (e.g., DeepAR Salinas et al. 2019a , Autoformer Wu et al. 2022a , FEDformer Zhou et al. 2022a , TFT Lim et al. 2020a , and PatchTST Nie et al. 2023a ) have been widely used to tackle this challenge Kolassa et al. 2023a . Recently, the emergence of foundation models (FMs) for time series presents new opportunities for enhancing forecast accuracy and reliability Aksu et al. 2024a ; Liang et al. 2024a . Foundation models, characterized by the pre-training of large-scale models on extensive and diverse datasets, are designed to learn a wide range of patterns and representations, which can then be applied, fine-tuned or adapted for specific downstream tasks across various domains with zero or minimal additional training. The foundation models approach utilizes the broad knowledge gained during pre-training, allowing models to generalize well and perform tasks in a zero-shot Xian et al. 2018a or few-shot Song et al. 2022a mode, which reduces the need for large volumes of task-specific data. Foundation models have achieved remarkable success in Natural Language Processing (NLP) Khurana et al. 2022a , Computer Vision (CV) Chai et al. 2021a , and are increasingly being explored for its potential in other areas, including time series modeling Liang et al. 2024a . Several recent efforts have yielded promising results. Notable examples include Nixtla’s TimeGPT Garza et al. 2024a , Amazon’s Chronos Ansari et al. 2024a , or Google’s TimeFM Das et al. 2024a have achieved forecasting accuracy comparable to, or in some cases exceeding, state-of-the-art statistical and machine learning methods Aksu et al. 2024a . The potential of Time Series Foundation Models (TSFMs) is considerable, offering opportunities to reduce predictive errors, enhance model generalisation across diverse time series datasets, and facilitate the integration of multi-modal data to address complex predictive and analytical tasks. In this article, we explore a different aspect of their potential: FMs for time series forecasting in the context of Conformal Prediction (CP). Conformal prediction Shafer & Vovk 2007a is a robust statistical method for uncertainty quantification that provides predictive intervals with a specified confidence level. CP constructs intervals that are expected to contain the true value in a proportion of cases equal to the chosen confidence level, e.g. 90% of the time. To achieve this, CP requires a calibration set—a separate portion of data distinct from the training set. The method first trains a model on the training data, then applies it to the calibration set to assess how well the model’s predictions align with actual outcomes. This alignment enables CP to adjust the interval widths accordingly. For a comprehensive introduction, readers are referred to Angelopoulos & Bate 2021a . While CP is effective for providing reliable uncertainty estimates, the need for a calibration set can be a limitation when data is scarce, as it requires partitioning an already small dataset into training and calibration subsets, which may impact model performance and calibration accuracy. The zero shot prediction capabilities of FMs make them particularly appealing for CP in time series forecasting, as training is no longer a constraint, enabling most available data to be allocated for calibration. In this article, we explore this approach by applying CP to open-source TSFMs on public datasets. Specifically, we tested three TSFMs: Amazon Chronos Ansari et al. 2024a , Lag-Llama Rasul et al. 2024a , and TimesFM Das et al. 2024a on four datasets: ERCOT, NN5 Daily, NN5 Weekly, and M3 Monthly Alexandrov et al. 2020a . These models and datasets were chosen for zero-sot evaluation purposes (i.e. the models have never seen the benchmarking datasets). We compare and evaluate the performance of these models relative to statistical and gradient boosting models. This article is organized as follows: Section 2 provides a concise overview of various FMs and the challenges they face in time series analysis, followed by the introduction of conformal prediction in Section 3 . Section 4 details the experimental procedures. We review related work in Section 5 , and conclude the article with a discussion of our findings in Section 6 . 2 Foundation models for time series forecasting Foundation models (FMs) are large-scale machine learning models trained on vast amounts of data, enabling them to generalize across multiple tasks with minimal or no fine-tuning Bommasani et al. 2021a . These models have recently demonstrated remarkable success, particularly in natural language processing (NLP), computer vision (CV), and multimodal Zhou et al. 2024a . However, applying FMs to time series data presents unique challenges due to the inherent complexities of temporal structures: • Most of FMs are built upon the transformer architecture Vaswani 2017a . The continuity of time series data presents a fundamental challenge for transformer-based models, which are originally designed for discrete token-based inputs, such as those in natural language processing (NLP). Unlike NLP tasks, where predictions are made based on a finite and well-defined vocabulary of tokens, time series data is continuous, requiring models to capture subtle temporal dependencies and variations over an unbounded numerical space. This continuous nature increases the complexity of learning meaningful representations, making it more difficult for transformers to generalize effectively compared to tasks involving discrete sequences. • In time series forecasting, covariates play a crucial role in improving predictive accuracy. These covariates can be static (e.g., demographic information), dynamic (e.g., weather conditions), or even additional time series that evolve alongside the primary series. However, most forecasting models struggle to effectively incorporate covariates, especially when the covariates themselves are time series that require simultaneous prediction. This scenario, known as multivariate time series forecasting, adds another layer of complexity. • While NLP, CV, and multimodal benefit from an