Do global forecasting models require frequent retraining?

Marco Zanotti · 2025

Read Do global forecasting models require frequent retraining? by Marco Zanotti (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-00356.txt.

Introduction

Retail forecasters often retrain their global models every time new sales data lands, and a 2025 arXiv paper by Marco Zanotti asks whether that habit is worth its computing cost. He tested ten machine learning and deep learning models on two large retail demand datasets, under retraining plans from constant updates to none at all.

Accuracy held up under far less frequent retraining, for both single value and probability forecasts. Machine learning models paired with rare retraining cut costs most as data arrived faster. Zanotti argues periodic retraining is the sweet spot, and that the standard always retrain practice wastes energy and money.

Catalog record

CREATORMarco Zanotti
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-00356

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Do global forecasting models require frequent retraining? Marco Zanotti Abstract In an era of increasing computational capabilities and growing environmental consciousness, organizations face a critical challenge in balancing the accuracy of forecasting models with computational efficiency and sustainability. Global forecasting models, lowering the computational time, have gained significant attention over the years. However, the common practice of retraining these models with new observations raises important questions about the costs of forecasting. Using ten different machine learning and deep learning models, we analyzed various retraining scenarios, ranging from continuous updates to no retraining at all, across two large retail datasets. We showed that less frequent retraining strategies maintain the forecast accuracy while reducing the computational costs, providing a more sustainable approach to large-scale forecasting. We also found that machine learning models are a marginally better choice to reduce the costs of forecasting when coupled with less frequent model retraining strategies as the frequency of the data increases. Our findings challenge the conventional belief that frequent retraining is essential for maintaining forecasting accuracy. Instead, periodic retraining offers a good balance between predictive performance and efficiency, both in the case of point and probabilistic forecasting. These insights provide actionable guidelines for organizations seeking to optimize forecasting pipelines while reducing costs and energy consumption. 1 Introduction Forecasting plays a critical role in decision-making processes across industries, from supply chain management to energy demand planning. Traditionally, time series forecasting has relied on a Local Modeling approach (LM), meaning that separate models 1 1 1 We use the words model and method interchangeably even if the two have distinct statistical meanings ( Svetunkov & Boylan 2023 ) . are trained for each series in isolation. However, recent advances have demonstrated the potential of Global forecasting Models (GM), a paradigm also known as cross-learning, which in turn consists of fitting a single forecasting model on the whole data set ( Januschowski et al. 2020 ) . This novel approach allows to leverage information across multiple time series to improve accuracy and generalization by employing machine learning or deep learning architectures 2 2 2 We distinguish between traditional machine learning models, like linear regression or tree-based methods, and deep learning models, those that are based on some sort of neural network architecture. . Global modeling has affirmed itself as one of the most relevant innovations in time series forecasting of recent years ( Semenoglou et al. 2021 ) , and its success is not only due to the demonstrated forecast accuracy in most time series competitions, but also to the particular computational benefit it provides. Indeed, while the local approach to time series forecasting is potentially beneficial for forecast accuracy, it comes with substantial computational overhead. Moreover, since the forecasts are usually produced through some cloud computing service that relies on pay-as-you-go pricing ( Fotios Petropoulos & Spiliotis 2024 ) , higher computing time and resources directly translate into higher costs of forecasting for organizations. The retail industry particularly exemplifies the complexity of modern forecasting challenges. Retailers must predict demand for thousands or even millions of products across hundreds of stores while accounting for seasonality, promotions, pricing strategies, and external factors such as weather and local events. Accurate demand forecasts directly impact inventory decisions: overestimation leads to excess inventory and waste, particularly critical for perishable goods, while underestimation results in stockouts and direct money loss for companies ( Fildes et al. 2022 ) . Traditional approaches involving separate models for each product-store combination have proven increasingly inadequate, especially in contexts where the number of series (SKUs) to forecast is high, leading to the adoption of global forecasting models that can learn patterns across the entire product hierarchy and can drastically reduce the costs of producing forecasts 3 3 3 Most of the cost of producing forecasts is due to the algorithm’s training time. The global modeling approach cuts it by training the model only once on the whole data set. . Nevertheless, despite the growing adoption of global models, it is still common practice to update the forecasting models when new observations are available, often motivated by the assumption that continuous updates lead to better adaptability to changing patterns and more accurate predictions. Unlike local models, global models benefit from learning shared dynamics across multiple time series, potentially leading to more robust representations that are less sensitive to frequent retraining. In the context of local models, Spiliotis & Petropoulos 2024 demonstrated that less frequent model updates do not harm forecasting accuracy. However, in the context of global models, the effects of retraining are not well understood. Is continuous retraining necessary to maintain forecast performance, or can global models remain effective without frequent updates? This aspect remains largely unexplored in the forecasting literature and investigating the impact of retraining is crucial for both methodological and practical reasons. From a methodological perspective, understanding whether global models degrade in performance without frequent retraining provides insights into their stability and adaptability. If global models can maintain strong predictive accuracy with less frequent updates, it would challenge conventional wisdom on the necessity of continuous retraining in forecasting. Moreover, from a practical perspective, frequent retraining has significant computational and environmental costs. Training large-scale forecasting models requires substantial computational power, contributing to energy consumption and carbon emissions ( Schwartz et al. 2020 ) . Indeed, the energy consumption of model training extends beyond direct computational costs. In recent years, the environmental impact of machine learning models has become a growing concern. Data centers running these models contribute significantly to global carbon emissions, with estimates suggesting that training a single large deep learning model can emit as much carbon as five cars over their lifetimes Strubell et al. 2019 . The frequency of model retraining multiplies this impact, particularly in large organizations handling millions of series, emphasizing the need for more computationally efficient training practices. The implication is straightforward: reducing the retraining frequency of forecasting models could contribute substantially to sustainability by lowering energy consumption, possibly without harming accuracy performance. 1.1 Research Question We aim to address the question "Is frequent retraining necessary in the context of global forecasting models?" . Specifically, we study whether skipping retraining when new observations are available harms the forecasting performance of global models. To answer this question, we use the two most recent and comprehensive retail forecasting datasets, namely the M5 and the VN1 competitions’ data. To generally understand how retraining the forecasting models affects their performances, we consider ten different global forecasting methods (five from the "classical" machine learning domain and five often used deep neural network architectures), and several possible retraining scenarios, from continuous retraining to no retraining at all. We also explore intermediate periodic retraining strategies to broadly cover the most reasonable and effective scenarios. We also focus on the investigation of trade-offs between accuracy and sustainability, in terms of the computational cost of resources to produce the forecasts. This cost is indeed significant for large-scale applications, like the retail industry, and being able to reduce (or control) it somehow may result in direct and significant business savings. 1.2 Contributions Our contribution is threefold: 1. We provide the first comprehensive study of the relationship between retraining frequency and forecast accuracy using 10 different global models, a diverse

Read the complete text