Reviving Error Correction in Modern Deep Time-Series Forecasting

Minh Hoang Nguyen, Dai Do, Huu Hiep Nguyen, Dung Nguyen, Kien Do, Hung Le · 2026

Read Reviving Error Correction in Modern Deep Time-Series Forecasting by Minh Hoang Nguyen, Dai Do, Huu Hiep Nguyen, Dung Nguyen, Kien Do, Hung Le (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-21088.txt.

Introduction

Minh Hoang Nguyen and colleagues bring back error fixes for deep time-series forecasts. Long-range forecasts drift because each guess feeds the next guess. Their add-on splits a forecast into trend and seasonal parts and fixes each part on its own. It fits any forecaster with no retraining, and tests on four models and ten data sets show clear gains.

Catalog record

CREATORMinh Hoang Nguyen, Dai Do, Huu Hiep Nguyen, Dung Nguyen, Kien Do, Hung Le
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE99618
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.21088

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Reviving Error Correction in Modern Deep Time-Series Forecasting Minh Hoang Nguyen, Dai Do, Huu Hiep Nguyen, Dung Nguyen, Kien Do, Hung Le Abstract Modern deep-learning models have achieved remarkable success in time-series forecasting. Yet, their performance degrades in long-term prediction due to error accumulation in autoregressive inference, where predictions are recursively used as inputs. While classical error correction mechanisms (ECMs) have long been used in statistical methods, their applicability to deep learning models remains limited or ineffective. In this work, we revisit the error accumulation problem in deep time-series forecasting and investigate the role and necessity of ECMs in this new context. We propose a simple, architecture-agnostic error correction model that can be integrated with any existing forecaster without requiring retraining. By explicitly decomposing predictions into trend and seasonal components and training the corrector to adjust each separately, we introduce the Universal Error Corrector with Seasonal–Trend Decomposition (UEC-STD), which significantly improves correction accuracy and robustness across 4 backbones and 10 datasets. Our findings provide a practical tool for enhancing forecasts while offering new insights into mitigating autoregressive errors in deep time-series models. Code is available at https://github.com/DA2I2-SLM/UEC-STD † † affiliationnotice: Equal contribution 1 Introduction Time-series forecasting is essential across numerous industries, including finance, healthcare, energy management, and supply chain optimization. In recent years, deep learning models have significantly improved the accuracy of time-series forecasting ( 24 ; 21 ; 6 ; 15 ) . They outperform traditional methods on real-world benchmarks by leveraging advanced feature extraction and data-driven representations ( 19 ; 17 ) . Despite these advances, long-term forecasting remains a persistent challenge. One approach is to directly train the model to predict a fixed, large number of future steps in a single forward pass. However, this requires significantly larger models, often exhibits degraded accuracy, and is not scalable to arbitrary prediction lengths. A more flexible alternative is autoregressive inference, which generates future steps sequentially by conditioning on previously predicted values. Yet, this paradigm suffers from compounding errors, as inaccuracies introduced at earlier steps propagate and amplify over time ( 13 ) . Figure 1: (a) Chunk-based autoregressive (AR) forecasting in time series. Given a forecaster F with a fixed prediction window length L , which equals the input window size, the model’s output must be recursively fed as input to predict a future horizon of length 4L (here, using M=4 AR steps). (b) The relative increase in test prediction error when using model-predicted inputs instead of ground-truth, across 4 standard forecasting lengths: 96, 192, 336, and 720. Results are based on TimeMixer with L=W=96 on the ETTh1 dataset. Error modeling has been studied in traditional time-series forecasting, with classical Error Correction Models (ECMs) addressing long-term relationships by using cointegration and making adjustments for deviations from equilibrium, defined as a stable long-run relationship that the system gradually returns to after short-term fluctuations ( 4 ; 1 ) . Similarly, classic methods like ARIMA, based on autoregressive processes, make forecasts by considering past observations, predictions, and errors ( 12 ) . However, classical ECMs differ fundamentally from the error correction needed in deep learning models. They adjust for deviations from equilibrium across multiple time series, making them difficult to apply directly to modern deep learning models, which require the correction of errors arising from internal processing and autoregressive prediction. While error correction has been explored for specific deep learning models in recent research, solutions often involve predefined error functions to refine predictions ( 26 ) or the integration of error correction layers within forecasting pipelines ( 10 ; 7 ) , necessitating costly joint training of both the correction module and the forecasting model. To our knowledge, there exists no error correction model (ECM) that reliably improves a wide range of modern forecasters while treating the underlying forecasting backbone as a black-box . The absence of such an ECM is potentially due to the already high performance of current forecasting methods, which makes ECMs redundant. Alternatively, it may stem from the risk of overfitting ECMs to specific model or dataset characteristics, thereby hindering their ability to perform well on test data ( 14 ) . These considerations give rise to two key research questions under the autoregressive inference setting: (1) Are ECMs necessary for deep learning-based forecasting models? (2) How can ECMs be systematically integrated to improve the performance of modern forecasting architectures? In this paper, we investigate the feasibility of integrating ECM into deep forecasting models. We propose the Universal Error Corrector (UEC), a simple framework that learns correction vectors from the inputs and outputs of pre-trained models. Once trained, UEC adjusts forecasts at inference to mitigate error accumulation over long horizons. While the UEC can be implemented as any machine learning model, we propose a specialized variant for time-series data, the UEC with Seasonal-Trend Decomposition (UEC-STD). Time-series forecasts often exhibit distinct long-term trends and short-term seasonal patterns, and the backbone forecaster may struggle differently with each. UEC-STD explicitly separates these components and learns targeted corrections for both, optimizing a weighted loss that balances trend and seasonal errors. The experimental results demonstrate that the UEC-STD consistently reduces error accumulation and significantly improves the accuracy of 4 deep forecasters with minimal additional computational cost. In summary, our contributions are: (i) We pioneer a universal error correction mechanism for modern forecasters without retraining the backbone; (ii) We design UEC-STD, a lightweight plug-in module that explicitly corrects trend and seasonal errors in time-series data; (iii) We validate UEC-STD across diverse datasets and models, showing consistent error reduction. The significance of this work is introducing the first post-hoc error corrector tailored for autoregressive forecasting. Our approach treats the backbone as a complete black box, requiring no retraining or architectural modification, and can be seamlessly integrated with existing deep forecasters. 2 Method To begin, we briefly introduce time-series forecasting. Here, the objective is to predict future values of a sequence based on historical observations. Let \mathcal{D}_{train}=\{X_{t}\}_{t=1}^{T_{train}} represent the observed multivariate time-series data, where X_{t}\in\mathbb{R}^{D} is the time-series values at time t , and D is the number of variates. The forecasting task involves predicting future values over a horizon L based on historical time-series observations. Specifically, let the past window of observations be represented as: {X}_{t-W+1:t}=\{X_{t-W+1},X_{t-W+2},\dots,X_{t}\} where W is the look-back window length. Given this window, we aim to predict the future values of the time-series X_{t+1},X_{t+2},\dots,X_{t+L} using a model F(\cdot) : \hat{{X}}_{t+1:t+L}=F({X}_{t-W+1:t}) . The objective is to minimize the forecast error, often defined as the discrepancy between the predicted values \hat{{X}}_{t+1:t+L} and the true future values {X}_{t+1:t+L} , by minimizing the forecasting losses such as MSE or Huber ( 5 ) . 2.1 Chunk-based Autoregressive Prediction Now, we formalize the autoregressive forecasting setup considered in this work. In this approach, during inference, when ground-truth data are unavailable for long-term forecasting, the model feeds its previous predictions back as inputs ( 18 ) . This can cause error propagation, as small prediction errors accumulate and amplify over time, leading to significant deviations. Formerly, let \hat{X}_{t} be the predicted value at time t , and X_{t} the true value. In traditional autoregressive models, assuming we do not have the true data X_{t} , the process is: \hat{X}_{t+1}=F({X}_{t-W:t-1}\oplus\hat{X}_{t}) where {X}_{t-W:t-1} is the history of observations up

Read the complete text