Forecasting Italian daily electricity generation disaggregated by geographical zones and energy sources using coherent forecast combination

Daniele Girolimetto and Tommaso Di Fonzo · 2025

Read Forecasting Italian daily electricity generation disaggregated by geographical zones and energy sources using coherent forecast combination by Daniele Girolimetto and Tommaso Di Fonzo (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-11878.txt.

Introduction

Daniele Girolimetto and Tommaso Di Fonzo forecast Italian electricity output in twenty twenty-five. The data is daily and split by region and by energy source. Forecasts made piece by piece often clash with each other. The parts must add up to the national total, and independent forecasts rarely respect that.

Their approach combines forecasts from multiple experts while enforcing coherence. The combination is balanced and multi-task, and it uses unbiased base forecasts. Applied to Italian generation data, the method beat single-task forecasts. It also beat combined forecasts and a leading single-expert reconciliation method. Readers who forecast hierarchical time series get a way to gain accuracy and consistency at once.

Catalog record

CREATORDaniele Girolimetto and Tommaso Di Fonzo
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE12 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-11878

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Forecasting Italian daily electricity generation disaggregated by geographical zones and energy sources using coherent forecast combination Daniele Girolimetto and Tommaso Di Fonzo Abstract A novel approach is applied for improving forecast accuracy and achieving coherence in forecasting the Italian daily energy generation time series. In hierarchical frameworks such as national energy generation disaggregated by geographical zones and energy sources, independently generated base forecasts often result in inconsistencies across the constraints. We deal with this issue through a coherent balanced multi-task forecast combination approach, which combines unbiased forecasts from multiple experts while ensuring coherence. Applied to the daily Italian electricity generation data, our method shows superior accuracy compared to single-task base and combined forecasts, and a state-of-the-art single-expert reconciliation technique, demonstrating to be an effective approach to forecasting linearly constrained multiple time series. 1 Introduction Selecting an effective forecasting method among many options presents a complex and resource-intensive challenge, as inherent uncertainties often prevent any method from achieving the best accuracy across all scenarios. This complexity becomes even more significant when dealing with multiple interrelated variables that must satisfy linear constraints, as in National Accounts Girolimetto2024 and in hierarchical time series like electricity demand segmented by regions and sources Athanasopoulos2024 . Such settings require appropriate forecasting approaches ensuring coherence across interrelated variables. Traditional univariate forecast combination methods Bates1969 ; Clemen1989 focus on individual time series. In contrast, global forecast combination methods leverage shared information across multiple series to improve accuracy Thompson2024 . Similarly, forecast reconciliation approaches search for coherence by adjusting forecasts to satisfy some a priori constraints Wickramasuriya2019 , with significant empirical advantages in various fields Athanasopoulos2024 . In this paper, we exploit a recently developed linear framework DGTDF2025 , that joins single-variable forecast combination Bates1969 and the least squares reconciliation procedure for a linearly constrained multiple time series Stone1942-fa to produce optimal (in the least squares sense) coherent forecasts. The remainder of the paper is structured as follows. Sect. 2 succinctly presents the optimal coherent forecast combination procedure for incoherent base forecasts of a linearly constrained multiple time series, of which hierarchical time series are a special case. Sect. 3 presents the main findings of a forecasting experiment on 76 daily time series of the Italian electricity generation disaggregated by geographical zones and energy sources. 2 Optimal coherent multi-task forecast combination Let \vec{y}=\left[y_{1}\;\ldots\;y_{i}\;\ldots\;y_{n}\right]^{\top}\in\mathbb{R}^{n} represent the target forecast vector for a linearly constrained time series \vec{Y}_{t} , such that \vec{C}\vec{Y}_{t}=\vec{0}_{(n_{u}\times 1)} , where \vec{C}\in\mathbb{R}^{n_{u}\times n} is a predefined matrix describing the (homogeneous) linear constraints valid for the single component series of \vec{Y}_{t} , i.e., \vec{C}\vec{y}=\vec{0}_{(n_{u}\times 1)} . We assume that p\geq 2 experts independently produced a base forecast for every one of the n individual components of \vec{y} , yielding m=np base forecasts overall 1 1 1 A complete discussion of the optimal coherent combination approach, including the extension to the general case where the experts may produce base forecasts only for a subset of the totality of variables, can be found in DGTDF2025 . . Denote \widehat{y}_{i}^{j} the unbiased base forecast of the i -th individual variable of \vec{y} produced by the j -th expert, and let \varepsilon_{i}^{j}=\widehat{y}_{i}^{j}-y_{i} the zero-mean base forecast error. Let \widehat{\vec{y}}^{j}\in\mathbb{R}^{n_{j}} , j=1,\ldots,p , be the vector of base forecasts produced by the j -th expert, with error given by \boldsymbol{\varepsilon}^{j}=\widehat{\vec{y}}^{j}-\vec{y} , \widehat{\vec{y}}=\text{vec}\begin{bmatrix}\widehat{\vec{y}}^{1}&\dots&\widehat{\vec{y}}^{j}&\dots&\widehat{\vec{y}}^{p}\end{bmatrix}\in\mathbb{R}^{m} , and \boldsymbol{\varepsilon}=\text{vec}\begin{bmatrix}\boldsymbol{\varepsilon}^{1}&\dots&\boldsymbol{\varepsilon}^{j}&\dots&\boldsymbol{\varepsilon}^{p}\end{bmatrix}\in\mathbb{R}^{m} . The linear relationship linking all the available base forecasts \widehat{\vec{y}} and the unknown target forecast vector \vec{y} can be expressed through the multiple regression model \widehat{\vec{y}}=\vec{K}\vec{y}+\boldsymbol{\varepsilon} , where \vec{K}=\left(\vec{1}_{p}\otimes\vec{I}_{n}\right) , E(\boldsymbol{\varepsilon})=\vec{0}_{(np\times 1)} and \vec{W}=E(\boldsymbol{\varepsilon}\boldsymbol{\varepsilon}^{\top})\in\mathbb{R}^{m\times m} is a p.d. matrix. We are looking for a coherent forecast vector \widetilde{\vec{y}}^{c} , i.e., \vec{C}\widetilde{\vec{y}}^{c}=\vec{0}_{(n_{u}\times 1)} , which exploits all the available base forecasts and improves their accuracy. Forecast combination and reconciliation can be simultaneously dealt with through an optimization-based technique that combines multiple individual experts’ base forecasts \widehat{\vec{y}}^{j} : \widetilde{\vec{y}}^{c}=\argmin_{\vec{y}}\big(\,\widehat{\vec{y}}-\vec{K}\vec{y}\big)^{\top}\vec{W}^{-1}\big(\,\widehat{\vec{y}}-\vec{K}\vec{y}\big)\qquad\text{s.t. }\quad\vec{C}\vec{y}=\vec{0}_{(n_{u}\times 1)}.\vskip-5.0pt (1) By extending the well known least squares adjustment procedure for a single vector of preliminary incoherent estimates (i.e., base forecasts) Stone1942-fa to the case of p\geq 2 vectors, the coherent combined forecast vector \widetilde{\vec{y}}^{c} can be expressed as \widetilde{\vec{y}}^{c}=\vec{M}\boldsymbol{\Omega}^{\top}\widehat{\vec{y}} , where \vec{M}=\left[\vec{I}_{n}-\vec{W}_{c}\vec{C}^{\top}\left(\vec{C}\vec{W}_{c}\vec{C}^{\top}\right)^{-1}\vec{C}\right] , \boldsymbol{\Omega}=\vec{W}^{-1}\vec{K}\vec{W}_{c} , and \vec{W}_{c}=\left(\vec{K}^{\top}\vec{W}^{-1}\vec{K}\right)^{-1} (see DGTDF2025 for details). It is worth noting that this result is obtained under the commonly assumed hypotheses that the base forecasts are unbiased, and that the joint dispersion matrix of the p forecast experts is known. 3 Forecasting Italian daily electricity generation In this section, we consider a forecasting experiment for 76 Italian daily electricity generation time series from 01/01/2023 to 31/12/2023 , obtained from the ENTSO-E Transparency Platform. The Italian electricity market is a grouped time series with two hierarchies, both sharing the top and bottom levels. In the first hierarchy, generation is aggregated into 7 different sources, classified into two categories: renewable (Biomass, Hydro, Solar, Wind, Geothermal) and non-renewable (Fossil, Waste). The second hierarchy organizes the data geographically in 7 zones according to the Terna electricity market map in compliance with the EU CACM regulation. In order to assess the forecast accuracy of the various approaches, we perform a rolling forecast experiment with an expanding window ( 01/01/2023-21/5/2023 first training set). One- to seven-step-ahead forecasts were generated leading to Q_{1}=225 one-, …, and Q_{7}=119 seven-step-ahead daily forecasts for evaluation. Each series was independently modeled using three different approaches: stlf Cleveland1990-ux , arima Box1976-ud , tbats De-Livera2011-hx . Moreover, we consider the following eleven forecasting procedures: 1. Single best model and its reconciled counterpart : two approaches. For the best base forecast expert (tbats), the reconciled forecasts are obtained through the shrunk MinT approach by Wickramasuriya2019 (tbats {}_{\text{shr}} ). 2. Single-task combination : three approaches. Equal weights (ew) and the optimal weighting schemes proposed by Bates1969 and Newbold1974 , called respectively ow {}_{\text{var}} and ow {}_{\text{cov}} . 3. Coherent combination : six approaches. A sequential reconciliation-then-equal-weight-combination (src), three sequential combination-then-reconciliation (scr {}_{\text{ew}} , scr {}_{\text{var}} , scr {}_{\text{cov}} ), and finally two optimal coherent combination approach, occ {}_{\text{wlsv}} and occ {}_{\text{be}} , with diagonal and block-diagonal shrunk in-sample covariance matrix, respectively (see DGTDF2025 for details). The forecast accuracy is evaluated in Table 1 using the Average Relative Mean Absolute ( AR\text{-}MAE ) and Squared ( AR\text{-}MSE ) Error Fleming1986 ; Davydenko2013 computed as, respectively, AR\text{-}MAE_{h}^{app}=\left(\scalebox{.8}{$\displaystyle\prod_{i=1}^{76}$}\frac{MAE_{h,i}^{app}}{MAE_{h,i}^{\text{ew}}}\right)^{\frac{1}{76}} and AR\text{-}MSE_{h}^{app}=\left(\scalebox{.8}{$\displaystyle\prod_{i=1}^{76}$}\frac{MSE_{h,i}^{app}}{MSE_{h,i}^{\text{ew}}}\right)^{\frac{1}{76}} , with MSE_{h,i}^{app}=\frac{1}{Q_{h}}\scalebox{.8}{$\displaystyle\sum_{q=1}^{Q_{h}}$}\big(y_{i,h,q}-\overline{y}_{i,h,q}^{\,app}\big)^{2} and MAE_{h,i}^{app}=\frac{1}{Q_{h}}\scalebox{.8}{$\displaystyle\sum_{q=1}^{Q_{h}}$}\big|y_{i,h,q}-\overline{y}_{i,h,q}^{\,app}\big| , where h=1,...,7 is the forecast horizon, i=1,...,76 denotes the variable, Q_{h} is the test set dimension, app is the approach used, y_{i,h,q} is the observed value and \overline{y}_{i,h,q}^{\,app} is the forecast value using the app approach (coherent or incoherent). The equal weights (ew) single-task combination is used as benchmark. Looking at Table 1 , single-task combination and single-expert reconciliation strategies consistently improve forecasting accuracy compared to the three base models. However, tbats {}_{\text{shr}} tends to perform less effectively when compared to the more advanced single-task combination approaches. In contrast, coherent combination approaches consistently outperform all the other forecasting strategies. Furthermore, these coherently combined forecasts satisfy all the necessary constraints, which is a critical advantage in this, as in most applied contexts. Acknowledgements. The authors acknowledge financial support from project PRIN 2022: PRICE – “A New Paradigm for High-Frequency Finance”– 2022C799SX. Table 1: AR\text{-}MAE and AR\text{-}MSE with equal weights combination approach (ew) as benchmark. Bold entries identify

Read the complete text