Coherent forecast combination for linearly constrained multiple time series Daniele Girolimetto, Tommaso Di Fonzo Abstract Linearly constrained multiple time series may be encountered in many practical contexts, such as the National Accounts (e.g., GDP disaggregated by Income, Expenditure and Output), and multilevel frameworks where the variables are organized according to hierarchies or groupings, like the total energy consumption of a country disaggregated by region and energy sources. In these cases, when multiple incoherent base forecasts for each individual variable are available, a forecast combination-and-reconciliation approach, that we call coherent forecast combination , may be used to improve the accuracy of the base forecasts and achieve coherence in the final result. In this paper, we develop an optimization-based technique that combines multiple unbiased base forecasts while assuring the constraints valid for the series. We present closed form expressions for the coherent combined forecast vector and its error covariance matrix in the general case where a different number of forecasts is available for each variable. We also discuss practical issues related to the covariance matrix that is part of the optimal solution. Through simulations and a forecasting experiment on the daily Australian electricity generation hierarchical time series, we show that the proposed methodology, in addition to adhering to sound statistical principles, may yield in significant improvement on base forecasts, single-task combination and single-expert reconciliation approaches as well. 1 Introduction Forecasting is a critical and important component of effective and informed decision-making in various domains, from business and economics to public policy and environmental management. However, selecting an appropriate forecasting approach is often a complex and time-consuming challenge, requiring significant resources to implement techniques that slightly improve accuracy. Despite these efforts, the intrinsic uncertainty associated with forecasting means that no method can guarantee the most accurate predictions for all scenarios. The challenge is particularly pronounced in contexts where multiple variables are interrelated through specific constraints, linear but not limited to. These relationships offer valuable supplementary information that can improve the accuracy, but they also introduce additional complexity into the forecasting process. Many real-world forecasting scenarios involve data structures with multiple variables linked by constraints ( Athanasopoulos et al.,, 2024 ) . This is common in National Accounts systems, where aggregates like GDP are broken down into components from Income, Expenditure and Output sides ( Di Fonzo and Girolimetto,, 2023 ) , or in hierarchical frameworks like the total electricity demand and power generation of a country, which is disaggregated by regions and energy sources ( Ben Taieb et al.,, 2021 , Panagiotelis et al.,, 2023 ) . In these cases, when multiple forecasts of the individual variables are available, a forecast combination-and-reconciliation approach, that we call coherent forecast combination , may be used to improve the accuracy of individual forecasts while ensuring that the final forecasts satisfy the constraints. For instance, when base, i.e., possibly incoherent multiple forecasts, are available for various components of a constrained time series, these forecasts can be combined and reconciled to produce coherent and more accurate predictions. This paper investigates the problem of combining forecasts for multiple time series linked by linear constraints, focusing on deriving a coherent forecast combination. Specifically, the study examines how to optimally assign combination weights to base forecasts such that the final combined forecast is both coherent (i.e., consistent with the underlying constraints) and exhibits improved accuracy. It is important to note that the generation of the initial base forecasts is outside the scope of this study, as these forecasts may be produced through various methodologies. The classical univariate forecast combination approach ( Bates and Granger,, 1969 , Clemen,, 1989 , Timmermann,, 2006 , Wang et al.,, 2024 ) considers each time series separately, by using only forecasts of that variable, according to a local approach. In contrast, global forecast combination techniques consider multiple time series simultaneously, using information across series and common patterns available in the forecast errors to improve accuracy ( Thompson et al.,, 2024 ) . Although standard (univariate) forecast combination approaches focus on using local information to fit the weights, i.e., information that only concerns the target forecast, by its nature forecast reconciliation ( Hyndman et al.,, 2011 ) is a ‘global’ approach, insofar it derives the forecast of a single variable belonging to a constrained structure, by using information coming from the forecasts of all variables. The literature on forecast reconciliation has extensively explored this idea, methodologically formalizing the problem and demonstrating its significant empirical benefits across various applications (see Wickramasuriya et al.,, 2019 , Ben Taieb et al.,, 2021 , Girolimetto et al.,, 2024 , among many others) . Some authors have investigated whether combining forecasts generated from different models can improve the forecast accuracy of hierarchical time series rather than individual models ( Spiliotis et al.,, 2019 , Yang and Zhang,, 2019 , Goehry et al.,, 2020 , Mohamed,, 2023 , Rostami-Tabar and Hyndman,, 2024 , Zhang et al.,, 2024 ) , and similar research questions, related to general linearly constrained multiple time series, have been addressed in engineering ( Porrill,, 1988 , Sun and Deng,, 2004 ) . Notably, Hollyman et al., (2021) and Di Fonzo and Girolimetto, (2024) propose a reconciliation approach that focuses on combining forecasts across sub-hierarchical structures. However, they do not address the integration of different forecasting models within a unified combination framework, limiting the scope of their reconciliation efforts to sub-hierarchical models without considering the potential of broader model combinations. In this paper, we follow up on an insight of Bates and Granger, (1969) , who wrote: “ Work by Stone et al., (1942) has made use of ideas rather similar to these, though their work related only to making improved estimates of past national income figures for the U.K. and did not tackle forecasting problems ”. We show that integrating their linear forecast combination approach with the constrained multivariate least-squares adjustment setting developed by Stone et al., (1942) , results in a closed-form expression that provides optimal combined and coherent forecasts for multiple linearly constrained time series. This new result unifies linear forecast reconciliation and combination in a simultaneous and statistically justified way, ensuring that the forecasts are both accurate and coherent, which is particularly valuable in applications where the integrity of the forecast structure is crucial. The paper is organized as follows. In Section 2 we set the notation and consider different representatons of the problem. Section 3 describes the model linking the multiple base forecasts to the target linearly constrained forecast vector. The methodological analysis, including the closed-form solution for optimal coherent forecast combination and its covariance matrix, is presented in Section 4 . Section 5 discusses practical issues related to the estimation of the covariance matrix. Insights into the empirical performance of the newly proposed methodology are presented in Section 6 , that describes a Monte-Carlo experiment, and in Section 7 , where an application on forecasting the daily time series of the Australian electricity generation is discussed. Finally, Section 8 presents conclusions and indications for future research. Appendices A-G contain supplementary theoretical materials, as well as tables and graphs related to the empirical applications. 2 Notation and preliminaries We use lower case bold letters to denote column vectors, e.g., \bm{x}\in\mathbb{R}^{N} , and upper case bold letters to denote matrices, e.g., \bm{A}\in\mathbb{R}^{N\times K} . An all-one vector of dimension N is denoted as \bm{1}_{N} . We use \bm{I}_{N} to denote the (N\times N) identity matrix, and \bm{0}_{(N\times K)} to denote the (N\times K) zero matrix. To specify that a vector \bm{x} is non-negative for all its elements, we write \bm{x}\succeq\bm{0}_{(N\times 1)} . For matrices \bm{A} , \bm{A}\succeq\bm{0} means that \bm{A} is positive semi-definite. Table 1 summarizes the notation used throughout the paper. Table 1: List of symbols used in the paper. Symbol Description n_{u} , n_{b} , n , p Scalars denoting the number of constrained (upper), free (bottom), total variables, respectively, and the number of forecast experts. i,k Indices running on the variables, i,k=1,\dots,n . j,l Indices running on the forecast experts, j,l=1,\dots,p . n_{j} Scalar denoting the number of variables for which forecasts produced by the j -th expert are available, 1\leq n_{j}\leq n . p_{i} Scalar denoting the number of forecast experts available for the i -th variable, 1\leq p_{i}\leq p , with p=\displaystyle\max_{i=1,\ldots,n}p_{i} . m Scalar denoting the total number of available forecasts produced by p experts for n variables: m=\displaystyle\sum_{j=1}^{p}n_{j}=\displaystyle\sum_{i=1}^{n}p_{i} , n\leq m\leq np . When n_{j}=n\;\forall j , i.e., p_{i}=p\;\forall i , m=np (‘balanced’ case). y_{i} Target forecast for the i -th variable. \bm{u} (n_{u}\times 1) vector of constrained (upper) variables. \bm{b} (n_{b}\times 1) vector of free (bottom) variables. \bm{A} (n_{u}\times n_{b}) linear combination matrix mapping \bm{b} into \bm{u} : \bm{u}=\bm{A}\bm{b} . \bm{C} (n_{u}\times n) zero-constraints matrix: \bm{C}=\begin{bmatrix}[0.7]\bm{I}_{n_{u}}&-\bm{A}\end{bmatrix} . \bm{y} (n\times 1) target forecast vector: \bm{y}=\begin{bmatrix}[0.7]\bm{u}^{\top}&\bm{b}^{\top}\end{bmatrix}^{\top} , by definition coherent ( \bm{C}\bm{y}=\bm{0}_{(n_{u}\times 1)} ). \bm{S} (n\times n_{b}) structural-like matrix: \bm{S}=\begin{bmatrix}[0.7]\bm{A}\\ \bm{I}_{n_{b}}\end{bmatrix} , such that \bm{y}=\bm{S}\bm{b} . \widehat{y}_{i}^{j} Unbiased base forecast of the i -th variable produced by the j -th expert. \widehat{\bm{y}}^{j} (n_{j}\times 1) vector of the base forecasts produced by the j -th expert. \widehat{\bm{y}}_{i} (p_{i}\times 1) vector of the base forecasts of the i -th variable. \widehat{\bm{y}}\equiv\widehat{\bm{y}}_{\text{be}} \left[\widehat{\bm{y}}^{1\top}\dots\;\widehat{\bm{y}}^{j\top}\dots\;\widehat{\bm{y}}^{p\top}\right]^{\top} : (m\times 1) vector of the base forecasts stacked by-expert (be). \widehat{\bm{y}}_{\text{bv}} \left[\widehat{\bm{y}}_{1}^{\top}\;\ldots\;\widehat{\bm{y}}_{i}^{\top}\;\ldots\;\widehat{\bm{y}}_{n}^{\top}\right]^{\top} : (m\times 1) vector of the base forecasts stacked by-variable (bv). \widehat{\bm{Y}} \begin{bmatrix}[0.7]\widehat{\bm{y}}^{1}&\ldots&\widehat{\bm{y}}^{j}&\ldots&\widehat{\bm{y}}^{p}\end{bmatrix} . If n_{j}=n\;\forall j (i.e., ‘balanced’ case): ( n\times p ) matrix containing the base forecasts produced by p different experts for the target vector \bm{y} . Each column denotes an expert j=1,\dots,p , while each row denotes a variable i=1,\dots,n . In this case, \widehat{\bm{y}}=\text{vec}\left(\widehat{\bm{Y}}\right) . \widehat{\bm{Y}}^{\top} \begin{bmatrix}[0.7]\widehat{\bm{y}}_{1}&\ldots&\widehat{\bm{y}}_{i}&\ldots&\widehat{\bm{y}}_{n}\end{bmatrix} . If n_{j}=n\;\forall j (i.e., ‘balanced’ case): ( p\times n ) matrix containing the base forecasts produced by p different experts for the target vector \bm{y} . Each column denotes a variable i=1,\dots,n , while each row denotes an expert j=1,\dots,p . In this case, \widehat{\bm{y}}_{\text{bv}}=\text{vec}\left(\widehat{\bm{Y}}^{\top}\right) . \bm{P} (m\times m) permutation matrix such that \bm{P}\widehat{\bm{y}}=\widehat{\bm{y}}_{\text{bv}} . As \bm{P}^{-1}=\bm{P}^{\top} , \widehat{\bm{y}}=\bm{P}^{\top}\widehat{\bm{y}}_{\text{bv}} . If n_{j}=n\;\forall j (i.e., ‘balanced’ case): (np\times np) commutation matrix such that \bm{P}\text{vec}\left(\widehat{\bm{Y}}\right)=\text{vec}\left(\widehat{\bm{Y}}^{\top}\right) . \bm{L}_{j} ( n_{j}\times n ) zero-one matrix selecting the entries of \bm{y} for which forecasts of expert j are available. \bm{L} \text{Diag}\left(\bm{L}_{1},\ldots,\bm{L}_{j},\ldots,\bm{L}_{p}\right)\in\{0,1\}^{m\times np} . If n_{j}=n\;\forall j (i.e., ‘balanced’ case): \bm{L}=\bm{I}_{np} . \bm{K} \bm{L}\left(\bm{1}_{p}\otimes\bm{I}_{n}\right)=\left[\bm{L}_{1}^{\top}\ldots\bm{L}_{j}^{\top}\ldots\bm{L}_{p}^{\top}\right]^{\top}\in\{0,1\}^{m\times n} . If n_{j}=n\;\forall j (i.e., ‘balanced’ case): \bm{K}=\bm{1}_{p}\otimes\bm{I}_{n} , (np\times n) matrix such that \bm{K}\bm{y}=\big[\;\underbrace{\bm{y}^{\top}\;\ldots^{\phantom{\top}}\;\bm{y}^{\top}}_{p\;\text{times}}\;\big]^{\top}=\begin{bmatrix}[0.7]\bm{y}\\ \vdots\\ \bm{y}\end{bmatrix} . \bm{J} \bm{P}\bm{K}=\bm{P}\bm{L}\left(\bm{1}_{p}\otimes\bm{I}_{n}\right)\in\{0,1\}^{m\times n} , such that \bm{J}\bm{y}=\begin{bmatrix}[0.7]\bm{1}_{p_{1}}y_{1}\\ \vdots\\ \bm{1}_{p_{n}}y_{n}\end{bmatrix} . If n_{j}=n\;\forall j (i.e., ‘balanced’ case): \bm{J}=\bm{I}_{n}\otimes\bm{1}_{p} : (np\times n) matrix such that \bm{J}\bm{y}=\bm{y}\otimes\bm{1}_{p} . \bm{W} (m\times m) error covariance matrix of \widehat{\bm{y}} . \bm{W}_{jl} (n_{j}\times n_{l}) error cross-covariance matrix of \widehat{\bm{y}}^{j} and \widehat{\bm{y}}^{l} . \bm{\Sigma} (m\times m) error covariance matrix of \widehat{\bm{y}}_{\text{bv}} . \bm{\Sigma}=\bm{P}\bm{W}\bm{P}^{\top} and \bm{W}=\bm{P}^{\top}\bm{\Sigma}\bm{P} . \bm{\Sigma}_{ik} (p_{i}\times p_{k}) error cross-covariance matrix of \widehat{\bm{y}}_{i} and \widehat{\bm{y}}_{k} . \widehat{\bm{y}}^{c} (n\times 1) vector of the multi-task combined forecasts. In general, these forecasts are incoherent: \bm{C}\widehat{\bm{y}}^{c}\neq\bm{0}_{(n_{u}\times 1)} . \widetilde{\bm{y}}^{j} If n_{j}=n , (n\times 1) vector of reconciled forecasts using the base forecasts produced by the j -th expert. \widetilde{\bm{y}}^{j} is by construction coherent: \bm{C}\widetilde{\bm{y}}^{j}=\bm{0}_{(n_{u}\times 1)} . \widetilde{\bm{y}}^{c} (n\times 1) vector of the optimal coherent combined forecasts, by construction coherent: \bm{C}\widetilde{\bm{y}}^{c}=\bm{0}_{(n_{u}\times 1)} . \bm{\Omega} \begin{bmatrix}[0.7]\bm{\Omega}_{1}\;\ldots\;\bm{\Omega}_{j}\;\ldots\;\bm{\Omega}_{p}\end{bmatrix}^{\top} : (m\times n) matrix given by the concatenation of the matrix combination weights \bm{\Omega}_{j}\in\mathbb{R}^{n\times n_{j}} of the multi-task forecast combination \widehat{\bm{y}}^{c}=\bm{\Omega}^{\top}\widehat{\bm{y}}=\displaystyle\sum_{j=1}^{p}\bm{\Omega}_{j}\widehat{\bm{y}}^{j} (by-expert formulation). \bm{\Gamma} \begin{bmatrix}[0.7]\bm{\Gamma}_{1}\;\ldots\;\bm{\Gamma}_{i}\;\ldots\;\bm{\Gamma}_{n}\end{bmatrix}^{\top} : (m\times n) matrix given by the concatenation of the matrix combination weights \bm{\Gamma}_{i}\in\mathbb{R}^{n\times p_{i}} of the multi-task forecast combination \widehat{\bm{y}}^{c}=\bm{\Gamma}^{\top}\widehat{\bm{y}}_{\text{bv}}=\displaystyle\sum_{i=1}^{n}\bm{\Gamma}_{i}\widehat{\bm{y}}_{i} (by-variable formulation). \bm{\Psi} \begin{bmatrix}[0.7]\bm{\Psi}_{1}\;\ldots\;\bm{\Psi}_{j}\;\ldots\;\bm{\Psi}_{p}\end{bmatrix}^{\top} : (m\times n) matrix given by the concatenation of the matrix reconciliation weights \bm{\Psi}_{j}\in\mathbb{R}^{n\times n_{j}} of the coherent multi-task forecast combination \widetilde{\bm{y}}^{c}=\bm{\Psi}^{\top}\widehat{\bm{y}}=\displaystyle\sum_{j=1}^{p}\bm{\Psi}_{j}\widehat{\bm{y}}^{j} (by-expert formulation). \bm{\Phi} \begin{bmatrix}[0.7]\bm{\Phi}_{1}\;\ldots\;\bm{\Phi}_{i}\;\ldots\;\bm{\Phi}_{n}\end{bmatrix}^{\top} : (m\times n) matrix given by the concatenation of the matrix reconciliation weights \bm{\Phi}_{i}\in\mathbb{R}^{n\times p_{i}} of the coherent multi-task forecast combination \widetilde{\bm{y}}^{c}=\bm{\Phi}^{\top}\widehat{\bm{y}}_{\text{bv}}=\displaystyle\sum_{i=1}^{n}\bm{\Phi}_{i}\widehat{\bm{y}}_{i} (by-variable formulation). src Sequential first-reconciliation-then-combination. scr Sequential first-combination-then-reconciliation. occ Optimal (minimum mean square error, MMSE) coherent linear combination. 2.1 Zero-constrained and structural representations of a general linearly constrained time series Let \bm{y}_{t}=\begin{bmatrix}[0.7]y_{1,t}&\ldots&y_{i,t}&\ldots\;y_{n,t}\end{bmatrix}^{\top}\in\mathbb{R}^{n} be a vector of observed time series we are interested in forecasting, and assume that the time series is linearly constrained, in the sense that at every time t the n individual variables of \bm{y}_{t} must satisfy n_{u}1 individual variables of \bm{y} , we face a classical problem of single-expert forecast reconciliation. When looking for a linear solution, the reconciled (i.e., coherent) forecast vector may be expressed as \widetilde{\bm{y}}=\bm{M}\widehat{\bm{y}}^{j}\quad\rightarrow\quad\widetilde{y}_{i}=m_{ii}\widehat{y}_{i}^{j}+\sum_{\begin{subarray}{c}k=1\\ k\neq i\end{subarray}}^{n}m_{ik}\widehat{y}_{k}^{j},\quad i=1,\ldots,n, (11) where \widehat{\bm{y}}^{j}\in\mathbb{R}^{n} , and \bm{M}=\{m_{ik}\}\in\mathbb{R}^{n\times n} is a projection matrix depending on the base forecast errors’ covariance matrix and the zero constraints matrix \bm{C} ( Panagiotelis et al.,, 2021 , Di Fonzo and Girolimetto,, 2023 ) . The single-variable formulation on the rhs of expression ( 11 ) makes it clear the global nature ( Thompson et al.,, 2024 ) of the forecast combination resulting in the single-expert linear reconciliation, in the sense that the reconciled forecast of the i -th individual variable is given by the linear combination of the base forecasts of the same variable, \widehat{y}_{i}^{j} , and of all the remaining n-1 individual variables. Continuing along this line of reasoning, we might consider the extension to the multi-task framework of the single-task linear forecast combination approach in expression ( 10 ). Useful references are Sun and Deng, (2004) , who deal with data assimilation problems, Keller and Olkin, (2004) and Lavancier and Rochet, (2016) , extending the statistical theory on the combination of multiple estimators of the same vector of parameters. The results found by Sun and Deng, (2004) and Lavancier and Rochet, (2016) may be used to express a global multi-task combined forecast \widehat{\bm{y}}^{c} which exploits all the base forecasts of all variables, and is more accurate than any individual or multiple base forecasts. Surprisingly, these papers appear to have had a limited impact on research on forecast combination and we aim to address this gap. However, it should be noted that, if the variable to be forecast is linearly constrained, there is no guarantee that the outcome obtained following the approaches so far is coherent. In other terms, in general it is \bm{C}\widehat{\bm{y}}^{c}\neq\bm{0}_{(n_{u}\times 1)} . A possible, practical solution to obtain coherent forecasts is adopting a two-step procedure ( sequential combination-first-then-reconciliation , scr), consisting of performing the reconciliation of \widehat{\bm{y}}^{c} in order to finalize the coherent combination forecasting process ( Rostami-Tabar and Hyndman,, 2024 , see) . Another simple two-step procedure, sequential reconciliation-first-then-simple-average-combination , src, may be developed as well. However, it is worth mentioning that the src approach is limited to the balanced case and does not apply to more general situations. In this paper we address the problem of finding the optimal (in least squares sense) coherent-and-combined forecast vector \widetilde{\bm{y}}^{c}\in\mathbb{R}^{n} of a linearly constrained time series, where the coherence condition is expressed as \bm{C}\widetilde{\bm{y}}^{c}=\bm{0}_{(n_{u}\times 1)} . Table 2 schematically shows conceivable combination and reconciliation approaches in relation to the forecast coherence property and to the local/global nature of the final result. Table 2 : Combination approaches for single- and multi-task forecast combination, single-expert forecast reconciliation, and coherent forecast combination. The term local denotes the combination of multiple base forecasts of one individual variable, while global refers to the combination of either single or multiple experts base forecasts of all n individual variables. Combination approaches Forecast Coherence Nature of the combined forecast Single-task forecast combination \widehat{y}_{i}^{c} NO \longrightarrow Local, multiple experts Forecast reconciliation \widetilde{\bm{y}} YES \longrightarrow Global, single expert Multi-task forecast combination \widehat{\bm{y}}^{c} NO \left.\rule{0.0pt}{32.37479pt}\right\}\hskip-5.0pt\rightarrow Global, multiple experts Sequential combination-reconciliation \widetilde{\bm{y}}^{c}_{\text{scr}} YES Sequential reconciliation-combination \widetilde{\bm{y}}^{c}_{\text{src}} YES Optimal coherent combination \widetilde{\bm{y}}^{c} YES 3.1 Model and number of experts for each individual variable: The unbalanced case To discuss the optimal coherent forecast combination methodology, we slightly abstract the problem and consider a data-fitting issue with equality constraints. As in the classical frameworks of Stone et al., (1942) and Bates and Granger, (1969) , we assume that each individual base forecast is unbiased, i.e., E\big(\widehat{y}_{i}^{j}\big)=E\big(y_{i}\big) i=1,\ldots,n_{j} , j=1,\ldots,p_{i} . Following Stone et al., (1942) ( Byron,, 1978 , Byron,, 1979 , see also ) , we state that the base forecast of the i -th variable produced by the j -th expert, is the sum of the ‘true’, unknown target forecast and a zero-mean forecast error \varepsilon_{i}^{j} : \widehat{y}_{i}^{j}=y_{i}+\varepsilon_{i}^{j},\quad i=1,\ldots,n_{j},\;i=1,\ldots,p_{i}. (12) In the following, we discuss the unbalanced case 5 5 5 The ‘balanced’ case (i.e., n_{j}=n \forall j , p_{i}=p \forall i ) is presented in B . , occurring when for at least one index j , it is n_{j}1 , \widehat{\bm{W}}_{h} is challenging to estimate (e.g., multi-step-ahead errors will not be independent) and we assume that \widehat{\bm{W}}_{h}\propto\widehat{\bm{W}} as proposed in Wickramasuriya et al., (2019) and Ben Taieb et al., (2021) . Moreover, when m>>T , \widehat{\bm{W}} and \widehat{\bm{\Sigma}} are not well defined, and some regularization has to be adopted in order to recover a stable, non-singular covariance matrix. The natural choice is to consider the shrunk versions of the sample covariance matrices \widehat{\bm{W}} and \widehat{\bm{\Sigma}} towards their diagonal versions, that is: \widehat{\bm{W}}_{\text{shr}}=\widehat{\lambda}\left(\bm{I}_{n}\odot\widehat{\bm{W}}\right)+\left(1-\widehat{\lambda}\right)\widehat{\bm{W}}\;\rightarrow\;\widehat{\bm{\Sigma}}_{\text{shr}}=\bm{P}\widehat{\bm{W}}_{\text{shr}}\bm{P}^{\top}, (29) where \odot denotes the Hadamard product and \widehat{\lambda} is an estimate of the coefficient of shrinkage intensity \lambda , 0\leq\lambda\leq 1 ( Schäfer and Strimmer,, 2005 ) . An alternative approach involves assuming uncorrelated errors across either experts or variables, which results in block-diagonal covariance matrices (see Section 5.1 ): in the former case \widehat{\bm{W}}_{\text{bd}}=\mbox{Diag}\left(\widehat{\bm{W}}_{1},\dots,\widehat{\bm{W}}_{j},\dots,\widehat{\bm{W}}_{p}\right) , with \widehat{\bm{W}}_{j}=\displaystyle\frac{1}{T}\sum_{t=1}^{T}\widehat{\bm{\varepsilon}}_{t}^{j}\widehat{\bm{\varepsilon}}_{t}^{j}{{}^{\top}}\in\mathbb{R}^{n_{j}\times n_{j}} , j=1,\ldots,p . In the latter case, \widehat{\bm{\Sigma}}_{\text{bd}}=\mbox{Diag}\left(\widehat{\bm{\Sigma}}_{1},\dots,\widehat{\bm{\Sigma}}_{i},\dots,\widehat{\bm{\Sigma}}_{n}\right) , with \widehat{\bm{\Sigma}}_{i}=\displaystyle\frac{1}{T}\sum_{t=1}^{T}\widehat{\bm{\varepsilon}}_{i,t}\widehat{\bm{\varepsilon}}_{i,t}^{\top}\in\mathbb{R}^{p_{i}\times p_{i}} , i=1,\ldots,n . When n_{j}>T for some expert j , or p_{i}>T for some variable y_{i} , the estimates \widehat{\bm{W}}_{j} and \widehat{\bm{\Sigma}}_{i} are not well defined. In this case, as usual, we can resort to the shrunk versions of these two matrices given by, respectively: \displaystyle\widehat{\bm{W}}_{j,\text{shr}} \displaystyle=\widehat{\lambda}_{j}\left(\bm{I}_{n}\odot\widehat{\bm{W}}_{j}\right)+\left(1-\widehat{\lambda}_{j}\right)\widehat{\bm{W}}_{j}, \displaystyle j=1,\ldots,p \displaystyle\widehat{\bm{\Sigma}}_{i,\text{shr}} \displaystyle=\widehat{\nu}_{i}\left(\bm{I}_{n}\odot\widehat{\bm{\Sigma}}_{i}\right)+\left(1-\widehat{\nu}_{i}\right)\widehat{\bm{\Sigma}}_{i}, \displaystyle i=1,\ldots,n where \widehat{\lambda}_{j} and \widehat{\nu}_{i} are estimates of the coefficients of shrinkage intensity, respectively, \lambda_{j} and \nu_{i} , 0\leq\lambda_{j}\leq 1 and 0\leq\nu_{i}\leq 1 . Then, other two estimators can be considered: \widehat{\bm{W}}_{\text{bd-shr}}=\mbox{Diag}\left(\widehat{\bm{W}}_{1,\text{shr}},\dots,\widehat{\bm{W}}_{p,\text{shr}}\right) and \widehat{\bm{\Sigma}}_{\text{bd-shr}}=\mbox{Diag}\left(\widehat{\bm{\Sigma}}_{1,\text{shr}},\dots,\widehat{\bm{\Sigma}}_{n,\text{shr}}\right) . 6 A simulation experiment In order to assess the performance of the proposed approach, a simulation experiment is run. The simulation framework, designed for a hierarchical multivariate time series, extends the univariate simulation experiment of Capistrán and Timmermann, (2009) to a multivariate setting that accommodates for cross-sectional dependencies and linear constraints across series. The hierarchical structure of the series is the one on the left panel of Figure 1 , including a total of n=7 variables, with n_{b}=4 bottom series, with aggregation and structural matrices \bm{A} and \bm{S} , respectively, given by ( 4 ). Denote t=0,\dots,(T-1) , and i=1,\dots,n_{b} , the indices running on, respectively, time periods and bottom series. The observed bottom time series are simulated from a simple two-factor model 9 9 9 This formulation is equivalent to expression (9) in Capistrán and Timmermann, (2009) , where \mu_{y}=0 and \beta_{y1}=\beta_{y2}=1 in all settings. We have chosen to omit these parameters to simplify the notation. : b_{i,t+1}=F_{1,i,t+1}+F_{2,i,t+1}+\eta_{i,t+1} , i=1,\ldots,n_{b} , where factors F_{1,i} and F_{2,i} come from a Vector AutoRegressive model of order 1, \bm{F}_{i,t+1}=\bm{\Phi}_{F}\bm{F}_{i,t}+\bm{\xi}_{i,t+1} , characterized by a diagonal coefficients’ matrix \bm{\Phi}_{F} and independent innovations \bm{\xi}_{i,t+1}\sim\mathcal{N}\left(\bm{0}_{(2\times 1)},\bm{I}_{2}\right) . In addition, \bm{\eta}_{t+1}=\begin{bmatrix}\eta_{1,t+1}&\dots&\eta_{n_{b},t+1}\end{bmatrix}^{\top}\sim\mathcal{N}_{n_{b}}(\bm{0}_{n_{b}\times 1},\sigma^{2}_{\eta}\bm{R}) , where \sigma^{2}_{\eta}=1 and \bm{R} is the correlation matrix of the bottom series obtained as the closest positive definite matrix to \check{\bm{R}} , with \check{\rho}_{i,k}=U(-1,1) , i\neq k , with U\left(-1,1\right) denoting a Uniform distribution in (-1,1) , and \check{\rho}_{i,i}=1 , i,k=1,\ldots,n_{b} . The n -variate linearly constrained time series \bm{y}_{t+1} is given by \bm{y}_{t+1}=\bm{S}\bm{b}_{t+1} , where \bm{b}_{t+1}=\begin{bmatrix}b_{1,t+1}&\dots&b_{n_{b},t+1}\end{bmatrix}^{\top} . To generate the base forecasts from different experts, the systematic part of the forecast from the j -th expert for the i -th bottom variable at time t+1 is obtained as \check{b}^{j}_{i,t+1}=\mu_{j}+\beta_{j,1}F_{1,i,t+1}+\beta_{j,2}F_{2,i,t+1} , i=1,\ldots,n_{b} , j=1,\ldots,p ,where \bm{\beta}_{j}=\begin{bmatrix}\beta_{j,1}&\beta_{j,2}\end{bmatrix}^{\top} is the vector of factor loadings for the series’ components. The base forecast vector \widehat{\bm{y}}^{j}_{t+1} produced by the j -th expert for the complete set of n variables (i.e., balanced case), is \widehat{\bm{y}}^{j}_{t+1}=\bm{S}\check{\bm{b}}^{j}_{t+1}+\bm{\varepsilon}^{j}_{t+1}, (30) where \bm{\varepsilon}^{j}_{t+1}=\begin{bmatrix}\varepsilon_{1,t+1}^{j}&\dots&\varepsilon_{n,t+1}^{j}\end{bmatrix}^{\top}\sim\mathcal{N}_{n}(\bm{0}_{(n\times 1)},\bm{\Gamma}_{\varepsilon}) and \bm{\Gamma}_{\varepsilon}=\bm{D}^{-1/2}\bm{\Theta}\bm{D}^{-1/2} , with variance proportional to the number of bottom variables involved in the aggregation defining the nodes at each hierarchy level, i.e., \bm{D}=\text{Diag}(\sigma_{j}^{2}\bm{S}\bm{1}_{n_{b}}) , that in our setting is equal to \bm{D}=\sigma^{2}_{j}\begin{bmatrix}[0.9]4&0&0&0&0&0&0\\ 0&2&0&0&0&0&0\\ 0&0&2&0&0&0&0\\ 0&0&0&1&0&0&0\\ 0&0&0&0&1&0&0\\ 0&0&0&0&0&1&0\\ 0&0&0&0&0&0&1\end{bmatrix},\quad j=1,\ldots,p, and two covariance structures: either uncorrelated errors 10 10 10 Due to space constraints, the results with uncorrelated errors are provided in E . The main conclusions drawn do not differ substantially from those valid for the correlated case. , i.e., \bm{\Theta}=\bm{I}_{n} , or \bm{\Theta} equal to the closest positive definite matrix \check{\bm{\Theta}} with entries \check{\theta}_{i,k}=U(-1,1) , i\neq k , and \check{\theta}_{i,i}=1 , i,k=1,\ldots,n_{b} . Table 4 : Each setting specifies values for the parameters in the multivariate forecast model, including mean terms \mu_{j} , factor loadings \bm{\beta}_{i} , errors’ variance \sigma_{i}^{2} , autoregressive matrix \bm{\Phi}_{F} , and correlation \rho_{i,k} , i\neq k , for the bottom time series. Settings vary systematically to assess model performance under different assumptions, including uniform ( U ), beta ( B ), inverse gamma ( IG ), and normal ( \mathcal{N} ) distributions. Settings 1–5 replicate Capistrán and Timmermann, (2009) , while Setting 6 includes a bias component \mu_{j}\neq 0 for each expert. Setting \mu_{j} \bm{\beta}_{j} \sigma_{j}^{2} \bm{\Phi}_{F} 1 0 \bm{1}_{2} 1 \bm{0}_{2\times 2} 2 0 0.5\cdot\bm{1}_{2} 1 \bm{0}_{2\times 2} 3 0 0.5\cdot\bm{1}_{2} 1 0.9\cdot\bm{I}_{2} 4 0 \begin{bmatrix}B(1,1)\\ B(1,1)\end{bmatrix} 1 \bm{0}_{2\times 2} 5 0 0.5\cdot\bm{1}_{2} IG(5,5) \bm{0}_{2\times 2} 6 \mathcal{N}(0,1) 0.5\cdot\bm{1}_{2} 1 \bm{0}_{2\times 2} Following Capistrán and Timmermann, (2009) , we assume that E[\varepsilon_{i,t+1}^{j}\varepsilon_{k,t+1}^{l}]=0 for j\neq l , and that E[\varepsilon_{n_{u}+i,t+1}^{j}\eta_{i,t+1}]=0 , j=1,\dots,p and i=1,\dots,n_{b} . This setup represents a scenario where, at time t , forecasters receive noisy signals that are imperfectly correlated with future realizations of the factors F_{1,i,t+1} and F_{2,i,t+1} . For the calculation of covariance matrices in both reconciliation and combination processes, we utilize N observations, with T=N+100 , where the last 100 observations are reserved as test set. In each experimental configuration (see Table 4 ), we examine different values for the number of observations, N\in\{50,100,200\} , and the number of experts, p\in\{4,10,20\} , running 500 replications per setting to ensure robustness in results. In addition, we consider two different frameworks as Capistrán and Timmermann, (2009) : • Balanced panel of forecasts : no missing values, allowing for consistent forecasts across all variables and experts. • Unbalanced panel of forecasts : we classify experts according to their participation frequency, distinguishing between frequent (40%) and infrequent participants. Using the transition probabilities proposed in Capistrán and Timmermann, (2009) , we generate a binary participation matrix for each variable 11 11 11 In the optimal coherent combination approach utilizing a block-diagonal shrunk error covariance matrix, the different number of residuals across experts and variables is addressed through the covariance shrinkage parameters \lambda_{j} , j=1,\dots,p , as detailed in Section 3. , that is applied to the fully populated matrix of forecasts simulated by expression ( 30 ). This results in a realistic, unbalanced panel structure that allows us to examine the impact of varying participation frequencies on the accuracy and robustness of different coherent combination forecast approaches. These frameworks provide a comprehensive environment for testing forecast performance under different data conditions, allowing us to assess robustness across scenarios. The forecast accuracy is evaluated using the Average Relative Mean Absolute ( AvgRelMAE ) 12 12 12 Detailed results, including a forecast evaluation using the Average Relative Mean Squared Error, are presented in E . Notably, the use of the squared error metric does not change the main conclusions. , given by AvgRelMAE^{app}=\left(\prod_{s=1}^{500}\prod_{i=1}^{n}\frac{MAE_{s,i}^{app}}{MAE_{s,i}^{\text{ew}}}\right)^{\frac{1}{500n}}\;\text{with}\;\;MAE_{s,i}^{app}=\displaystyle\frac{1}{100}\sum_{q=1}^{100}\left|y_{i,s,q}-\overline{y}_{i,s,q}^{\,app}\right|, where i=1,...,n denotes the variable, app is the approach used, y_{i,s,q} is the observed value and \overline{y}_{i,s,q}^{\,app} is the forecast value using the app approach (either coherent or incoherent, see Table 5 ). Table 5 : Summary of forecasting approaches used in the simulation ( Section 6 ) and in the forecasting experiment on the Australian daily electricity generation time series ( Section 7 ). For single-model reconciliation and coherent combination sequential approaches, the shrunk in-sample MSE matrix is used for the reconciliation. Approach & description Approach & description Base (incoherent forecasts) base ∗ Best base forecasts ( Section 6 ) tbats Exponential smoothing state space model with Box-Cox transformation, ARMA errors, Trend and Seasonal components ( Section 7 ) Single model reconciliation base {}^{\ast}_{\text{shr}} Cross-sectional reconciliation of the best base forecasts ( Section 6 ) base {}_{\text{shr}} Best cross-sectional reconciliation of base forecasts ( Section 6 ) tbats {}_{\text{shr}} Cross-sectional reconciliation of tbats base ( Section 7 ) Single-task combination ( incoherent forecasts , Sections 6 and 7 ) ew Equal-weighted average ow {}_{\text{var}} Weighted average, optimal weights inversely proportional to the MSE’s ow {}_{\text{cov}} Weighted average, optimal weights in the unit simplex ( Conflitti et al.,, 2015 ) computed using the MSE matrix Coherent combination (Sections 6 and 7 ) src Sequential reconciliation-then-combination with ew scr {}_{\text{ew}} Sequential ew combination-then-reconciliation scr {}_{\text{var}} Sequential ow {}_{\text{var}} combination-then- reconciliation scr {}_{\text{cov}} Sequential ow {}_{\text{cov}} combination-then- reconciliation occ {}_{\text{be}} Optimal coherent combination using a by-expert block-diagonal shrunk error covariance matrix Table 6 : AvgRelMAE for the simulation experiment. Benchmark approach: equal-weighted average (ew). Bold entries identify the best performing approaches, italic entries identify the second best and red color denotes forecasts worse than the benchmark. Balanced panel of forecasts Unbalanced panel of forecasts Sett. p N base ∗ base {}^{\ast}_{\text{shr}} base {}_{\text{shr}} ew ow {}_{\text{var}} ow {}_{\text{cov}} src scr {}_{\text{ew}} scr {}_{\text{var}} scr {}_{\text{cov}} occ {}_{\text{be}} ew ow {}_{\text{var}} ow {}_{\text{cov}} scr {}_{\text{ew}} scr {}_{\text{var}} scr {}_{\text{cov}} occ {}_{\text{be}} 1 4 50 1.308 1.063 1.058 1.000 1.002 1.027 0.921 0.949 0.951 0.969 0.905 1.000 1.031 1.479 0.903 1.053 1.122 0.892 100 1.307 1.038 1.037 1.000 1.000 1.014 0.915 0.946 0.946 0.955 0.894 1.000 1.024 1.341 0.903 1.032 1.114 0.885 200 1.305 1.026 1.025 1.000 1.000 1.007 0.912 0.943 0.942 0.946 0.890 1.000 1.010 1.191 0.902 1.002 1.090 0.880 10 50 1.417 1.152 1.146 1.000 1.001 1.053 0.962 0.980 0.981 1.020 0.953 1.000 1.220 2.999 0.943 1.276 1.492 0.941 100 1.417 1.125 1.123 1.000 1.000 1.033 0.959 0.979 0.979 1.003 0.947 1.000 1.216 2.924 0.940 1.250 1.488 0.928 200 1.412 1.111 1.110 1.000 1.000 1.019 0.958 0.976 0.976 0.989 0.946 1.000 1.183 2.688 0.940 1.190 1.464 0.923 20 50 1.461 1.188 1.181 1.000 1.001 1.063 0.979 0.990 0.991 1.040 0.974 1.000 1.351 4.250 0.973 1.426 1.797 0.981 100 1.463 1.162 1.159 1.000 1.000 1.044 0.978 0.990 0.990 1.023 0.972 1.000 1.335 4.405 0.974 1.385 1.814 0.968 200 1.455 1.147 1.145 1.000 1.000 1.028 0.978 0.989 0.988 1.008 0.971 1.000 1.287 4.077 0.973 1.302 1.709 0.958 2 4 50 1.226 1.054 1.052 1.000 1.001 1.026 0.949 0.967 0.968 0.986 0.942 1.000 1.022 1.396 0.928 1.031 1.076 0.919 100 1.226 1.037 1.036 1.000 1.000 1.014 0.945 0.965 0.966 0.975 0.936 1.000 1.020 1.314 0.929 1.022 1.077 0.914 200 1.225 1.026 1.026 1.000 1.000 1.007 0.943 0.963 0.963 0.967 0.932 1.000 1.013 1.191 0.927 1.008 1.067 0.910 10 50 1.294 1.113 1.110 1.000 1.001 1.045 0.977 0.988 0.989 1.023 0.974 1.000 1.147 2.536 0.963 1.173 1.316 0.960 100 1.295 1.095 1.093 1.000 1.000 1.030 0.976 0.988 0.988 1.009 0.972 1.000 1.145 2.470 0.962 1.161 1.317 0.952 200 1.293 1.083 1.083 1.000 1.000 1.018 0.975 0.987 0.987 0.999 0.970 1.000 1.129 2.088 0.961 1.133 1.260 0.947 20 50 1.319 1.135 1.132 1.000 1.000 1.050 0.988 0.994 0.994 1.032 0.986 1.000 1.226 3.433 0.985 1.259 1.518 0.989 100 1.319 1.117 1.114 1.000 1.000 1.036 0.988 0.994 0.994 1.021 0.986 1.000 1.221 3.561 0.986 1.245 1.537 0.981 200 1.318 1.105 1.103 1.000 1.000 1.023 0.987 0.994 0.994 1.009 0.984 1.000 1.199 3.475 0.986 1.206 1.512 0.974 3 4 50 1.110 1.034 1.034 1.000 1.000 1.020 0.979 0.988 0.988 1.003 0.978 1.000 1.321 1.824 0.969 1.377 1.459 0.961 100 1.112 1.025 1.025 1.000 1.000 1.013 0.977 0.986 0.987 0.995 0.975 1.000 1.325 1.862 0.969 1.360 1.479 0.958 200 1.111 1.016 1.016 1.000 1.000 1.007 0.974 0.984 0.984 0.989 0.971 1.000 1.313 1.852 0.966 1.328 1.498 0.957 10 50 1.137 1.059 1.059 1.000 1.000 1.029 0.992 0.995 0.995 1.017 0.991 1.000 1.462 2.819 0.988 1.523 1.647 0.984 100 1.139 1.050 1.049 1.000 1.000 1.021 0.990 0.995 0.995 1.011 0.989 1.000 1.462 2.712 0.986 1.503 1.619 0.979 200 1.138 1.044 1.041 1.000 1.000 1.013 0.989 0.995 0.995 1.004 0.988 1.000 1.437 2.256 0.988 1.455 1.506 0.977 20 50 1.147 1.069 1.067 1.000 1.000 1.031 0.996 0.997 0.998 1.021 0.995 1.000 1.527 3.547 0.997 1.594 1.801 0.997 100 1.148 1.058 1.057 1.000 1.000 1.023 0.995 0.997 0.997 1.015 0.994 1.000 1.514 3.682 0.998 1.563 1.798 0.992 200 1.148 1.053 1.051 1.000 1.000 1.016 0.995 0.998 0.998 1.010 0.994 1.000 1.482 3.599 0.999 1.504 1.755 0.990 4 4 50 1.243 1.074 1.074 1.000 0.991 1.001 0.950 0.968 0.957 0.950 0.922 1.000 0.999 1.343 0.922 1.008 1.049 0.909 100 1.241 1.056 1.056 1.000 0.989 0.988 0.946 0.966 0.953 0.936 0.915 1.000 1.001 1.277 0.922 1.004 1.049 0.904 200 1.242 1.042 1.042 1.000 0.989 0.982 0.942 0.963 0.950 0.929 0.909 1.000 0.993 1.130 0.921 0.988 1.032 0.900 10 50 1.317 1.134 1.134 1.000 0.986 0.987 0.978 0.988 0.973 0.955 0.948 1.000 1.129 2.507 0.956 1.155 1.290 0.947 100 1.313 1.117 1.117 1.000 0.985 0.968 0.976 0.987 0.972 0.936 0.942 1.000 1.126 2.388 0.956 1.141 1.283 0.938 200 1.317 1.107 1.107 1.000 0.985 0.959 0.975 0.986 0.971 0.926 0.939 1.000 1.114 2.072 0.955 1.119 1.240 0.933 20 50 1.336 1.150 1.150 1.000 0.983 0.973 0.989 0.994 0.977 0.948 0.958 1.000 1.214 3.456 0.982 1.248 1.500 0.975 100 1.339 1.138 1.138 1.000 0.983 0.952 0.988 0.994 0.977 0.928 0.954 1.000 1.206 3.482 0.981 1.230 1.519 0.964 200 1.334 1.123 1.123 1.000 0.983 0.937 0.987 0.994 0.976 0.913 0.950 1.000 1.186 3.329 0.981 1.193 1.452 0.957 5 4 50 1.241 1.049 1.049 1.000 0.989 1.010 0.939 0.959 0.955 0.969 0.926 1.000 0.989 1.346 0.916 0.998 1.040 0.901 100 1.245 1.038 1.034 1.000 0.989 0.998 0.934 0.957 0.952 0.958 0.919 1.000 0.986 1.251 0.915 0.988 1.038 0.895 200 1.243 1.023 1.023 1.000 0.988 0.991 0.930 0.954 0.949 0.951 0.915 1.000 0.982 1.136 0.915 0.977 1.030 0.892 10 50 1.322 1.122 1.122 1.000 0.994 1.036 0.972 0.985 0.981 1.012 0.966 1.000 1.120 2.421 0.953 1.145 1.292 0.945 100 1.320 1.103 1.103 1.000 0.994 1.021 0.971 0.985 0.981 1.000 0.964 1.000 1.118 2.349 0.953 1.134 1.280 0.936 200 1.320 1.087 1.087 1.000 0.993 1.009 0.968 0.983 0.979 0.990 0.960 1.000 1.105 2.083 0.950 1.109 1.248 0.930 20 50 1.353 1.151 1.149 1.000 0.997 1.049 0.986 0.993 0.991 1.030 0.983 1.000 1.212 3.480 0.979 1.246 1.514 0.980 100 1.352 1.132 1.128 1.000 0.996 1.031 0.984 0.992 0.990 1.015 0.980 1.000 1.204 3.568 0.980 1.228 1.533 0.969 200 1.356 1.116 1.113 1.000 0.996 1.020 0.984 0.992 0.990 1.007 0.979 1.000 1.186 3.461 0.980 1.193 1.496 0.963 6 4 50 1.370 1.240 1.240 1.000 0.966 0.962 0.961 0.975 0.928 0.919 0.898 1.000 0.871 1.212 0.848 0.870 0.904 0.840 100 1.367 1.224 1.224 1.000 0.964 0.950 0.956 0.972 0.923 0.906 0.891 1.000 0.869 1.099 0.847 0.864 0.899 0.830 200 1.366 1.212 1.212 1.000 0.964 0.944 0.952 0.970 0.921 0.899 0.886 1.000 0.863 0.997 0.844 0.853 0.884 0.826 10 50 1.508 1.363 1.363 1.000 0.980 1.003 0.981 0.990 0.964 0.980 0.946 1.000 1.016 2.396 0.893 1.036 1.180 0.891 100 1.507 1.349 1.349 1.000 0.978 0.986 0.979 0.990 0.962 0.965 0.942 1.000 1.013 2.297 0.891 1.025 1.176 0.878 200 1.499 1.331 1.331 1.000 0.979 0.975 0.977 0.988 0.961 0.956 0.940 1.000 1.005 2.055 0.893 1.007 1.163 0.875 20 50 1.554 1.410 1.408 1.000 0.990 1.031 0.989 0.994 0.982 1.014 0.973 1.000 1.143 3.443 0.945 1.175 1.459 0.952 100 1.552 1.389 1.389 1.000 0.988 1.012 0.989 0.994 0.980 0.998 0.969 1.000 1.135 3.527 0.942 1.155 1.469 0.936 200 1.553 1.379 1.379 1.000 0.987 0.998 0.988 0.995 0.979 0.986 0.966 1.000 1.118 3.310 0.941 1.125 1.410 0.927 Table 6 presents several critical aspects that influence the performance of forecasting methods under different conditions. It clearly appears that as the number of residuals used to estimate the error covariance matrices grows, the quality of forecast improves in terms of accuracy. This finding highlighted the critical role of robust statistical techniques to estimate the covariances, particularly in high-dimensional settings where estimation errors can propagate and affect the results negatively. In relation to this problem, we observe that the AvgRelMAE decreases as the number of experts p increases. Developing criteria for identifying the most relevant experts for combining and reconciling forecasts is an important aspect which lies beyond the scope of this paper. Looking at the different forecasting procedures, the coherent approaches src (for balanced cases), scr {}_{\text{ew}} , scr_{\text{var}} , and occ {}_{\text{be}} consistently outperform the benchmark equal-weighted (ew) average, as indicated by indices uniformly below 1. Among these, occ {}_{\text{be}} is the most effective overall, ranking first in the majority of cases for both balanced panels (51 out of 54 cases) and unbalanced panels (50 out of 54 cases) for any setting. The scr {}_{\text{ew}} method also demonstrates strong performance, particularly in unbalanced panel, where it frequently ranks among the top-performing methods (first 4 times and second 50 times). Similarly, the src method shows excellent results in balanced cases, ranking second in 37 out of 54 cases. However, a major drawback of this approach is that it cannot be used in the unbalanced case, which limits its applicability in real-world scenarios where data availability is often irregular. In conclusion, among the evaluated approaches, occ {}_{\text{be}} stands out as the most effective and accurate, highlighting the advantages of simultaneously combining and reconciling forecasts for different variables and from multiple experts. 7 Forecasting Australian daily electricity generation To illustrate the effectiveness of the coherent forecast combination methodology for real-life data, we perform a forecasting experiment on the daily electricity generation from various energy sources in Australia ( Panagiotelis et al.,, 2023 ) . Daily time series data were obtained from opennem.org.au , which compiles publicly available data from the Australian Energy Market Operator (AEMO). Accurate day-ahead forecasts are crucial for operational planning and ensuring the efficiency and stability of the power network, particularly as the growth of intermittent renewable energy sources, such as wind and solar, introduces significant variability and complexity into the power system. Wind Biomass Battery (Discharg.) Battery (Charg.) Hydro Pumps Solar (Rooftop) Solar (Utility) Distillate Black Coal Brown Coal Gas (Recip.) Gas (OCGT) Gas (CCGT) Gas (Steam) Gas Coal Solar Hydro (-Pumps) Batteries Renew. non-Renew. Total Figure 2 : Australian daily electricity generation hierarchy (left) and the corresponding linear combination matrix (right), mapping 15 bottom variables into 8 upper variables. Red color denotes bottom variables that - when aggregated - are subtracted instead of added. Figure 2 shows the source generation hierarchy and the corresponding linear combination matrix \bm{A}\in\{-1,0,1\}^{8\times 15} for the whole dataset of 23 time series ( Figure 3 ), with 15 of these being bottom-level series, representing the specific sources of generation. Detailed descriptions of the aggregation levels, including the components of each source, are available in Panagiotelis et al., (2023) 13 13 13 The original dataset, available at https://github.com/PuwasalaG/Probabilistic-Forecast-Reconciliation , underwent a cleaning process. Specifically, 2 out of the 15 original bottom time series (Distillate and Biomass) contained some negative values (from -0.06 to -0.01), which affected 26% and 0.9% of their data, respectively. To address this issue, these negative values were replaced by zero . Figure 3 : Australian daily electricity generation time series. In order to assess the forecast accuracy of the various approaches, we perform a rolling forecast experiment with an expanding window. The first training window consists of 140 days (20 weeks) of data. One - to seven - step - ahead forecasts were generated leading to Q_{1}=226 one -, ..., and Q_{7}=220 seven - step - ahead daily forecasts for evaluation. Each series was independently modeled using three different approaches: stlf ( Cleveland,, 1990 , Seasonal and Trend decomposition using Loess,) , arima ( Box and Jenkins,, 1976 , AutoRegressive Integrated Moving Average,) , tbats ( De Livera et al.,, 2011 , Exponential smoothing state space model with Box-Cox transformation, ARMA errors, Trend and Seasonal components,) . Starting from the base forecasts produced by these models, we consider three single-task combination procedures, resulting in incoherent forecasts, three single model reconciliation approaches and five coherent combination procedures (see Table 5 ) 14 14 14 The base forecasting models were implemented using the automatic forecasting procedure of the R package forecast ( Hyndman and Khandakar,, 2008 , Hyndman et al.,, 2023 ) . The combined and reconciled forecasts were computed using the R packages FoReco ( Girolimetto and Di Fonzo, 2024a, ) and FoCo2 ( Girolimetto and Di Fonzo, 2024b, ) . A complete set of results is available at the GitHub repository https://github.com/danigiro/cfc-project . : 1. Single-task combination : equal weights (ew) and two classical optimal weighting schemes proposed by Bates and Granger, (1969) and Newbold and Granger, (1974) , called respectively ow {}_{\text{var}} , based on the diagonal elements of the in-sample MSE matrix, and ow {}_{\text{cov}} , based on the whole MSE matrix, with optimized weights constrained to be non-negative and sum to unity ( Conflitti et al.,, 2015 ) . 2. Single model reconciliation : for each base forecasting model, the reconciled forecasts are obtained through the MinT approach by Wickramasuriya et al., (2019) , with a shrunk in-sample error covariance matrix (stlf {}_{\text{shr}} , arima {}_{\text{shr}} , tbats {}_{\text{shr}} ). 3. Coherent combination : we consider four sequential approaches, namely (i) sequential reconciliation-then-equal-weight-combination (src), (ii)-(iv) sequential combination-then-reconciliation: (scr {}_{\text{ew}} , scr {}_{\text{var}} , scr {}_{\text{cov}} ), and finally occ, the optimal coherent combination approach with by-expert block-diagonal shrunk in-sample covariance matrix (see section 5.2 ). The forecast accuracy is evaluated using the Average Relative Mean Absolute ( AvgRelMAE ) and Squared ( AvgRelMSE ) Error ( Fleming and Wallace,, 1986 , Davydenko and Fildes,, 2013 ) computed as, respectively, AvgRelMAE^{app}=\left(\prod_{h=1}^{H}AvgRelMAE_{h}^{app}\right)^{\frac{1}{H}}\;\text{and}\;\;AvgRelMSE^{app}=\left(\prod_{h=1}^{H}AvgRelMSE_{h}^{app}\right)^{\frac{1}{H}}. The AvgRelMAE and AvgRelMSE for a fixed forecast horizon h are defined as AvgRelMAE_{h}^{app}=\left(\prod_{i=1}^{n}\frac{MAE_{h,i}^{app}}{MAE_{h,i}^{\text{ew}}}\right)^{\frac{1}{n}}\;\text{and}\;\;AvgRelMSE_{h}^{app}=\left(\prod_{i=1}^{n}\frac{MSE_{h,i}^{app}}{MSE_{h,i}^{\text{ew}}}\right)^{\frac{1}{n}}, with the Mean Squared Error ( MSE ) and Mean Absolute Error ( MAE ) for each forecast horizon and variable are computed as MSE_{h,i}^{app}=\displaystyle\frac{1}{Q_{h}}\sum_{q=1}^{Q_{h}}\left(y_{i,h,q}-\overline{y}_{i,h,q}^{\,app}\right)^{2}\;\text{and}\;\;MAE_{h,i}^{app}=\displaystyle\frac{1}{Q_{h}}\sum_{q=1}^{Q_{h}}\left|y_{i,h,q}-\overline{y}_{i,h,q}^{\,app}\right|, where h=1,...,H is the forecast horizon, i=1,...,n denotes the variable, Q_{h} is the dimension of the test set, app is the approach used, y_{i,h,q} is the observed value and \overline{y}_{i,h,q}^{\,app} is the forecast value using the app approach (coherent or incoherent). Finally, we evaluate the forecasting performances of different approaches by first applying the pairwise Diebold and Mariano, (1995) test to investigate the null hypothesis of Equal Predictive Accuracy (EPA) across models and, then, we use the Model Confidence Set (MCS) approach developed by Hansen et al., (2011) , which identifies approaches with statistically superior performance. In addition, in F , we present the results for the non-parametric Friedman test along with the post hoc multiple-comparison-with-the-best (MCB) Nemenyi test ( Koning et al.,, 2005 , Kourentzes and Athanasopoulos,, 2019 , Makridakis et al.,, 2022 ) , both of which are well-established tools for evaluating multiple forecast approaches. 7.1 Results Forecast accuracy indices AvgRelMAE and AvgRelMSE for all 23 time series 15 15 15 A detailed analysis, distinct between upper and bottom time series, also using a wider set of coherent combination procedures, is available in G . are reported in Table 7 , while Figure 4 and Table 8 show the pairwise DM-test test and the MCS approach, respectively. The forecasting approaches are evaluated for each forecast horizon (1 through 7 days), and across all horizons (denoted 1:7). Table 7: AvgRelMAE (top panel) and AvgRelMSE (bottom panel) of daily forecasts for the Australian electricity generation dataset. Benchmark approach: equal-weighted average (ew). Bold entries identify the best performing approaches, italic entries identify the second best, and red color denotes forecasts worse than the benchmark. Forecast horizon Approach 1 2 3 4 5 6 7 1:7 AvgRelMAE - All 23 time series Base (incoherent forecasts) and single model reconciliation tbats 1.0447 1.0515 1.0348 1.0266 1.0305 1.0288 1.0201 1.0331 tbats {}_{\text{shr}} 1.0320 1.0413 1.0231 1.0134 1.0212 1.0208 1.0188 1.0235 Combination (incoherent forecasts) ew 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1 1.0000 ow {}_{\text{var}} 0.9927 0.9921 0.9982 0.9983 0.9967 0.9967 0.9990 0.9965 ow {}_{\text{cov}} 1.0216 1.0208 1.0390 1.0423 1.0307 1.0250 1.0325 1.0309 Coherent combination src 0.9939 0.9941 0.9919 0.9895 0.9887 0.9908 0.9933 0.9915 scr {}_{\text{ew}} 0.9952 0.9959 0.9911 0.9908 0.9908 0.9932 0.9961 0.9930 scr {}_{\text{var}} 0.9819 0.9803 0.9869 0.9895 0.9887 0.9913 0.9972 0.9882 scr {}_{\text{cov}} 1.0081 1.0081 1.0270 1.0327 1.0245 1.0197 1.0250 1.0215 occ {}_{\text{be}} 0.9779 0.9745 0.9843 0.9852 0.9851 0.9880 0.9926 0.9843 AvgRelMSE - All 23 time series Base (incoherent forecasts) and single model reconciliation tbats 1.0796 1.0780 1.0445 1.0270 1.0322 1.0288 1.0142 1.0393 tbats {}_{\text{shr}} 1.0478 1.0577 1.0304 1.0108 1.0219 1.0213 1.0116 1.0257 Combination (incoherent forecasts) ew 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 ow {}_{\text{var}} 0.9840 0.9881 0.9995 1.0032 1.0020 1.0028 1.0054 0.9995 ow {}_{\text{cov}} 1.0279 1.0494 1.0972 1.1103 1.1009 1.0993 1.1055 1.0908 Coherent combination src 0.9827 0.9855 0.9863 0.9833 0.9852 0.9873 0.9911 0.9859 scr {}_{\text{ew}} 0.9875 0.9898 0.9859 0.9859 0.9885 0.9905 0.9962 0.9890 scr {}_{\text{var}} 0.9586 0.9683 0.9838 0.9942 0.9982 1.0017 1.0114 0.9910 scr {}_{\text{cov}} 1.0026 1.0287 1.0795 1.0972 1.0942 1.0913 1.0981 1.0773 occ {}_{\text{be}} 0.9481 0.9560 0.9754 0.9831 0.9891 0.9939 0.9993 0.9808 Figure 4 : Pairwise DM-test results for the Australian electricity generation dataset, evaluated using absolute loss (top panels) and quadratic loss (bottom panel) across different forecast horizons. The left panel corresponds to forecast horizon h=1 , while the right panel is for h=1,\dots,7 . Each cell reports the percentage of series for which the p -value of the DM-test is below 0.05 : e.g., the value 83 in the top-left cell means that occ resulted more accurate ( p -value <0.05 ) than stlf for h=1 and in terms of absolute error in the 83% of the series. Table 8: Model Confidence Set results ( 10^{4} bootstrap sample) for the Australian electricity generation dataset, evaluated using absolute loss (top panels) and quadratic loss (bottom panel) across different forecast horizons ( h=1 and h=1,\dots,7 ). Each cell reports the percentage of series for which that approach is in the Model Confidence Set across different thresholds ( \delta\in\{95\%,90\%,80\%\} ). h=1 h=1:7 Approach \delta=95\% \delta=90\% \delta=80\% \delta=95\% \delta=90\% \delta=80\% Absolute loss - All 23 time series Base (incoherent forecasts) and single model reconciliation tbats 56.5 56.5 52.2 78.3 69.6 56.5 tbats {}_{\text{shr}} 78.3 73.9 60.9 87.0 82.6 69.6 Combination (incoherent forecasts) ew 87.0 87.0 78.3 95.7 91.3 78.3 ow {}_{\text{var}} 95.7 95.7 82.6 95.7 91.3 82.6 ow {}_{\text{cov}} 73.9 69.6 60.9 73.9 65.2 43.5 Coherent combination src 91.3 91.3 87.0 95.7 95.7 87.0 scr {}_{\text{ew}} 91.3 91.3 87.0 95.7 91.3 78.3 scr {}_{\text{var}} 100.0 100.0 91.3 91.3 91.3 87.0 scr {}_{\text{cov}} 82.6 78.3 73.9 78.3 69.6 65.2 occ {}_{\text{be}} 100.0 100.0 95.7 95.7 95.7 87.0 Quadratic loss - All 23 time series Base (incoherent forecasts) and single model reconciliation tbats 65.2 65.2 60.9 91.3 73.9 73.9 tbats {}_{\text{shr}} 73.9 69.6 65.2 95.7 82.6 69.6 Combination (incoherent forecasts) ew 87.0 78.3 60.9 95.7 87.0 82.6 ow {}_{\text{var}} 100.0 82.6 78.3 91.3 87.0 82.6 ow {}_{\text{cov}} 78.3 69.6 52.2 78.3 60.9 34.8 Coherent combination src 95.7 91.3 82.6 91.3 91.3 91.3 scr {}_{\text{ew}} 95.7 87.0 73.9 91.3 91.3 91.3 scr {}_{\text{var}} 95.7 95.7 95.7 91.3 91.3 91.3 scr {}_{\text{cov}} 82.6 82.6 73.9 73.9 60.9 56.5 occ {}_{\text{be}} 100.0 95.7 95.7 91.3 91.3 91.3 We begin by analyzing incoherent forecasting approaches, focusing on both base and single-task combinations. Among the three base forecasting models, tbats demonstrates the highest performance ( G ) and single-task combination strategies consistently lead to improvements in forecasting accuracy over the base models. Furthermore, we observe that equal weight (ew) and variance-weighted (ow {}_{\text{var}} ) combinations outperform the covariance-weighted (ow {}_{\text{cov}} ) approach in terms of both MSE and MAE. Among these, ow {}_{\text{var}} performs better than ew in all cases when considering MAE, and in three out of seven forecast horizons when evaluated by MSE. However, further analysis in Figure 4 and Table 8 , using the Diebold-Mariano and MCS tests (along with the MCB test in F ), suggests that these differences are not statistically significant. This result is not surprising, and somehow confirms the robustness of the equal weight combination scheme, an issue well-known in the forecasting literature as ‘forecast combination puzzle’ ( Smith and Wallis,, 2009 , Claeskens et al.,, 2016 , Qian et al.,, 2019 , Frazier et al.,, 2023 , Liu et al.,, 2024 ) . When we focus on coherent forecasting methods, single-expert reconciliation approaches generally improve on the forecasting accuracy of the base forecasts, but perform worse when compared to the single-task combination approaches. Coherent combination approaches, on the other hand, consistently outperform base models, single-task combinations, and single-expert reconciliation. Moreover, these coherent methods produce forecasts that satisfy all the necessary constraints, which is a critical advantage in many applied contexts. In detail, while the differences between the various coherent methods may not always be statistically significant, overall Figure 4 and Table 8 suggest that the optimal coherent combination approach occ be delivers the best results in terms of both MSE and MAE, and looks particularly effective in balancing forecast accuracy and coherence. In addition, scr {}_{\text{var}} , the variance-weighted combination followed by MinT reconciliation, is the most effective sequential coherent combination procedure. 8 Conclusions, limitations and future work In this paper, we have introduced several coherent multi-task forecast combination procedures designed for linearly constrained time series, with a focus on an approach involving an optimization-based technique to combine multiple unbiased, possibly incoherent base forecasts, while ensuring coherence across the variables. Our solution has nice theoretical properties, including unbiasedness and minimum forecast error variance, making it a powerful tool balancing forecast accuracy and coherence in different scenarios. However, the theoretical solution relies on two key assumptions: the base forecasts are unbiased, and the error covariance matrix is known. As for the former issue, it is left to the user the task of removing any bias from the base forecasts. Addressing the second challenge, we have outlined practical approaches for the estimation of the covariance matrix, such as using in-sample residuals, which consider techniques from both forecast combination and reconciliation literature. These approaches provide a feasible path forward for practitioners dealing with multiple base forecasts in real-world settings, where there is not perfect knowledge of the covariance matrix. From a practical perspective, the new methodology has been empirically validated through a simulation experiment and in a real-world application, demonstrating its effectiveness and robustness. The results show that the coherent multi-task forecast combination consistently outperforms individual base forecasts, single-task combinations, forecasts reconciled by single experts and sequential coherent combination approaches. This performance highlights the method’s ability to integrate multiple sources of information while maintaining coherence. Future research offers several directions for further developing of the coherent multi-task forecast combination methodology. One key area involves exploring more advanced and flexible methods for estimating the error covariance matrix. While we have proposed practical solutions using in-sample residuals, more sophisticated techniques could be devised to improve the covariance estimates, particularly in high-dimensional settings where data limitations are common. Another promising direction is the extension of the framework from point to probabilistic forecasting, which is crucial for decision-making in fields like energy, finance, and economics. We aim to pursue these topics in our ongoing research, with the goal of further improving the accuracy and flexibility of this methodology. Appendix A Proofs of Theorem 1 and Corollary 1 Proof of Theorem 1 : Optimal linear coherent forecast combination \widetilde{\bm{y}}^{c} . Consider the augmented (lagrangean) objective function \displaystyle\mathcal{L}\left(\bm{y},\bm{\lambda}\right) \displaystyle=\left(\widehat{\bm{y}}-\bm{K}\bm{y}\right)^{\top}\bm{W}^{-1}\left(\widehat{\bm{y}}-\bm{K}\bm{y}\right)+2\bm{\lambda}^{\top}\bm{C}\bm{y} \displaystyle=\bm{y}^{\top}\bm{K}^{\top}\bm{W}^{-1}\bm{K}\bm{y}-2\widehat{\bm{y}}^{\top}\bm{W}^{-1}\bm{K}\bm{y}+\widehat{\bm{y}}^{\top}\bm{W}^{-1}\widehat{\bm{y}}+2\bm{\lambda}^{\top}\bm{C}\bm{y}. The first order condition, obtained by equating to zero the partial derivatives of \mathcal{L}\left(\bm{y},\bm{\lambda}\right) wrt \bm{y} and \bm{\lambda} , respectively, results in: \begin{bmatrix}\bm{K}^{\top}\bm{W}^{-1}\bm{K}&\bm{C}^{\top}\\ \bm{C}&\bm{0}_{(n_{u}\times 1)}\end{bmatrix}\begin{bmatrix}\;\bm{y}\;\;\\ \bm{\lambda}\end{bmatrix}=\begin{bmatrix}\bm{K}^{\top}\bm{W}^{-1}\widehat{\bm{y}}\\ \bm{0}_{(n_{u}\times 1)}\end{bmatrix}. (31) The optimal coherent combination forecast vector \widetilde{\bm{y}}^{c} is thus obtained by solving equation ( 31 ): \begin{bmatrix}\;\widetilde{\bm{y}}^{c}\;\;\\ \widetilde{\bm{\lambda}}\end{bmatrix}=\begin{bmatrix}\bm{K}^{\top}\bm{W}^{-1}\bm{K}&\bm{C}^{\top}\\[4.26773pt] \bm{C}&\bm{0}_{(n_{u}\times 1)}\end{bmatrix}^{-1}\begin{bmatrix}\bm{K}^{\top}\bm{W}^{-1}\widehat{\bm{y}}\\[4.26773pt] \bm{0}_{(n_{u}\times 1)}\end{bmatrix}. As \bm{K}^{\top}\bm{W}^{-1}\bm{K} has full rank, define \bm{W}_{c}=\left(\bm{K}^{\top}\bm{W}^{-1}\bm{K}\right)^{-1} . Then \displaystyle\widetilde{\bm{y}}^{c} \displaystyle=\left[\bm{W}_{c}-\bm{W}_{c}\bm{C}^{\top}\left(\bm{C}\bm{W}_{c}\bm{C}^{\top}\right)^{-1}\bm{C}\bm{W}_{c}\right]\bm{K}^{\top}\bm{W}^{-1}\widehat{\bm{y}} \displaystyle=\left[\bm{I}_{n}-\bm{W}_{c}\bm{C}^{\top}\left(\bm{C}\bm{W}_{c}\bm{C}^{\top}\right)^{-1}\bm{C}\right]\bm{W}_{c}\bm{K}^{\top}\bm{W}^{-1}\widehat{\bm{y}} \displaystyle=\left[\bm{I}_{n}-\bm{W}_{c}\bm{C}^{\top}\left(\bm{C}\bm{W}_{c}\bm{C}^{\top}\right)^{-1}\bm{C}\right]\bm{\Omega}^{\top}\widehat{\bm{y}} \displaystyle=\bm{M}\bm{\Omega}^{\top}\widehat{\bm{y}}=\bm{\Psi}^{\top}\widehat{\bm{y}}, where \bm{\Psi}^{\top}=\bm{M}\bm{\Omega}^{\top} , \bm{\Omega}=\bm{W}^{-1}\bm{K}\bm{W}_{c} , and \bm{M}=\left[\bm{I}_{n}-\bm{W}_{c}\bm{C}^{\top}\left(\bm{C}\bm{W}_{c}\bm{C}^{\top}\right)^{-1}\bm{C}\right] . ∎ Proof of Corollary 1 : Unbiasedness of \widetilde{\bm{y}}^{c} and an important property of its error covariance matrix. The unbiasedness of the p base forecasts \widehat{\bm{y}}^{j} can be expressed in compact form as E\left(\widehat{\bm{y}}\right)=\bm{K}E\left(\bm{y}\right)=\bm{K}\bm{\mu}. Then, noting that \bm{\Omega}^{\top}\bm{K}=\bm{W}_{c}\bm{K}^{\top}\bm{W}^{-1}\bm{K}=\bm{I}_{n} and \bm{C}\bm{\mu}=\bm{0}_{(n_{u}\times 1)} , it is \displaystyle E\left(\widetilde{\bm{y}}^{c}\right) \displaystyle=\bm{M}\bm{\Omega}^{\top}E\left(\widehat{\bm{y}}\right)=\bm{M}\bm{\Omega}^{\top}\bm{K}\bm{\mu}=\bm{M}\bm{\mu} \displaystyle=\bm{\mu}-\bm{W}_{c}\bm{C}^{\top}\left(\bm{C}\bm{W}_{c}\bm{C}\right)^{-1}\bm{C}\bm{\mu}=\bm{\mu}. To compute \widetilde{\bm{W}}_{c} , we start by noting that \widetilde{\bm{y}}^{c}-\bm{y}=\bm{M}\bm{\Omega}^{\top}\widehat{\bm{y}}-\bm{y}=\bm{M}\bm{\Omega}^{\top}\bm{K}\bm{y}+\bm{M}\bm{\Omega}^{\top}\bm{\varepsilon}-\bm{y}=\bm{M}\bm{\Omega}^{\top}\bm{\varepsilon} . The error covariance matrix of \widetilde{\bm{y}}^{c} is thus given by \widetilde{\bm{W}}_{c}=E\left(\bm{M}\bm{\Omega}^{\top}\bm{\varepsilon}\bm{\varepsilon}^{\top}\bm{\Omega}\bm{M}^{\top}\right)=\bm{M}\bm{\Omega}^{\top}\bm{W}\bm{\Omega}\bm{M}^{\top}=\bm{M}\bm{W}_{c}\bm{M}^{\top}, where the last expression is obtained by noting that \bm{\Omega}^{\top}\bm{W}\bm{\Omega}=\bm{W}_{c}\underbrace{\bm{K}^{\top}\bm{W}^{-1}\bm{W}\bm{W}^{-1}\bm{K}}_{\bm{W}_{c}^{-1}}\bm{W}_{c}=\bm{W}_{c}. Proceeding further in the calculations gives: \displaystyle\widetilde{\bm{W}}_{c} \displaystyle=\bm{M}\bm{W}_{c}\bm{M}^{\top} \displaystyle=\bm{W}_{c}-\bm{W}_{c}\bm{C}^{\top}\left(\bm{C}\bm{W}_{c}\bm{C}^{\top}\right)^{-1}\bm{C}\bm{W}_{c}-\bm{W}_{c}\bm{C}^{\top}\left(\bm{C}\bm{W}_{c}\bm{C}^{\top}\right)^{-1}\bm{C}\bm{W}_{c} \displaystyle\phantom{=}\qquad\qquad\qquad\qquad\qquad\qquad\qquad+\bm{W}_{c}\bm{C}^{\top}\left(\bm{C}\bm{W}_{c}\bm{C}^{\top}\right)^{-1}\overbrace{\bm{C}\bm{W}_{c}\bm{C}^{\top}\left(\bm{C}\bm{W}_{c}\bm{C}^{\top}\right)^{-1}}^{\bm{I}_{n_{u}}}\bm{C}\bm{W}_{c} \displaystyle=\bm{W}_{c}-\bm{W}_{c}\bm{C}^{\top}\left(\bm{C}\bm{W}_{c}\bm{C}^{\top}\right)^{-1}\bm{C}\bm{W}_{c}=\bm{M}\bm{W}_{c}. Finally, in order to derive ( 23 ), we prove 16 16 16 This proof extends a result by Sun and Deng, (2004) about the covariance matrix of the multi-task combined forecast vector \widehat{\bm{y}}^{c} in the balanced case. first the inequality \bm{L}_{j}\bm{W}_{c}\bm{L}_{j}^{\top}\preceq\bm{W}_{j}. (32) Let \bm{K}_{j}=\left[\bm{0}_{(n_{1}\times n)}\,\ldots\,\bm{L}_{j}\,\ldots\,\bm{0}_{(n_{p}\times n)}\right]^{\top}\in\{0,1\}^{m\times n} be a matrix whose j -th block place is \bm{L}_{j} and other blocks are (n_{l}\times n) zero matrices, l=1,\ldots,p , with l\neq j . Observing that \bm{K}_{j}\bm{L}_{j}^{\top}=\left[\bm{0}_{(n_{1}\times n_{j})}\,\ldots\,\bm{I}_{n_{j}}\,\ldots\,\bm{0}_{(n_{p}\times n_{j})}\right]^{\top} is a (m\times n_{j}) matrix such that (\bm{L}_{j}\bm{K}_{j}^{\top})(\bm{K}_{j}\bm{L}_{j}^{\top})=\bm{I}_{n_{j}} , and \bm{K}^{\top}\bm{K}_{j}\bm{L}_{j}^{\top}=\bm{L}_{j}^{\top} , it easy to check that \bm{L}_{j}\bm{K}_{j}^{\top}\bm{W}\bm{K}_{j}\bm{L}_{j}^{\top}=\bm{W}_{j} . Therefore, applying Schwarz matrix inequality 17 17 17 Corollary (2.4) in Rao, (2000) (p. 311) says that, for matrices \bm{A} and \bm{B} having the same number of columns, it is: \bm{A}\bm{A}^{\top}\succeq\bm{A}\bm{B}^{\top}\left(\bm{B}\bm{B}^{\top}\right)^{-}\bm{B}\bm{A}^{\top}, (33) where the symbol - denotes the generalized inverse. In this case, it is: \overbrace{\underbrace{\bm{L}_{j}\bm{K}_{j}^{\top}\bm{W}^{\frac{1}{2}}}_{\bm{A}}\underbrace{\bm{W}^{-\frac{1}{2}}\bm{K}}_{\bm{B}^{\top}}}^{\bm{L}_{j}}\overbrace{\left[\underbrace{\bm{K}^{\top}\bm{W}^{-\frac{1}{2}}}_{\bm{B}}\underbrace{\bm{W}^{-\frac{1}{2}}\bm{K}}_{\bm{B}^{\top}}\right]^{-1}}^{\bm{W}_{c}}\overbrace{\underbrace{\bm{K}^{\top}\bm{W}^{-\frac{1}{2}}}_{\bm{B}}\underbrace{\bm{W}^{\frac{1}{2}}\bm{K}_{j}\bm{L}_{j}^{\top}}_{\bm{A}^{\top}}}^{\bm{L}_{j}^{\top}}. , we have: \displaystyle\bm{L}_{j}\bm{W}_{c}\bm{L}_{j}^{\top} \displaystyle=\bm{L}_{j}\left(\bm{K}^{\top}\bm{W}^{-1}\bm{K}\right)^{-1}\bm{L}_{j}^{\top} \displaystyle=\left[\left(\bm{W}^{-\frac{1}{2}}\bm{K}\right)^{\top}\left(\bm{W}^{\frac{1}{2}}\bm{K}_{j}\bm{L}_{j}^{\top}\right)\right]^{\top}\left[\left(\bm{W}^{-\frac{1}{2}}\bm{K}\right)^{\top}\left(\bm{W}^{-\frac{1}{2}}\bm{K}\right)\right]^{-1}\left[\left(\bm{W}^{-\frac{1}{2}}\bm{K}\right)^{\top}\left(\bm{W}^{\frac{1}{2}}\bm{K}_{j}\bm{L}_{j}^{\top}\right)\right] \displaystyle\preceq\left(\bm{W}^{\frac{1}{2}}\bm{K}_{j}\bm{L}_{j}^{\top}\right)^{\top}\left(\bm{W}^{\frac{1}{2}}\bm{K}_{j}\bm{L}_{j}^{\top}\right)=\bm{L}_{j}\bm{K}_{j}^{\top}\bm{W}\bm{K}_{j}\bm{L}_{j}^{\top}=\bm{W}_{j}, (34) which proves \bm{L}_{j}\bm{W}_{c}\bm{L}_{j}^{\top}\preceq\bm{W}_{j} . Consider now the inequality \bm{L}_{j}\widetilde{\bm{W}}_{c}\bm{L}_{j}^{\top}\preceq\bm{L}_{j}\bm{W}_{c}\bm{L}_{j}^{\top} . In Remark 3 we have shown that \widetilde{\bm{y}}^{c} may be interpreted as a single-expert optimal combination reconciled forecast of the multi-task forecast combination vector \widehat{\bm{y}}^{c} . It follows that \widetilde{\bm{W}}_{c}\preceq\bm{W}_{c} ( Panagiotelis et al.,, 2021 ) . In addition, since \widetilde{\bm{W}}_{c}=\bm{M}\bm{W}_{c} , we can write \widetilde{\bm{W}}_{c}=\bm{W}_{c}-\bm{\Delta}, (35) where \bm{\Delta}=\bm{W}_{c}\bm{C}^{\top}\left(\bm{C}\bm{W}_{c}\bm{C}^{\top}\right)^{-1}\bm{C}\bm{W}_{c} is a symmetric positive semidefinite matrix. Since pre-multiplying and post-multiplying a positive semidefinite matrix by the same matrix always gives a positive semidefinite matrix, pre- and post- multiplying expression ( 35 ) by \bm{L}_{j} gives: \bm{L}_{j}\widetilde{\bm{W}}_{c}\bm{L}_{j}^{\top}=\bm{L}_{j}\bm{W}_{c}\bm{L}_{j}^{\top}-\bm{\Delta}_{j}\preceq\bm{L}_{j}\bm{W}_{c}\bm{L}_{j}^{\top}, (36) where \bm{\Delta}_{j}=\bm{L}_{j}\bm{\Delta}\bm{L}_{j}^{\top} is a positive semidefinite matrix. Finally, from ( 32 ) and ( 36 ) it results: \bm{L}_{j}\widetilde{\bm{W}}_{c}\bm{L}_{j}^{\top}\preceq\bm{L}_{j}\bm{W}_{c}\bm{L}_{j}^{\top}\preceq\bm{W}_{j}.\vskip-12.0pt ∎ Appendix B Balanced case: n_{j}=n \forall j and p_{i}=p \forall i In the balanced case, expression ( 12 ) may be grouped as p linear models relating the (unbiased) base forecast \widehat{\bm{y}}^{j} to the target vector \bm{y} : \widehat{\bm{y}}^{j}=\bm{y}+\bm{\varepsilon}^{j},\quad j=1,\ldots,p, (37) where the base forecast errors \bm{\varepsilon}^{j} , j=1,\ldots,p , are (n\times 1) zero-mean random vectors, with (n\times n) covariance matrices \bm{W}_{jl}=E\left[\bm{\varepsilon}^{j}(\bm{\varepsilon}^{l})^{\top}\right] , j,l=1,\ldots p . The p relationships in expression ( 37 ) can be written in compact form as a simplified multivariate multiple linear model ( Seber,, 1984 ) : \displaystyle\widehat{\bm{Y}} \displaystyle=\Big[\;\overbrace{\bm{y}^{\phantom{A}}\,\ldots^{\phantom{A}}\,\bm{y}}^{p\text{ times}}\;\Big]+\bm{E} (38) \displaystyle=\bm{y}\bm{1}_{p}^{\top}+\bm{E}, where \widehat{\bm{Y}} is the ( n\times p ) matrix defined in ( 8 ), containing the base forecasts of the target vector \bm{y} produced by p different experts, and the ( n\times p ) matrix \bm{E}=\left[\bm{\varepsilon}^{1}\;\ldots\;\bm{\varepsilon}^{j}\;\ldots\;\bm{\varepsilon}^{p}\right] contains the base forecast errors \bm{\varepsilon}^{j}=\widehat{\bm{y}}^{j}-\bm{y} , j=1,\ldots,p , across all models and variables. In both matrices \widehat{\bm{Y}} and \bm{E} , each column denotes a single expert j=1,\dots,p , and each row denotes an individual variable i=1,\dots,n . Applying the \text{vec}\left(\cdot\right) operator to expression ( 38 ), noting that \text{vec}\left(\bm{y}\bm{1}_{p}^{\top}\right)=\left(\bm{1}_{p}\otimes\bm{I}_{n}\right)\bm{y} , yields the multiple regression model \widehat{\bm{y}}=\bm{K}\bm{y}+\bm{\varepsilon}, (39) where \widehat{\bm{y}}=\text{vec}\big(\,\widehat{\bm{Y}}\,\big) is a (np\times 1) vector containing the base forecasts stacked by-expert, \bm{K}=\bm{1}_{p}\otimes\bm{I}_{n} is a (np\times n) matrix, and \bm{\varepsilon}=\text{vec}\left(\bm{E}\right) is a ( np\times 1 ) vector of errors with zero average and (np\times np) , known and positive definite covariance matrix \bm{W} : \bm{W}=\begin{bmatrix}[0.9]\bm{W}_{1}&\cdots&\bm{W}_{1j}&\cdots&\bm{W}_{1p}\\ \vdots&\ddots&\vdots&\ddots&\vdots\\ \bm{W}_{j1}&\cdots&\bm{W}_{j}&\cdots&\bm{W}_{jp}\\ \vdots&\ddots&\vdots&\ddots&\vdots\\ \bm{W}_{p1}&\cdots&\bm{W}_{pj}&\cdots&\bm{W}_{p}\end{bmatrix} (40) where \bm{W}_{j}\equiv\bm{W}_{jj} , j=1,\ldots,p . Appendix C A simple numerical example Consider the case n=3 , i.e., \bm{y}=\left[y_{1}\;y_{2}\;y_{3}\right]^{\top} , p_{1}=2,p_{2}=1 and p_{3}=4 , with \widehat{\bm{Y}}=\begin{bmatrix}[0.9]\widehat{y}_{1}^{1}&\bullet&\widehat{y}_{1}^{3}&\bullet\\[5.69046pt] \bullet&\widehat{y}_{2}^{2}&\bullet&\bullet\\[5.69046pt] \widehat{y}_{3}^{1}&\widehat{y}_{3}^{2}&\widehat{y}_{3}^{3}&\widehat{y}_{3}^{4}\\ \end{bmatrix}, where the symbol \bullet denotes an empty entry of \widehat{\bm{Y}} . In this case, it is p=4 and m=7 . The vector containing all the available base forecasts is given by \widehat{\bm{y}}=\begin{bmatrix}[0.9]\widehat{\bm{y}}^{1}\\ \widehat{\bm{y}}^{2}\\ \widehat{\bm{y}}^{3}\\ \widehat{\bm{y}}^{4}\end{bmatrix}=\begin{bmatrix}\widehat{y}_{1}^{1}&\widehat{y}_{3}^{1}&\widehat{y}_{2}^{2}&\widehat{y}_{3}^{2}&\widehat{y}_{1}^{3}&\widehat{y}_{3}^{3}&\widehat{y}_{3}^{4}\end{bmatrix}^{\top}, and the selection matrices \bm{L}_{1}=\bm{L}_{3}=\begin{bmatrix}[0.9]1&0&0\\ 0&0&1\end{bmatrix},\quad\bm{L}_{2}=\begin{bmatrix}[0.9]0&1&0\\ 0&0&1\end{bmatrix},\quad\bm{L}_{4}=\begin{bmatrix}0&0&1\end{bmatrix}, are such that \bm{L}_{1}\bm{y}=\bm{L}_{3}\bm{y}=\begin{bmatrix}[0.9]y_{1}\\ y_{3}\end{bmatrix},\quad\bm{L}_{2}\bm{y}=\begin{bmatrix}[0.9]y_{2}\\ y_{3}\end{bmatrix},\quad\bm{L}_{4}\bm{y}=y_{3}. Finally, it is \bm{L}=\text{Diag}\left(\bm{L}_{1},\bm{L}_{2},\bm{L}_{3},\bm{L}_{4}\right)=\begin{bmatrix}[0.9]1&0&0&0&0&0&0&0&0&0&0&0\\ 0&0&1&0&0&0&0&0&0&0&0&0\\ 0&0&0&0&0&1&0&0&0&0&0&0\\ 0&0&0&0&0&0&0&0&1&0&0&0\\ 0&0&0&0&0&0&0&0&0&1&0&0\\ 0&0&0&0&0&0&0&0&0&0&1&0\\ 0&0&0&0&0&0&0&0&0&0&0&1\\ \end{bmatrix}. Appendix D Equivalent derivations of the optimal coherent linear forecast combination Let us first prove that the solution found with the zero-constrained approach is the same as the one obtained with the structural approach. At this end, consider the model and the linear constraints of the zero-constrained approach according to the ‘by-expert’ representation 18 18 18 An analogous reasoning may be followed if the ‘by-variable’ representation is adopted. : \widehat{\bm{y}}=\bm{K}\bm{y}+\bm{\varepsilon},\text{ s.t. }\bm{C}\bm{y}=\bm{0}. (41) The constraint \bm{C}\bm{y}=\bm{0} is equivalent to 19 19 19 \bm{C}\bm{y}=\bm{0} means \bm{u}-\bm{A}\bm{b}=\bm{0} , i.e., \bm{u}=\bm{A}\bm{b} , while \bm{y}=\bm{S}\bm{b} corresponds to \bm{u}=\bm{A}\bm{b} and \bm{b}=\bm{b} , this last expression being trivially true. \bm{y}=\bm{S}\bm{b} , that can be explicitly incorporated into expression ( 41 ). Since it is \bm{C}\bm{S}=\bm{0}_{(n_{u}\times n_{b})} , this operation results in an unrestricted linear model: \widehat{\bm{y}}=\bm{K}\bm{S}\bm{b}+\bm{\varepsilon},\text{ s.t. }\bm{C}\bm{S}\bm{b}=\bm{0}\quad\Rightarrow\quad\widehat{\bm{y}}=\bm{K}\bm{S}\bm{b}+\bm{\varepsilon}, (42) and the rhs of expression ( 42 ) corresponds to the linear model of the structural approach according to the ‘by-expert’ base forecasts’ representation. Then, computing the MMSE coherent forecast combination of \bm{y} through either model ( 41 ) or ( 42 ) gives the same result, the only difference being the closed-form expressions of \widehat{\bm{y}}^{c} and its error covariance matrix \widetilde{\bm{W}}_{c} according to either approaches (see Table 3 ). This establishes the equivalence between zero-constrained and structural approaches in the optimal coherent linear forecast combination method 20 20 20 In passing, this way of operating also establishes the equivalence between zero-constrained and structural approaches when p=1 , which corresponds to the optimal linear cross-sectional forecast reconciliation, complementing in a sense the result shown by Wickramasuriya et al., (2019) in their online appendix, where this simple step is missing. . D.1 Zero-constrained approach and by-expert base forecasts’ organization See the proofs of Theorem 1 and Corollary 1 in A . D.2 Zero-constrained approach and by-variable base forecasts’ organization Pre-multiplication of model ( 15 ) by the permutation matrix \bm{P}\in\{0,1\}^{m\times m} (see section 2.2 ) gives the equivalent, re-parameterized model according to a by-variable data organization: \widehat{\bm{y}}_{\text{bv}}=\bm{J}\bm{y}+\bm{\varepsilon}_{\text{bv}}, (43) where \widehat{\bm{y}}_{\text{bv}}=\bm{P}\widehat{\bm{y}} , \bm{\varepsilon}_{\text{bv}}=\bm{P}\bm{\varepsilon} , \bm{J}=\bm{P}\bm{K}=\begin{bmatrix}[0.7]\bm{1}_{p_{1}}&\cdots&\bm{0}_{(p_{1}\times 1)}&\cdots&\bm{0}_{(p_{1}\times 1)}\\ \vdots&\ddots&\vdots&\ddots&\vdots\\ \bm{0}_{(p_{i}\times 1)}&\cdots&\bm{1}_{p_{i}}&\cdots&\bm{0}_{(p_{i}\times 1)}\\ \vdots&\ddots&\vdots&\ddots&\vdots\\ \bm{0}_{(p_{n}\times 1)}&\cdots&\bm{0}_{p_{n}\times 1}&\cdots&\bm{1}_{p_{n}}\end{bmatrix}\in\{0,1\}^{m\times n}, (44) and \bm{\varepsilon}_{\text{bv}}\in\mathbb{R}^{m} is a zero-mean random vector, with covariance matrix \bm{\Sigma}=E\left(\bm{\varepsilon}_{\text{bv}}\bm{\varepsilon}_{\text{bv}}^{\top}\right)=\bm{P}\bm{W}\bm{P}^{\top} . In this case, the solution to the linearly constrained quadratic program \widetilde{\bm{y}}^{c}=\argmin_{\bm{y}}\left(\widehat{\bm{y}}_{\text{bv}}-\bm{J}\bm{y}\right)^{\top}\bm{\Sigma}^{-1}\left(\widehat{\bm{y}}_{\text{bv}}-\bm{J}\bm{y}\right)\quad\text{s.t. }\bm{C}\bm{y}=\bm{0}_{(n_{u}\times 1)} (45) can be obtained as for the case of by-expert data organization (see A ): \widetilde{\bm{y}}^{c}=\bm{\Phi}^{\top}\widehat{\bm{y}}_{\text{bv}}=\bm{M}\bm{\Gamma}^{\top}\widehat{\bm{y}}_{\text{bv}}, (46) with weight matrix \Phi^{\top}=\bm{M}\bm{\Gamma}^{\top}\in\mathbb{R}^{n\times m} , where \displaystyle\bm{M} \displaystyle=\left[\bm{I}_{n}-\bm{\Sigma}_{c}\bm{C}^{\top}\left(\bm{C}\bm{\Sigma}_{c}\bm{C}^{\top}\right)^{-1}\bm{C}\right], (47) \displaystyle\bm{\Gamma} \displaystyle=\bm{\Sigma}^{-1}\bm{J}\bm{\Sigma}_{c}, (48) \displaystyle\bm{\Sigma}_{c} \displaystyle=\left(\bm{J}^{\top}\bm{\Sigma}^{-1}\bm{J}\right)^{-1}. (49) In order to establish the equivalence between expressions ( 46 ) and ( 18 ), it will suffice to show that \bm{W}_{c}=\bm{\Sigma}_{c} . For, noting that \bm{K}=\bm{P}^{\top}\bm{J} and \bm{W}=\bm{P}^{\top}\bm{\Sigma}\bm{P} , we have: \bm{W}_{c}=\left(\bm{K}^{\top}\bm{W}^{-1}\bm{K}\right)^{-1}=\left(\bm{J}^{\top}\bm{P}\bm{P}^{\top}\bm{\Sigma}^{-1}\bm{P}\bm{P}^{\top}\bm{J}\right)^{-1}=\left(\bm{J}^{\top}\bm{\Sigma}^{-1}\bm{J}\right)^{-1}=\bm{\Sigma}_{c}. It follows that: • \left[\bm{I}_{n}-\bm{W}_{c}\bm{C}^{\top}\left(\bm{C}\bm{W}_{c}\bm{C}^{\top}\right)^{-1}\bm{C}\right]=\left[\bm{I}_{n}-\bm{\Sigma}_{c}\bm{C}^{\top}\left(\bm{C}\bm{\Sigma}_{c}\bm{C}^{\top}\right)^{-1}\bm{C}\right]=\bm{M} ; • \bm{\Omega}=\bm{P}^{\top}\bm{\Gamma} and \bm{\Gamma}=\bm{P}\bm{\Omega} ; • \widetilde{\bm{y}}^{c}=\bm{M}\bm{\Omega}^{\top}\widehat{\bm{y}}=\bm{M}\bm{\Gamma}^{\top}\widehat{\bm{y}}_{\text{bv}} . In addition, denoting \bm{\Gamma}=\begin{bmatrix}\bm{\Gamma}_{1}\;\cdots\;\bm{\Gamma}_{i}\;\cdots\;\bm{\Gamma}_{n}\end{bmatrix}^{\top} and \bm{\Phi}=\begin{bmatrix}\bm{\Phi}_{1}\;\cdots\;\bm{\Phi}_{i}\;\cdots\;\bm{\Phi}_{n}\end{bmatrix}^{\top} , we can express the MMSE multi-task combination forecast \widehat{\bm{y}}^{c} and the MMSE multi-task coherent combination forecast \widetilde{\bm{y}}^{c} as, respectively, \widehat{\bm{y}}^{c}=\bm{\Gamma}^{\top}\widehat{\bm{y}}_{\text{bv}}=\displaystyle\sum_{i=1}^{n}\bm{\Gamma}_{i}\widehat{\bm{y}}_{i}\quad\text{ and }\quad\widetilde{\bm{y}}^{c}=\bm{\Phi}^{\top}\widehat{\bm{y}}_{\text{bv}}=\displaystyle\sum_{i=1}^{n}\bm{\Phi}_{i}\widehat{\bm{y}}_{i}, with \bm{\Phi}_{i}=\bm{M}\bm{\Gamma}_{i} , i=1,\ldots,n . D.3 Structural approach and by-expert base forecasts’ organization Deriving the MMSE multi-task coherent combination forecast according to the structural approach can be seen as a multi-task extension of the optimal combination forecast reconciliation approach proposed by Athanasopoulos et al., (2009) and Hyndman et al., (2011) . This approach, originally developed to reconcile the incoherent base forecasts of a genuine hierarchical/grouped time series, has been extended by Girolimetto and Di Fonzo, 2024c () to deal with also general linearly constrained multiple series not having a natural hierarchical/grouped structure. In particular, Girolimetto and Di Fonzo, 2024c () have shown how a general linearly constrained time series can be represented in a structural-like form, as in expression ( 2 ), i.e., \bm{y}=\bm{S}\bm{b} . Building on this, in the following we derive the same results as Theorem 1 and Corollary 1 . Let us consider the p linear models \widehat{\bm{y}}^{j}=\bm{L}_{j}\bm{S}\bm{b}+\bm{\varepsilon}^{j},\quad j=1,\ldots,p, (50) where \bm{L}_{j} is the selection matrix defined in Section 3.1 . Expression ( 50 ) can be written in compact form as \widehat{\bm{y}}=\bm{K}\bm{S}\bm{b}+\bm{\varepsilon}, (51) with E\left(\bm{\varepsilon}\bm{\varepsilon}^{\top}\right)=\bm{W} . Coherent multi-task forecast combination can be achieved through model ( 51 ), by extending to the case of p\geq 2 vectors of base forecasts the minimum trace (MinT) solution proposed by Wickramasuriya et al., (2019) as for cross-sectional forecast reconciliation. This result is shown by the following Theorem. 2 Optimal linear coherent forecast combination \widetilde{\bm{y}}^{c} (structural approach) Let \widehat{y}_{i}^{j} , 1\leq n_{j}\leq n , 1\leq j\leq p_{i} , be the unbiased forecasts of the scalar variable y_{i} , which is part of an n -dimensional target forecast vector \bm{y} , and denote \widehat{\bm{y}}^{j}\in\mathbb{R}^{n_{j}} the vector of the base forecasts produced by the j -th expert. Let the zero-mean base forecast errors be \bm{\varepsilon}^{j}=\widehat{\bm{y}}^{j}-\bm{y} , j=1,\ldots,p , and assume that \bm{\varepsilon}^{j} and \bm{\varepsilon}^{l} ( j\neq l ) are correlated, with variance and cross-covariance matrices denoted by \bm{W}_{j}\in\mathbb{R}^{n_{j}\times n_{j}} and \bm{W}_{jl}\in\mathbb{R}^{n_{j}\times n_{l}} , respectively. Denoting \bm{W}\in\mathbb{R}^{m\times m} the p.d. error covariance matrix as in ( 16 ), the MMSE coherent linear forecast combination is given by: \widetilde{\bm{y}}^{c}=\bm{S}\bm{G}\widehat{\bm{y}}, (52) where \bm{G}=\left(\bm{S}^{\top}\bm{W}^{-1}_{c}\bm{S}\right)^{-1}\bm{S}^{\top}\bm{K}^{\top}\bm{W}^{-1}. (53) Proof. From the proof of Corollary 1 , we know that the unbiasedness of the base forecasts may be expressed in compact form as E\left(\widehat{\bm{y}}\right)=\bm{K}E(\bm{y}) . In addition, it is worth noting that E(\bm{y})=\bm{S}E(\bm{b}) , and thus E\left(\widetilde{\bm{y}}^{c}\right)=\bm{S}\bm{G}E\left(\widehat{\bm{y}}\right)=\bm{S}\bm{G}\bm{K}E(\bm{y})=\bm{S}\bm{G}\bm{K}\bm{S}E(\bm{b}) . Then, for \widetilde{\bm{y}}^{c} to be unbiased, i.e., E\left(\widetilde{\bm{y}}^{c}\right)=E(\bm{y})=\bm{S}E(\bm{b}) , it must be \bm{S}\bm{G}\bm{K}\bm{S}=\bm{S} , that is: \bm{G}\bm{K}\bm{S}=\bm{I}_{n_{b}}. (54) The (n\times 1) vector of the coherent combined forecast error \widetilde{\bm{\varepsilon}}=\widetilde{\bm{y}}^{c}-\bm{y} , may be expressed as \widetilde{\bm{\varepsilon}}=\bm{S}\bm{G}\widehat{\bm{y}}-\bm{y}=\bm{S}\bm{G}\left(\widehat{\bm{y}}-\bm{K}\bm{y}\right). Noting that \bm{W}=E\big[\left(\widehat{\bm{y}}-\bm{K}\bm{y}\right)\;\left(\widehat{\bm{y}}-\bm{K}\bm{y}\right)^{\top}\big] , the covariance matrix of \widetilde{\bm{y}}^{c} is given by \widetilde{\bm{W}}_{c}=E\big[\widetilde{\bm{\varepsilon}}\;\widetilde{\bm{\varepsilon}}^{\top}\big]=\bm{S}\bm{G}\bm{W}\bm{G}^{\top}\bm{S}^{\top} . We want to find the optimal combination weight matrix \bm{G} under restriction ( 54 ) that minimizes the trace of \widetilde{\bm{W}}_{c} , i.e., \text{tr}\left(\bm{S}\bm{G}\bm{W}\bm{G}^{\top}\bm{S}^{\top}\right) . At this end, consider the lagrangean function \mathcal{L}\left(\bm{G},\bm{\Lambda}\right)=\text{tr}\left(\bm{S}\bm{G}\bm{W}\bm{G}^{\top}\bm{S}^{\top}\right)-2\text{tr}\left[\bm{\Lambda}^{\top}\left(\bm{G}\bm{K}\bm{S}-\bm{I}_{n_{b}}\right)\right], where \bm{\Lambda}\in\mathbb{R}^{n_{b}\times n_{b}} is a matrix of Lagrange multipliers. Solving the first-order conditions system \displaystyle\bm{W}\bm{G}^{\top}\bm{S}^{\top}\bm{S}-\bm{K}\bm{S}\bm{\Lambda} \displaystyle=\bm{0}_{m\times n_{b}} \displaystyle\bm{G}\bm{S}-\bm{I}_{n_{b}} \displaystyle=\bm{0}_{(n_{b}\times n_{b})} results in the following expressions: \displaystyle\bm{K}\bm{S}\bm{\Lambda} \displaystyle=\bm{W}\bm{G}^{\top}\bm{S}^{\top}\bm{S} \displaystyle\bm{W}^{-1}\bm{K}\bm{S}\bm{\Lambda} \displaystyle=\bm{G}^{\top}\bm{S}^{\top}\bm{S} \displaystyle\mbox{{\footnotesize pre-multiplying by} }\bm{W}^{-1}\mbox{{\footnotesize on both sides}} \displaystyle\bm{S}^{\top}\bm{K}^{\top}\bm{W}^{-1}\bm{K}\bm{S}\bm{\Lambda} \displaystyle=\bm{S}^{\top}\bm{K}^{\top}\bm{G}^{\top}\bm{S}^{\top}\bm{S} \displaystyle\mbox{{\footnotesize pre-multiplying by} }\bm{S}^{\top}\bm{K}^{\top}\mbox{ {\footnotesize on both sides}} \displaystyle\bm{S}^{\top}\bm{W}^{-1}_{c}\bm{S}\bm{\Lambda} \displaystyle=\bm{S}^{\top}\bm{K}^{\top}\bm{G}^{\top}\bm{S}^{\top}\bm{S} \displaystyle\bm{W}^{-1}_{c}=\bm{K}^{\top}\bm{W}^{-1}\bm{K} \displaystyle\bm{S}^{\top}\bm{W}^{-1}_{c}\bm{S}\bm{\Lambda} \displaystyle=\bm{S}^{\top}\bm{S} \displaystyle\mbox{{\footnotesize according to (\ref{eq:unbiasedness_condition}),} }\bm{S}^{\top}\bm{K}^{\top}\bm{G}^{\top}=\bm{I}_{n_{b}} \displaystyle\bm{\Lambda} \displaystyle=\left(\bm{S}^{\top}\bm{W}^{-1}_{c}\bm{S}\right)^{-1}\bm{S}^{\top}\bm{S}. Then, \displaystyle\bm{W}\bm{G}^{\top}\bm{S}^{\top}\bm{S}-\bm{K}\bm{S}\bm{\Lambda} \displaystyle=\bm{0} \displaystyle\bm{W}\bm{G}^{\top}\bm{S}^{\top}\bm{S} \displaystyle=\bm{K}\bm{S}\bm{\Lambda} \displaystyle\bm{W}\bm{G}^{\top}\bm{S}^{\top}\bm{S} \displaystyle=\bm{K}\bm{S}\left(\bm{S}^{\top}\bm{W}^{-1}_{c}\bm{S}\right)^{-1}\bm{S}^{\top}\bm{S} \displaystyle\bm{W}\bm{G}^{\top} \displaystyle=\bm{K}\bm{S}\left(\bm{S}^{\top}\bm{W}^{-1}_{c}\bm{S}\right)^{-1} \displaystyle\quad\mbox{{\footnotesize post-multiplying by}}\left(\bm{S}^{\top}\bm{S}\right)^{-1}\mbox{{\footnotesize on both sides}} \displaystyle\bm{G}^{\top} \displaystyle=\bm{W}^{-1}\bm{K}\bm{S}\left(\bm{S}^{\top}\bm{W}^{-1}_{c}\bm{S}\right)^{-1} \displaystyle\quad\mbox{{\footnotesize pre-multiplying by} }\bm{W}^{-1}\mbox{{\footnotesize on both sides}} \displaystyle\bm{G} \displaystyle=\left(\bm{S}^{\top}\bm{W}^{-1}_{c}\bm{S}\right)^{-1}\bm{S}^{\top}\bm{K}^{\top}\bm{W}^{-1}. ∎ 6 Since \bm{C}\bm{S}=\bm{0}_{(n_{u}\times n_{b})} , the combined forecast vector ( 52 ) is also coherent, i.e., \bm{C}\widehat{\bm{y}}^{c}=\bm{0}_{(n_{u}\times 1)} . The unbiasedness property may be checked by noting that E\left(\bm{S}\bm{G}\widehat{\bm{y}}\right)=\bm{S}\bm{G}E\left(\widehat{\bm{y}}\right)=\bm{S}\bm{G}\bm{K}E(\bm{y}) . Then, E\left(\bm{S}\bm{G}\widehat{\bm{y}}\right)=\bm{S}\overbrace{\bm{G}\bm{K}\bm{S}}^{\bm{I}_{n_{b}}}E(\bm{b})=\bm{S}E(\bm{b})=E(\bm{y}). 7 A straightforward interpretation of expressions ( 52 ) and ( 53 ) is obtained by considering the GLS estimator of \bm{b} in model ( 51 ): \widetilde{\bm{b}}^{c}=\left(\bm{S}^{\top}\bm{W}^{-1}_{c}\bm{S}\right)^{-1}\bm{S}^{\top}\bm{K}^{\top}\bm{W}^{-1}\widehat{\bm{y}}=\bm{G}\widehat{\bm{y}}, where \bm{G} is the (n_{b}\times m) optimal combination weight matrix mapping all the m available forecasts into the n_{b} reconciled forecasts of the free (bottom) variables of series \bm{y}_{t} . This result is then used to compute the complete vector of coherent combined forecasts according to the structural representation linking the target vectors \bm{b} and \bm{y} , that is, \widetilde{\bm{y}}^{c}=\bm{S}\widetilde{\bm{b}}^{c}=\bm{S}\bm{G}\widehat{\bm{y}} . In addition, since E\left[\left(\widetilde{\bm{b}}^{c}-\bm{b}\right)\left(\widetilde{\bm{b}}^{c}-\bm{b}\right)^{\top}\right]=\left(\bm{S}^{\top}\bm{W}^{-1}_{c}\bm{S}\right)^{-1} , it follows E\left[\left(\widetilde{\bm{y}}^{c}-\bm{y}\right)\left(\widetilde{\bm{y}}^{c}-\bm{y}\right)^{\top}\right]=\bm{S}\left(\bm{S}^{\top}\bm{W}^{-1}_{c}\bm{S}\right)^{-1}\bm{S}^{\top}=\widetilde{\bm{W}}_{c} (see Corollary 2 ). 2 Property of the error covariance matrix (structural approach) The error covariance matrix of \widetilde{\bm{y}}^{c} in expression ( 52 ) is given by \widetilde{\bm{W}}_{c}=\bm{S}\left(\bm{S}^{\top}\bm{W}^{-1}_{c}\bm{S}\right)^{-1}\bm{S}^{\top}. (55) Furthermore, it is \bm{L}_{j}\widetilde{\bm{W}}_{c}\bm{L}_{j}^{\top}\preceq\bm{W}_{j},\quad j=1,\ldots,p. Proof. In the proof of Theorem 2 it was noted that the error covariance matrix of \widetilde{\bm{y}}^{c} is equal to \widetilde{\bm{W}}_{c}=\bm{S}\bm{G}\bm{W}\bm{G}^{\top}\bm{S}^{\top} . Replacing \bm{G} with expression ( 53 ) gives: \displaystyle\widetilde{\bm{W}}_{c} \displaystyle=\bm{S}\left(\bm{S}^{\top}\bm{W}^{-1}_{c}\bm{S}\right)^{-1}\underbrace{\bm{S}^{\top}\bm{K}^{\top}\bm{W}^{-1}\bm{W}\bm{W}^{-1}\bm{K}\bm{S}\left(\bm{S}^{\top}\bm{W}^{-1}_{c}\bm{S}\right)^{-1}}_{\bm{I}_{n_{b}}}\bm{S}^{\top} \displaystyle=\bm{S}\left(\bm{S}^{\top}\bm{W}^{-1}_{c}\bm{S}\right)^{-1}\bm{S}^{\top}. (56) As for the derivation of \bm{L}_{j}\widetilde{\bm{W}}_{c}\bm{L}_{j}^{\top}\preceq\bm{W}_{j} , j=1,\ldots,p , by applying Schwarz matrix inequality, we have 21 21 21 It is worth noting that \left(\bm{W}^{-1/2}\bm{K}\bm{S}\right)^{\top}\left(\bm{W}^{1/2}\bm{K}_{j}\right)=\bm{S}^{\top}\bm{K}^{\top}\bm{K}_{j}=\bm{S}^{\top}\bm{L}_{j}^{\top} . , 22 22 22 According to footnote 17 , in this case it is: \overbrace{\underbrace{\bm{K}_{j}^{\top}\bm{W}^{1/2}}_{\bm{A}}\underbrace{\bm{W}^{-1/2}\bm{K}\bm{S}}_{\bm{B}^{\top}}}^{\bm{S}}\overbrace{\Bigg[\underbrace{\bm{S}^{\top}\bm{K}^{\top}\bm{W}^{-1/2}}_{\bm{B}}\underbrace{\bm{W}^{-1/2}\bm{K}\bm{S}}_{\bm{B}^{\top}}\Bigg]^{-1}}^{\left[\bm{S}^{\top}\bm{K}^{\top}\bm{W}^{-1}\bm{K}\bm{S}\right]^{-1}}\overbrace{\underbrace{\bm{S}^{\top}\bm{K}^{\top}\bm{W}^{-1/2}}_{\bm{B}}\underbrace{\bm{W}^{1/2}\bm{K}_{j}}_{\bm{A}^{\top}}}^{\bm{S}^{\top}}. \displaystyle\bm{L}_{j}\widetilde{\bm{W}}_{c}\bm{L}_{j}^{\top} \displaystyle=\bm{L}_{j}\bm{S}\left(\bm{S}^{\top}\bm{W}^{-1}_{c}\bm{S}\right)^{-1}\bm{S}^{\top}\bm{L}_{j}^{\top}=\bm{L}_{j}\bm{S}\left(\bm{S}^{\top}\bm{K}^{\top}\bm{W}^{-1}\bm{K}\bm{S}\right)^{-1}\bm{S}^{\top}\bm{L}_{j}^{\top} \displaystyle=\left[\left(\bm{W}^{-1/2}\bm{K}\bm{S}\right)^{\top}\left(\bm{W}^{1/2}\bm{K}_{j}\bm{L}_{j}^{\top}\right)\right]^{\top}\left[\left(\bm{W}^{-1/2}\bm{K}\bm{S}\right)^{\top}\left(\bm{W}^{-1/2}\bm{K}\bm{S}\right)\right]^{-1} \displaystyle\qquad\qquad\qquad\qquad\qquad\qquad\qquad\qquad\qquad\qquad\left[\left(\bm{W}^{-1/2}\bm{K}\bm{S}\right)^{\top}\left(\bm{W}^{1/2}\bm{K}_{j}\bm{L}_{j}^{\top}\right)\right] \displaystyle\preceq\left(\bm{W}^{1/2}\bm{K}_{j}\bm{L}_{j}^{\top}\right)^{\top}\left(\bm{W}^{1/2}\bm{K}_{j}\bm{L}_{j}^{\top}\right)=\bm{W}_{j}, (57) where \bm{K}_{j}=\left[\bm{0}\ldots\bm{L}_{j}\ldots\bm{0}\right]^{\top} is a (m\times n) matrix whose j -th block place is the selection matrix \bm{L}_{j} , and other blocks are (n_{l}\times n) zero matrices, l=1,\ldots,p,\;l\neq j . ∎ D.4 Structural approach and by-variable base forecasts’ organization Pre-multiplication of model ( 51 ) by the permutation matrix \bm{P} gives the equivalent, re-parameterized structural model according to a by-variable data organization: \widehat{\bm{y}}_{\text{bv}}=\bm{J}\bm{S}\bm{b}+\bm{\varepsilon}_{\text{bv}}, (58) where \bm{J}=\bm{P}\bm{K}\in\{0,1\}^{m\times n} is defined by ( 44 ). In this case, the MMSE coherent linear forecast combination using the by-variable base forecasts’ organization is given by: \widetilde{\bm{y}}^{c}=\bm{S}\bm{G}_{\text{bv}}\widehat{\bm{y}}_{\text{bv}}, (59) where \bm{G}_{\text{bv}}=\left(\bm{S}^{\top}\bm{J}^{\top}\bm{\Sigma}^{-1}\bm{J}\bm{S}\right)^{-1}\bm{S}^{\top}\bm{J}^{\top}\bm{\Sigma}^{-1} . Since \bm{J}^{\top}\bm{\Sigma}^{-1}\bm{J}=\bm{K}^{\top}\bm{P}^{\top}\bm{\Sigma}^{-1}\bm{P}=\bm{K}^{\top}\bm{W}^{-1}\bm{K}=\bm{W}_{c}^{-1} , it is \bm{G}_{\text{bv}}=\left(\bm{S}^{\top}\bm{W}^{-1}_{c}\bm{S}\right)^{-1}\bm{S}^{\top}\bm{K}^{\top}\bm{W}^{-1}=\bm{G} , and \left(\bm{S}^{\top}\bm{W}^{-1}_{c}\bm{S}\right)=\left(\bm{S}^{\top}\bm{J}^{\top}\bm{P}\bm{P}^{\top}\bm{\Sigma}^{-1}\bm{P}\bm{P}^{\top}\bm{J}\bm{S}\right)=\left(\bm{S}^{\top}\bm{\Sigma}^{-1}_{c}\bm{S}\right) . In addition, \bm{G}_{\text{bv}}=\bm{G}\bm{P}^{\top} , \bm{G}=\bm{G}_{\text{bv}}\bm{P} , and \widetilde{\bm{y}}_{c}=\bm{S}\bm{G}\widehat{\bm{y}}=\bm{S}\bm{G}_{\text{bv}}\widehat{\bm{y}}_{\text{bv}} . Appendix E Simulation: extended figures and tables The forecast accuracy is evaluated also using the Average Relative Mean Squared ( AvgRelMSE ) as AvgRelMSE^{app}=\left(\prod_{s=1}^{500}\prod_{i=1}^{n}\frac{MSE_{s,i}^{app}}{MSE_{s,i}^{\text{ew}}}\right)^{\frac{1}{500n}}\;\text{with}\;\;MSE_{s,i}^{app}=\displaystyle\frac{1}{100}\sum_{q=1}^{100}\left(y_{i,s,q}-\overline{y}_{i,s,q}^{\,app}\right)^{2}, where i=1,...,n denotes the variable, app is the approach used, y_{i,s,q} is the observed value and \overline{y}_{i,s,q}^{\,app} is the forecast value using the app approach (coherent or incoherent, Table 9 ). Table 9 : Summary of forecasting approaches used in the simulation and the forecasting experiment on the Australian daily electricity generation time series. For single-model reconciliation and coherent combination sequential approaches, the shrunk in-sample MSE matrix is used for the reconciliation. Approach & description Approach & description Base (incoherent forecasts) base ∗ Best base forecasts (simulations) tbats Exponential smoothing state space model with Box-Cox transformation, ARMA errors, Trend and Seasonal components (application) Single model reconciliation base {}^{\ast}_{\text{shr}} Cross-sectional reconciliation of the best base forecasts (simulations) base {}_{\text{shr}} Best cross-sectional reconciliation of base forecasts (simulations) tbats {}_{\text{shr}} Cross-sectional reconciliation of tbats base (application) Single-task combination (incoherent forecasts) ew Equal-weighted average ow {}_{\text{var}} Weighted average, optimal weights inversely proportional to the MSE’s ow {}_{\text{cov}} Weighted average, optimal weights in the unit simplex ( Conflitti et al.,, 2015 ) computed using the MSE matrix Coherent combination src Sequential reconciliation-then-combination with equal weights scr {}_{\text{ew}} Sequential ew combination-then-reconciliation scr {}_{\text{var}} Sequential ow {}_{\text{var}} combination-then- reconciliation scr {}_{\text{cov}} Sequential ow {}_{\text{cov}} combination-then- reconciliation occ {}_{\text{bv}} Optimal coherent combination using a by-variable block-diagonal shrunk error covariance matrix occ {}_{\text{shr}} Optimal coherent combination using a full shrunk error covariance matrix occ {}_{\text{wls}} Optimal coherent combination using a diagonal error covariance matrix occ {}_{\text{be}} Optimal coherent combination using a by-expert block-diagonal shrunk error covariance matrix Table 10 : AvgRelMSE for the simulation experiment. Benchmark approach: ew. Bold entries identify the best performing approaches, italic entries identify the second best and red color denotes forecasts worse than the benchmark. Balanced panel of forecasts Unbalanced panel of forecasts Sett. p N base ∗ base {}^{\ast}_{\text{shr}} base {}_{\text{shr}} ew ow {}_{\text{var}} ow {}_{\text{cov}} src scr {}_{\text{ew}} scr {}_{\text{var}} scr {}_{\text{cov}} occ {}_{\text{be}} ew ow {}_{\text{var}} ow {}_{\text{cov}} scr {}_{\text{ew}} scr {}_{\text{var}} scr {}_{\text{cov}} occ {}_{\text{be}} 1 4 50 1.712 1.130 1.120 1.000 1.004 1.056 0.847 0.901 0.905 0.939 0.818 1.000 1.063 3.884 0.811 1.108 1.272 0.792 100 1.708 1.078 1.074 1.000 1.001 1.029 0.837 0.895 0.896 0.913 0.801 1.000 1.046 2.532 0.811 1.060 1.246 0.779 200 1.702 1.052 1.049 1.000 1.000 1.013 0.832 0.888 0.888 0.895 0.791 1.000 1.020 1.638 0.810 1.001 1.190 0.771 10 50 2.010 1.327 1.315 1.000 1.002 1.108 0.925 0.960 0.963 1.040 0.908 1.000 1.494 34.050 0.885 1.630 2.414 0.883 100 2.007 1.267 1.262 1.000 1.001 1.068 0.920 0.958 0.959 1.005 0.899 1.000 1.480 28.860 0.882 1.563 2.393 0.861 200 1.996 1.236 1.232 1.000 1.000 1.039 0.918 0.953 0.953 0.979 0.895 1.000 1.404 18.107 0.880 1.416 2.302 0.849 20 50 2.136 1.411 1.398 1.000 1.001 1.129 0.958 0.980 0.982 1.081 0.949 1.000 1.836 84.355 0.946 2.045 3.705 0.966 100 2.139 1.351 1.345 1.000 1.001 1.090 0.956 0.980 0.981 1.046 0.945 1.000 1.787 89.608 0.946 1.922 3.820 0.937 200 2.118 1.314 1.309 1.000 1.000 1.055 0.955 0.977 0.977 1.015 0.942 1.000 1.662 69.338 0.946 1.699 3.380 0.918 2 4 50 1.502 1.111 1.108 1.000 1.003 1.054 0.901 0.936 0.939 0.973 0.888 1.000 1.042 3.352 0.859 1.061 1.164 0.842 100 1.503 1.077 1.074 1.000 1.001 1.029 0.893 0.933 0.933 0.951 0.876 1.000 1.036 2.474 0.860 1.041 1.163 0.833 200 1.500 1.052 1.051 1.000 1.000 1.013 0.888 0.928 0.927 0.935 0.868 1.000 1.025 1.690 0.858 1.013 1.140 0.826 10 50 1.674 1.238 1.235 1.000 1.001 1.092 0.955 0.975 0.977 1.044 0.949 1.000 1.313 22.856 0.925 1.372 1.840 0.920 100 1.675 1.200 1.195 1.000 1.000 1.060 0.953 0.976 0.976 1.018 0.944 1.000 1.307 19.212 0.924 1.344 1.822 0.904 200 1.670 1.171 1.170 1.000 1.000 1.036 0.950 0.973 0.973 0.997 0.940 1.000 1.276 9.649 0.922 1.282 1.647 0.895 20 50 1.739 1.287 1.281 1.000 1.001 1.103 0.976 0.987 0.988 1.065 0.973 1.000 1.506 52.634 0.970 1.590 2.555 0.981 100 1.740 1.247 1.242 1.000 1.000 1.074 0.976 0.988 0.988 1.042 0.971 1.000 1.490 55.401 0.971 1.549 2.608 0.962 200 1.736 1.217 1.216 1.000 1.000 1.046 0.974 0.988 0.988 1.019 0.968 1.000 1.438 48.233 0.973 1.456 2.559 0.949 3 4 50 1.240 1.073 1.071 1.000 1.001 1.043 0.957 0.975 0.976 1.006 0.954 1.000 1.738 5.907 0.936 1.881 2.137 0.920 100 1.241 1.052 1.052 1.000 1.000 1.027 0.953 0.972 0.972 0.990 0.948 1.000 1.742 5.729 0.937 1.831 2.192 0.916 200 1.242 1.036 1.035 1.000 1.000 1.015 0.948 0.968 0.969 0.979 0.943 1.000 1.712 5.168 0.932 1.745 2.243 0.912 10 50 1.301 1.124 1.124 1.000 1.000 1.061 0.983 0.990 0.990 1.037 0.981 1.000 2.125 25.490 0.974 2.301 2.850 0.966 100 1.305 1.105 1.102 1.000 1.000 1.044 0.980 0.990 0.990 1.022 0.978 1.000 2.121 21.027 0.972 2.237 2.747 0.956 200 1.305 1.092 1.087 1.000 1.000 1.028 0.978 0.989 0.989 1.009 0.975 1.000 2.051 10.766 0.975 2.101 2.349 0.952 20 50 1.324 1.144 1.143 1.000 1.000 1.064 0.991 0.995 0.995 1.044 0.990 1.000 2.324 49.384 0.994 2.526 3.512 0.993 100 1.327 1.124 1.121 1.000 1.000 1.048 0.990 0.994 0.994 1.031 0.988 1.000 2.280 55.099 0.995 2.425 3.561 0.983 200 1.328 1.112 1.106 1.000 1.000 1.035 0.989 0.995 0.995 1.021 0.987 1.000 2.181 48.296 0.997 2.245 3.429 0.979 4 4 50 1.546 1.152 1.152 1.000 0.981 1.001 0.901 0.937 0.915 0.902 0.849 1.000 0.994 2.993 0.847 1.010 1.102 0.822 100 1.542 1.114 1.114 1.000 0.978 0.977 0.895 0.933 0.909 0.877 0.836 1.000 0.995 2.329 0.847 0.999 1.098 0.813 200 1.543 1.087 1.087 1.000 0.977 0.965 0.889 0.928 0.904 0.864 0.826 1.000 0.983 1.474 0.846 0.971 1.062 0.806 10 50 1.734 1.287 1.287 1.000 0.971 0.975 0.956 0.976 0.947 0.913 0.899 1.000 1.272 22.092 0.910 1.331 1.751 0.894 100 1.730 1.253 1.253 1.000 0.970 0.939 0.953 0.975 0.945 0.878 0.889 1.000 1.264 17.674 0.911 1.298 1.731 0.877 200 1.731 1.221 1.221 1.000 0.970 0.919 0.951 0.974 0.943 0.857 0.882 1.000 1.239 9.583 0.909 1.248 1.599 0.868 20 50 1.785 1.325 1.325 1.000 0.967 0.948 0.978 0.988 0.954 0.900 0.918 1.000 1.475 54.937 0.963 1.561 2.493 0.951 100 1.789 1.293 1.293 1.000 0.967 0.906 0.976 0.988 0.954 0.862 0.910 1.000 1.453 52.381 0.962 1.510 2.580 0.930 200 1.778 1.261 1.261 1.000 0.966 0.877 0.974 0.988 0.954 0.832 0.903 1.000 1.406 43.904 0.961 1.422 2.324 0.916 5 4 50 1.539 1.099 1.099 1.000 0.978 1.019 0.881 0.920 0.911 0.939 0.857 1.000 0.970 3.043 0.833 0.987 1.081 0.806 100 1.547 1.077 1.069 1.000 0.977 0.996 0.871 0.916 0.905 0.916 0.844 1.000 0.963 2.197 0.833 0.968 1.074 0.795 200 1.545 1.049 1.046 1.000 0.976 0.983 0.867 0.910 0.900 0.904 0.838 1.000 0.958 1.509 0.832 0.946 1.055 0.789 10 50 1.750 1.260 1.260 1.000 0.988 1.075 0.946 0.970 0.963 1.025 0.934 1.000 1.251 19.939 0.904 1.307 1.778 0.890 100 1.744 1.216 1.216 1.000 0.987 1.041 0.944 0.970 0.962 1.000 0.929 1.000 1.244 16.563 0.904 1.278 1.719 0.873 200 1.744 1.181 1.181 1.000 0.986 1.018 0.937 0.966 0.958 0.979 0.921 1.000 1.216 9.717 0.899 1.224 1.625 0.861 20 50 1.830 1.325 1.321 1.000 0.994 1.102 0.971 0.984 0.981 1.060 0.965 1.000 1.472 54.645 0.960 1.554 2.538 0.962 100 1.829 1.283 1.272 1.000 0.993 1.064 0.969 0.985 0.980 1.031 0.961 1.000 1.449 56.087 0.960 1.507 2.644 0.941 200 1.838 1.245 1.238 1.000 0.993 1.040 0.968 0.984 0.979 1.013 0.959 1.000 1.407 48.361 0.959 1.424 2.483 0.927 6 4 50 1.836 1.488 1.488 1.000 0.940 0.935 0.922 0.949 0.868 0.854 0.813 1.000 0.765 2.523 0.726 0.763 0.831 0.708 100 1.824 1.443 1.443 1.000 0.936 0.912 0.912 0.945 0.859 0.830 0.800 1.000 0.760 1.705 0.724 0.751 0.818 0.693 200 1.821 1.414 1.414 1.000 0.936 0.901 0.905 0.941 0.855 0.817 0.792 1.000 0.751 1.171 0.719 0.733 0.790 0.683 10 50 2.202 1.782 1.782 1.000 0.963 1.011 0.962 0.978 0.932 0.964 0.897 1.000 1.034 20.803 0.799 1.074 1.478 0.795 100 2.198 1.740 1.740 1.000 0.961 0.976 0.959 0.979 0.930 0.936 0.890 1.000 1.027 17.133 0.795 1.050 1.462 0.773 200 2.179 1.698 1.698 1.000 0.961 0.956 0.955 0.976 0.927 0.917 0.887 1.000 1.010 10.024 0.796 1.013 1.416 0.763 20 50 2.348 1.903 1.903 1.000 0.981 1.065 0.979 0.988 0.966 1.030 0.947 1.000 1.312 55.538 0.894 1.387 2.407 0.910 100 2.343 1.849 1.849 1.000 0.978 1.027 0.978 0.989 0.963 0.998 0.940 1.000 1.292 57.402 0.889 1.338 2.440 0.878 200 2.335 1.815 1.815 1.000 0.975 0.999 0.976 0.989 0.959 0.974 0.936 1.000 1.256 44.016 0.888 1.270 2.207 0.862 E.1 Simulation with uncorrelated forecast errors Table 11 : AvgRelMAE for the simulation experiment (balanced panel of forecasts). Benchmark approach: ew. Bold entries identify the best performing approaches, italic entries identify the second best and red color denotes forecasts worse than the benchmark. Approach Sett. p N base ∗ base {}^{\ast}_{\text{shr}} base {}_{\text{shr}} ew ow {}_{\text{var}} ow {}_{\text{cov}} src scr {}_{\text{ew}} scr {}_{\text{var}} scr {}_{\text{cov}} occ {}_{\text{wls}} occ {}_{\text{bv}} occ {}_{\text{shr}} occ {}_{\text{be}} 1 4 50 1.269 1.132 1.132 1.000 1.003 1.028 0.955 0.962 0.965 0.982 0.953 0.969 1.053 0.959 100 1.267 1.127 1.126 1.000 1.001 1.015 0.953 0.959 0.959 0.968 0.951 0.962 1.031 0.955 200 1.265 1.121 1.121 1.000 1.001 1.008 0.953 0.956 0.957 0.961 0.952 0.959 1.000 0.954 10 50 1.358 1.213 1.213 1.000 1.002 1.050 0.979 0.984 0.986 1.021 0.978 1.019 1.165 0.981 100 1.358 1.208 1.207 1.000 1.001 1.032 0.978 0.982 0.983 1.005 0.977 1.002 1.197 0.979 200 1.352 1.199 1.199 1.000 1.000 1.019 0.977 0.981 0.981 0.994 0.977 0.992 1.125 0.978 20 50 1.395 1.246 1.246 1.000 1.001 1.059 0.988 0.992 0.993 1.037 0.988 1.070 1.143 0.989 100 1.394 1.240 1.239 1.000 1.000 1.040 0.988 0.991 0.991 1.021 0.987 1.039 1.283 0.988 200 1.385 1.229 1.229 1.000 1.000 1.026 0.987 0.990 0.991 1.009 0.987 1.016 1.324 0.988 2 4 50 1.195 1.099 1.098 1.000 1.001 1.026 0.972 0.976 0.977 0.994 0.969 0.983 1.065 0.974 100 1.192 1.094 1.094 1.000 1.001 1.015 0.971 0.975 0.975 0.984 0.969 0.977 1.048 0.972 200 1.192 1.089 1.089 1.000 1.000 1.008 0.970 0.973 0.973 0.978 0.969 0.974 1.018 0.971 10 50 1.249 1.149 1.149 1.000 1.001 1.042 0.988 0.990 0.991 1.020 0.987 1.028 1.165 0.989 100 1.247 1.145 1.144 1.000 1.000 1.028 0.987 0.990 0.990 1.009 0.986 1.010 1.202 0.988 200 1.245 1.138 1.138 1.000 1.000 1.018 0.987 0.990 0.990 1.001 0.986 0.999 1.137 0.987 20 50 1.268 1.165 1.165 1.000 1.001 1.046 0.994 0.995 0.995 1.028 0.993 1.079 1.145 0.995 100 1.267 1.163 1.162 1.000 1.000 1.032 0.993 0.995 0.995 1.018 0.993 1.044 1.281 0.994 200 1.264 1.155 1.155 1.000 1.000 1.023 0.993 0.995 0.995 1.010 0.993 1.020 1.323 0.993 3 4 50 1.092 1.052 1.050 1.000 1.000 1.020 0.989 0.990 0.991 1.005 0.986 0.999 1.076 0.990 100 1.093 1.049 1.049 1.000 1.000 1.012 0.988 0.990 0.990 0.999 0.986 0.993 1.059 0.989 200 1.093 1.047 1.046 1.000 1.000 1.008 0.987 0.989 0.989 0.994 0.986 0.990 1.034 0.988 10 50 1.114 1.072 1.071 1.000 1.000 1.027 0.995 0.996 0.996 1.016 0.994 1.030 1.161 0.996 100 1.115 1.068 1.068 1.000 1.000 1.018 0.995 0.996 0.996 1.009 0.994 1.016 1.185 0.995 200 1.115 1.067 1.067 1.000 1.000 1.013 0.995 0.996 0.996 1.005 0.994 1.006 1.136 0.995 20 50 1.122 1.080 1.079 1.000 1.000 1.028 0.998 0.998 0.998 1.018 0.997 1.073 1.142 0.998 100 1.122 1.076 1.076 1.000 1.000 1.020 0.997 0.998 0.998 1.012 0.997 1.045 1.258 0.997 200 1.123 1.074 1.074 1.000 1.000 1.014 0.997 0.998 0.998 1.008 0.997 1.023 1.297 0.997 4 4 50 1.213 1.117 1.117 1.000 0.989 0.994 0.972 0.976 0.964 0.955 0.955 0.946 1.012 0.956 100 1.212 1.113 1.113 1.000 0.988 0.983 0.971 0.975 0.961 0.943 0.954 0.937 0.990 0.952 200 1.211 1.110 1.110 1.000 0.988 0.978 0.969 0.972 0.958 0.937 0.954 0.934 0.964 0.951 10 50 1.272 1.175 1.174 1.000 0.984 0.978 0.988 0.991 0.974 0.949 0.970 0.945 1.064 0.966 100 1.269 1.167 1.167 1.000 0.983 0.960 0.988 0.991 0.973 0.933 0.969 0.924 1.076 0.964 200 1.272 1.166 1.166 1.000 0.984 0.952 0.987 0.990 0.973 0.923 0.969 0.915 1.020 0.963 20 50 1.288 1.187 1.187 1.000 0.982 0.962 0.994 0.995 0.976 0.940 0.974 0.952 1.022 0.969 100 1.288 1.183 1.183 1.000 0.981 0.942 0.993 0.995 0.976 0.920 0.974 0.917 1.112 0.967 200 1.285 1.178 1.178 1.000 0.981 0.927 0.993 0.995 0.976 0.906 0.974 0.894 1.132 0.967 5 4 50 1.209 1.103 1.103 1.000 0.992 1.012 0.966 0.971 0.966 0.979 0.957 0.968 1.047 0.963 100 1.209 1.098 1.098 1.000 0.991 1.001 0.964 0.968 0.963 0.970 0.957 0.963 1.030 0.961 200 1.209 1.096 1.096 1.000 0.991 0.994 0.963 0.967 0.961 0.964 0.957 0.959 1.003 0.959 10 50 1.275 1.164 1.164 1.000 0.996 1.035 0.985 0.988 0.985 1.013 0.981 1.019 1.156 0.983 100 1.273 1.159 1.159 1.000 0.995 1.021 0.985 0.988 0.985 1.002 0.981 1.002 1.186 0.983 200 1.273 1.155 1.155 1.000 0.995 1.010 0.983 0.987 0.983 0.992 0.980 0.991 1.122 0.981 20 50 1.301 1.187 1.187 1.000 0.998 1.045 0.992 0.994 0.992 1.027 0.990 1.073 1.144 0.991 100 1.300 1.182 1.182 1.000 0.997 1.029 0.992 0.994 0.992 1.014 0.989 1.038 1.269 0.990 200 1.301 1.179 1.179 1.000 0.997 1.020 0.991 0.994 0.992 1.008 0.990 1.017 1.310 0.990 6 4 50 1.346 1.281 1.281 1.000 0.965 0.959 0.982 0.983 0.938 0.928 0.934 0.915 0.984 0.930 100 1.344 1.274 1.274 1.000 0.962 0.947 0.979 0.981 0.933 0.915 0.931 0.906 0.961 0.925 200 1.341 1.266 1.266 1.000 0.961 0.940 0.976 0.978 0.929 0.907 0.930 0.901 0.931 0.921 10 50 1.468 1.396 1.396 1.000 0.979 1.000 0.991 0.991 0.966 0.978 0.964 0.979 1.113 0.961 100 1.467 1.391 1.391 1.000 0.978 0.984 0.989 0.991 0.964 0.965 0.962 0.964 1.134 0.958 200 1.460 1.379 1.379 1.000 0.978 0.974 0.989 0.991 0.963 0.957 0.963 0.955 1.074 0.957 20 50 1.511 1.440 1.440 1.000 0.989 1.026 0.996 0.995 0.983 1.010 0.981 1.043 1.128 0.981 100 1.513 1.436 1.436 1.000 0.988 1.009 0.995 0.995 0.981 0.996 0.980 1.015 1.241 0.978 200 1.511 1.428 1.428 1.000 0.986 0.997 0.994 0.996 0.980 0.985 0.979 0.993 1.264 0.975 Table 12 : AvgRelMSE for the simulation experiment (balanced panel of forecasts). Benchmark approach: ew. Bold entries identify the best performing approaches, italic entries identify the second best and red color denotes forecasts worse than the benchmark. Approach Sett. p N base ∗ base {}^{\ast}_{\text{shr}} base {}_{\text{shr}} ew ow {}_{\text{var}} ow {}_{\text{cov}} src scr {}_{\text{ew}} scr {}_{\text{var}} scr {}_{\text{cov}} occ {}_{\text{wls}} occ {}_{\text{bv}} occ {}_{\text{shr}} occ {}_{\text{be}} 1 4 50 1.611 1.283 1.283 1.000 1.005 1.058 0.912 0.926 0.930 0.965 0.908 0.939 1.108 0.919 100 1.606 1.269 1.269 1.000 1.002 1.031 0.909 0.919 0.921 0.939 0.906 0.926 1.063 0.913 200 1.603 1.257 1.257 1.000 1.001 1.015 0.908 0.914 0.915 0.924 0.907 0.919 0.999 0.910 10 50 1.847 1.474 1.472 1.000 1.004 1.104 0.957 0.968 0.971 1.043 0.956 1.039 1.355 0.962 100 1.843 1.457 1.457 1.000 1.002 1.065 0.956 0.965 0.966 1.010 0.954 1.004 1.432 0.958 200 1.830 1.439 1.439 1.000 1.001 1.039 0.955 0.962 0.963 0.988 0.955 0.984 1.265 0.956 20 50 1.947 1.552 1.551 1.000 1.002 1.121 0.976 0.983 0.985 1.074 0.976 1.146 1.305 0.979 100 1.943 1.536 1.536 1.000 1.001 1.082 0.975 0.982 0.983 1.042 0.974 1.079 1.646 0.976 200 1.922 1.511 1.511 1.000 1.001 1.054 0.975 0.981 0.982 1.018 0.975 1.032 1.753 0.976 2 4 50 1.428 1.206 1.206 1.000 1.003 1.053 0.944 0.953 0.955 0.988 0.939 0.966 1.135 0.948 100 1.421 1.195 1.195 1.000 1.001 1.030 0.942 0.950 0.951 0.969 0.938 0.954 1.098 0.945 200 1.421 1.185 1.185 1.000 1.001 1.016 0.941 0.947 0.947 0.956 0.938 0.947 1.036 0.942 10 50 1.561 1.321 1.321 1.000 1.002 1.086 0.976 0.980 0.982 1.041 0.974 1.057 1.354 0.978 100 1.556 1.308 1.308 1.000 1.001 1.056 0.975 0.980 0.981 1.018 0.973 1.019 1.443 0.976 200 1.551 1.294 1.294 1.000 1.001 1.036 0.974 0.979 0.980 1.002 0.973 0.998 1.290 0.974 20 50 1.610 1.362 1.361 1.000 1.001 1.095 0.987 0.990 0.991 1.058 0.986 1.165 1.308 0.989 100 1.607 1.351 1.351 1.000 1.000 1.066 0.987 0.989 0.990 1.037 0.986 1.091 1.641 0.987 200 1.599 1.334 1.334 1.000 1.000 1.046 0.986 0.991 0.991 1.021 0.986 1.042 1.749 0.987 3 4 50 1.198 1.109 1.107 1.000 1.001 1.042 0.977 0.981 0.982 1.011 0.973 0.998 1.164 0.979 100 1.201 1.103 1.103 1.000 1.000 1.026 0.976 0.980 0.980 0.997 0.972 0.987 1.125 0.976 200 1.201 1.098 1.097 1.000 1.000 1.016 0.974 0.978 0.978 0.988 0.972 0.980 1.070 0.974 10 50 1.249 1.155 1.154 1.000 1.001 1.056 0.991 0.991 0.992 1.033 0.989 1.064 1.362 0.992 100 1.249 1.147 1.147 1.000 1.000 1.039 0.990 0.991 0.992 1.020 0.988 1.034 1.418 0.990 200 1.250 1.142 1.142 1.000 1.000 1.027 0.989 0.992 0.992 1.010 0.988 1.012 1.299 0.989 20 50 1.266 1.172 1.170 1.000 1.000 1.058 0.995 0.995 0.996 1.039 0.994 1.159 1.315 0.996 100 1.268 1.164 1.164 1.000 1.000 1.042 0.995 0.995 0.996 1.025 0.994 1.096 1.599 0.995 200 1.268 1.158 1.158 1.000 1.000 1.030 0.994 0.995 0.995 1.016 0.994 1.049 1.700 0.994 4 4 50 1.472 1.249 1.249 1.000 0.978 0.990 0.944 0.954 0.929 0.912 0.913 0.894 1.025 0.914 100 1.468 1.239 1.239 1.000 0.976 0.967 0.942 0.950 0.924 0.890 0.911 0.878 0.983 0.907 200 1.469 1.231 1.231 1.000 0.975 0.956 0.940 0.946 0.919 0.878 0.911 0.872 0.929 0.904 10 50 1.619 1.379 1.379 1.000 0.969 0.956 0.976 0.981 0.949 0.901 0.940 0.892 1.131 0.934 100 1.613 1.366 1.364 1.000 0.967 0.922 0.975 0.981 0.947 0.870 0.939 0.854 1.161 0.929 200 1.612 1.356 1.356 1.000 0.967 0.904 0.974 0.979 0.946 0.852 0.939 0.836 1.040 0.927 20 50 1.661 1.412 1.412 1.000 0.964 0.927 0.988 0.990 0.953 0.883 0.949 0.905 1.042 0.939 100 1.655 1.398 1.398 1.000 0.963 0.888 0.987 0.990 0.953 0.847 0.949 0.843 1.238 0.936 200 1.650 1.383 1.383 1.000 0.963 0.860 0.987 0.991 0.953 0.822 0.949 0.798 1.283 0.935 5 4 50 1.462 1.219 1.219 1.000 0.983 1.024 0.932 0.943 0.933 0.958 0.916 0.937 1.097 0.927 100 1.460 1.205 1.205 1.000 0.982 1.002 0.930 0.937 0.928 0.941 0.915 0.926 1.061 0.923 200 1.461 1.202 1.202 1.000 0.981 0.988 0.928 0.934 0.924 0.928 0.915 0.920 1.005 0.920 10 50 1.627 1.358 1.358 1.000 0.991 1.072 0.970 0.976 0.970 1.026 0.962 1.038 1.337 0.967 100 1.619 1.343 1.343 1.000 0.990 1.042 0.969 0.976 0.970 1.004 0.961 1.004 1.407 0.965 200 1.624 1.338 1.338 1.000 0.990 1.020 0.967 0.974 0.968 0.986 0.961 0.983 1.261 0.963 20 50 1.692 1.408 1.408 1.000 0.995 1.094 0.984 0.987 0.985 1.055 0.980 1.151 1.305 0.983 100 1.691 1.401 1.399 1.000 0.994 1.060 0.983 0.987 0.984 1.029 0.979 1.078 1.613 0.981 200 1.692 1.391 1.391 1.000 0.995 1.040 0.983 0.988 0.984 1.015 0.979 1.034 1.714 0.981 6 4 50 1.765 1.591 1.591 1.000 0.938 0.930 0.963 0.964 0.886 0.869 0.877 0.846 0.978 0.872 100 1.755 1.570 1.570 1.000 0.933 0.906 0.957 0.961 0.877 0.847 0.873 0.830 0.933 0.862 200 1.751 1.550 1.550 1.000 0.932 0.894 0.953 0.957 0.871 0.833 0.872 0.822 0.879 0.857 10 50 2.084 1.877 1.877 1.000 0.962 1.003 0.982 0.983 0.936 0.962 0.932 0.963 1.245 0.927 100 2.080 1.860 1.860 1.000 0.959 0.971 0.979 0.983 0.933 0.936 0.930 0.933 1.289 0.922 200 2.064 1.826 1.826 1.000 0.959 0.952 0.977 0.982 0.931 0.920 0.930 0.915 1.158 0.919 20 50 2.211 2.000 2.000 1.000 0.980 1.055 0.991 0.990 0.967 1.021 0.964 1.089 1.274 0.964 100 2.218 1.986 1.986 1.000 0.977 1.020 0.989 0.991 0.964 0.992 0.961 1.031 1.544 0.957 200 2.202 1.952 1.952 1.000 0.975 0.996 0.988 0.991 0.961 0.973 0.959 0.989 1.599 0.953 Table 13 : AvgRelMAE for the simulation experiment (unbalanced panel of forecasts). Benchmark approach: ew. Bold entries identify the best performing approaches, italic entries identify the second best and red color denotes forecasts worse than the benchmark. Approach Sett. p N ew ow {}_{\text{var}} ow {}_{\text{cov}} scr {}_{\text{ew}} scr {}_{\text{var}} scr {}_{\text{cov}} occ {}_{\text{wls}} occ {}_{\text{bv}} occ {}_{\text{shr}} occ {}_{\text{be}} 1 4 50 1.000 1.067 1.561 0.920 1.096 1.176 0.908 0.941 0.911 0.911 100 1.000 1.065 1.452 0.920 1.078 1.177 0.903 0.937 0.906 0.906 200 1.000 1.048 1.279 0.919 1.043 1.149 0.902 0.937 0.904 0.905 10 50 1.000 1.250 3.037 0.952 1.312 1.525 0.950 0.976 0.950 0.951 100 1.000 1.249 2.933 0.950 1.285 1.525 0.942 0.970 0.942 0.944 200 1.000 1.216 2.624 0.951 1.224 1.475 0.938 0.968 0.938 0.940 20 50 1.000 1.369 4.231 0.979 1.448 1.815 0.985 0.998 0.985 0.985 100 1.000 1.355 4.456 0.978 1.407 1.832 0.973 0.987 0.973 0.974 200 1.000 1.304 4.098 0.979 1.320 1.734 0.967 0.983 0.967 0.968 2 4 50 1.000 1.051 1.441 0.943 1.065 1.115 0.932 0.959 0.935 0.934 100 1.000 1.052 1.378 0.943 1.059 1.121 0.928 0.958 0.933 0.931 200 1.000 1.043 1.276 0.942 1.040 1.111 0.927 0.956 0.929 0.929 10 50 1.000 1.167 2.514 0.970 1.195 1.333 0.967 0.988 0.967 0.968 100 1.000 1.167 2.452 0.969 1.183 1.329 0.961 0.983 0.961 0.962 200 1.000 1.153 1.986 0.970 1.157 1.253 0.957 0.982 0.957 0.959 20 50 1.000 1.239 3.429 0.989 1.273 1.526 0.992 1.001 0.992 0.992 100 1.000 1.233 3.564 0.989 1.256 1.544 0.984 0.994 0.984 0.984 200 1.000 1.211 3.451 0.991 1.218 1.508 0.980 0.992 0.980 0.981 3 4 50 1.000 1.343 1.865 0.976 1.404 1.492 0.967 0.984 0.972 0.968 100 1.000 1.348 1.882 0.975 1.387 1.512 0.964 0.984 0.967 0.967 200 1.000 1.338 1.927 0.975 1.356 1.537 0.964 0.982 0.968 0.966 10 50 1.000 1.477 2.810 0.990 1.540 1.660 0.986 0.998 0.986 0.987 100 1.000 1.475 2.688 0.990 1.517 1.625 0.982 0.997 0.982 0.983 200 1.000 1.453 2.302 0.990 1.474 1.521 0.981 0.995 0.981 0.982 20 50 1.000 1.533 3.541 0.998 1.599 1.801 0.997 1.003 0.997 0.997 100 1.000 1.523 3.545 0.999 1.572 1.794 0.993 1.000 0.993 0.994 200 1.000 1.491 3.682 0.999 1.514 1.754 0.992 0.998 0.992 0.992 4 4 50 1.000 1.026 1.381 0.934 1.039 1.079 0.921 0.957 0.923 0.922 100 1.000 1.025 1.318 0.935 1.032 1.080 0.917 0.954 0.919 0.919 200 1.000 1.021 1.215 0.934 1.019 1.072 0.914 0.953 0.915 0.915 10 50 1.000 1.151 2.446 0.964 1.180 1.307 0.954 0.988 0.954 0.955 100 1.000 1.150 2.384 0.962 1.167 1.308 0.947 0.983 0.947 0.947 200 1.000 1.135 2.051 0.962 1.140 1.242 0.943 0.980 0.943 0.943 20 50 1.000 1.224 3.380 0.984 1.260 1.492 0.976 1.003 0.976 0.976 100 1.000 1.216 3.604 0.984 1.242 1.513 0.967 0.996 0.967 0.967 200 1.000 1.198 3.399 0.984 1.207 1.482 0.962 0.991 0.962 0.962 5 4 50 1.000 1.021 1.374 0.932 1.033 1.080 0.916 0.956 0.919 0.918 100 1.000 1.021 1.329 0.932 1.026 1.083 0.913 0.954 0.915 0.915 200 1.000 1.015 1.222 0.931 1.013 1.075 0.910 0.952 0.912 0.912 10 50 1.000 1.143 2.481 0.962 1.169 1.309 0.954 0.986 0.954 0.955 100 1.000 1.141 2.363 0.961 1.157 1.300 0.947 0.982 0.947 0.948 200 1.000 1.129 2.029 0.961 1.133 1.239 0.944 0.981 0.944 0.945 20 50 1.000 1.226 3.427 0.984 1.260 1.514 0.984 1.001 0.984 0.985 100 1.000 1.218 3.583 0.986 1.242 1.534 0.975 0.996 0.975 0.976 200 1.000 1.201 3.407 0.985 1.209 1.502 0.971 0.992 0.971 0.971 6 4 50 1.000 0.891 1.228 0.855 0.892 0.929 0.855 0.976 0.858 0.848 100 1.000 0.891 1.158 0.854 0.889 0.926 0.851 0.969 0.849 0.841 200 1.000 0.879 1.032 0.849 0.872 0.906 0.847 0.970 0.841 0.833 10 50 1.000 1.032 2.405 0.899 1.053 1.199 0.899 1.017 0.899 0.895 100 1.000 1.027 2.322 0.894 1.040 1.192 0.889 1.012 0.889 0.884 200 1.000 1.020 2.097 0.894 1.024 1.170 0.887 1.006 0.887 0.881 20 50 1.000 1.151 3.467 0.946 1.182 1.464 0.953 1.028 0.953 0.952 100 1.000 1.144 3.503 0.944 1.165 1.466 0.941 1.015 0.941 0.939 200 1.000 1.128 3.381 0.942 1.135 1.422 0.935 1.010 0.935 0.931 Table 14 : AvgRelMAE for the simulation experiment (unbalanced panel of forecasts). Benchmark approach: ew. Bold entries identify the best performing approaches, italic entries identify the second best and red color denotes forecasts worse than the benchmark. Approach Sett. p N ew ow {}_{\text{var}} ow {}_{\text{cov}} scr {}_{\text{ew}} scr {}_{\text{var}} scr {}_{\text{cov}} occ {}_{\text{wls}} occ {}_{\text{bv}} occ {}_{\text{shr}} occ {}_{\text{be}} 1 4 50 1.000 1.142 4.445 0.843 1.204 1.414 0.821 0.882 0.827 0.825 100 1.000 1.135 3.129 0.844 1.158 1.394 0.811 0.875 0.818 0.816 200 1.000 1.100 1.959 0.841 1.086 1.324 0.808 0.874 0.812 0.814 10 50 1.000 1.574 34.142 0.903 1.727 2.534 0.901 0.952 0.901 0.904 100 1.000 1.561 27.893 0.900 1.648 2.530 0.885 0.939 0.885 0.888 200 1.000 1.483 16.711 0.901 1.501 2.349 0.878 0.935 0.878 0.881 20 50 1.000 1.888 84.260 0.959 2.110 3.768 0.973 1.000 0.973 0.974 100 1.000 1.840 92.476 0.956 1.981 3.905 0.947 0.974 0.947 0.949 200 1.000 1.711 71.014 0.957 1.749 3.532 0.935 0.967 0.935 0.937 2 4 50 1.000 1.103 3.558 0.887 1.132 1.252 0.866 0.918 0.873 0.869 100 1.000 1.104 2.806 0.887 1.117 1.262 0.859 0.914 0.877 0.863 200 1.000 1.088 2.042 0.885 1.081 1.237 0.856 0.912 0.863 0.861 10 50 1.000 1.363 22.230 0.939 1.426 1.877 0.932 0.975 0.932 0.934 100 1.000 1.360 18.549 0.937 1.398 1.857 0.922 0.966 0.922 0.924 200 1.000 1.330 8.240 0.940 1.339 1.621 0.916 0.964 0.916 0.919 20 50 1.000 1.536 52.890 0.977 1.623 2.588 0.984 1.004 0.984 0.985 100 1.000 1.519 56.419 0.978 1.577 2.641 0.968 0.988 0.968 0.969 200 1.000 1.468 48.081 0.981 1.485 2.525 0.960 0.984 0.960 0.961 3 4 50 1.000 1.801 6.249 0.950 1.959 2.247 0.932 0.967 0.955 0.935 100 1.000 1.808 5.826 0.949 1.907 2.299 0.928 0.965 0.936 0.932 200 1.000 1.780 5.758 0.948 1.823 2.366 0.926 0.964 0.940 0.930 10 50 1.000 2.174 25.406 0.980 2.356 2.893 0.971 0.996 0.971 0.972 100 1.000 2.162 20.583 0.980 2.283 2.770 0.963 0.993 0.963 0.966 200 1.000 2.099 11.622 0.980 2.157 2.413 0.960 0.991 0.960 0.962 20 50 1.000 2.342 50.297 0.996 2.545 3.534 0.993 1.007 0.993 0.994 100 1.000 2.308 48.473 0.998 2.456 3.544 0.985 1.000 0.985 0.986 200 1.000 2.208 52.373 0.999 2.275 3.417 0.983 0.997 0.983 0.984 4 4 50 1.000 1.049 3.225 0.870 1.075 1.168 0.843 0.913 0.850 0.845 100 1.000 1.048 2.518 0.870 1.058 1.167 0.836 0.907 0.841 0.839 200 1.000 1.039 1.808 0.869 1.033 1.148 0.832 0.904 0.834 0.834 10 50 1.000 1.324 20.433 0.926 1.390 1.796 0.907 0.975 0.907 0.909 100 1.000 1.317 17.617 0.922 1.356 1.808 0.893 0.963 0.893 0.894 200 1.000 1.285 9.268 0.923 1.295 1.602 0.887 0.959 0.887 0.888 20 50 1.000 1.502 51.565 0.967 1.590 2.450 0.954 1.007 0.954 0.954 100 1.000 1.478 58.675 0.968 1.542 2.556 0.934 0.992 0.934 0.934 200 1.000 1.435 46.748 0.968 1.454 2.460 0.926 0.982 0.926 0.926 5 4 50 1.000 1.037 3.183 0.863 1.060 1.168 0.834 0.910 0.843 0.837 100 1.000 1.037 2.585 0.865 1.047 1.175 0.829 0.907 0.833 0.833 200 1.000 1.024 1.859 0.862 1.019 1.151 0.823 0.903 0.829 0.827 10 50 1.000 1.304 21.252 0.923 1.365 1.812 0.908 0.974 0.908 0.910 100 1.000 1.299 16.763 0.922 1.336 1.776 0.895 0.964 0.895 0.898 200 1.000 1.270 9.024 0.920 1.279 1.584 0.887 0.958 0.887 0.889 20 50 1.000 1.504 52.836 0.966 1.589 2.527 0.970 1.003 0.970 0.971 100 1.000 1.485 57.874 0.971 1.543 2.612 0.951 0.992 0.951 0.953 200 1.000 1.442 47.212 0.970 1.461 2.521 0.942 0.983 0.942 0.943 6 4 50 1.000 0.800 2.593 0.735 0.802 0.879 0.733 0.955 0.747 0.721 100 1.000 0.798 1.953 0.737 0.795 0.866 0.727 0.942 0.730 0.710 200 1.000 0.780 1.286 0.727 0.767 0.830 0.720 0.942 0.719 0.697 10 50 1.000 1.070 21.273 0.809 1.114 1.531 0.809 1.036 0.809 0.803 100 1.000 1.058 17.496 0.801 1.085 1.507 0.792 1.025 0.792 0.783 200 1.000 1.044 10.631 0.799 1.050 1.432 0.786 1.011 0.786 0.776 20 50 1.000 1.331 55.600 0.895 1.405 2.416 0.912 1.062 0.912 0.910 100 1.000 1.313 55.471 0.892 1.361 2.416 0.889 1.032 0.889 0.884 200 1.000 1.276 46.749 0.890 1.293 2.240 0.875 1.021 0.875 0.870 E.2 Simulation with correlated forecast errors Table 15 : AvgRelMAE for the simulation experiment (balanced panel of forecasts). Benchmark approach: ew. Bold entries identify the best performing approaches, italic entries identify the second best and red color denotes forecasts worse than the benchmark. Approach Sett. p N base ∗ base {}^{\ast}_{\text{shr}} base {}_{\text{shr}} ew ow {}_{\text{var}} ow {}_{\text{cov}} src scr {}_{\text{ew}} scr {}_{\text{var}} scr {}_{\text{cov}} occ {}_{\text{wls}} occ {}_{\text{bv}} occ {}_{\text{shr}} occ {}_{\text{be}} 1 4 50 1.308 1.063 1.058 1.000 1.002 1.027 0.921 0.949 0.951 0.969 0.945 0.961 0.976 0.905 100 1.307 1.038 1.037 1.000 1.000 1.014 0.915 0.946 0.946 0.955 0.944 0.955 0.939 0.894 200 1.305 1.026 1.025 1.000 1.000 1.007 0.912 0.943 0.942 0.946 0.944 0.951 0.908 0.890 10 50 1.417 1.152 1.146 1.000 1.001 1.053 0.962 0.980 0.981 1.020 0.974 1.016 1.148 0.953 100 1.417 1.125 1.123 1.000 1.000 1.033 0.959 0.979 0.979 1.003 0.973 1.000 1.109 0.947 200 1.412 1.111 1.110 1.000 1.000 1.019 0.958 0.976 0.976 0.989 0.973 0.988 1.038 0.946 20 50 1.461 1.188 1.181 1.000 1.001 1.063 0.979 0.990 0.991 1.040 0.986 1.071 1.209 0.974 100 1.463 1.162 1.159 1.000 1.000 1.044 0.978 0.990 0.990 1.023 0.985 1.041 1.286 0.972 200 1.455 1.147 1.145 1.000 1.000 1.028 0.978 0.989 0.988 1.008 0.985 1.015 1.189 0.971 2 4 50 1.226 1.054 1.052 1.000 1.001 1.026 0.949 0.967 0.968 0.986 0.963 0.978 1.012 0.942 100 1.226 1.037 1.036 1.000 1.000 1.014 0.945 0.965 0.966 0.975 0.963 0.971 0.980 0.936 200 1.225 1.026 1.026 1.000 1.000 1.007 0.943 0.963 0.963 0.967 0.963 0.967 0.952 0.932 10 50 1.294 1.113 1.110 1.000 1.001 1.045 0.977 0.988 0.989 1.023 0.984 1.029 1.166 0.974 100 1.295 1.095 1.093 1.000 1.000 1.030 0.976 0.988 0.988 1.009 0.984 1.010 1.133 0.972 200 1.293 1.083 1.083 1.000 1.000 1.018 0.975 0.987 0.987 0.999 0.984 0.997 1.062 0.970 20 50 1.319 1.135 1.132 1.000 1.000 1.050 0.988 0.994 0.994 1.032 0.992 1.085 1.216 0.986 100 1.319 1.117 1.114 1.000 1.000 1.036 0.988 0.994 0.994 1.021 0.992 1.049 1.298 0.986 200 1.318 1.105 1.103 1.000 1.000 1.023 0.987 0.994 0.994 1.009 0.992 1.020 1.204 0.984 3 4 50 1.110 1.034 1.034 1.000 1.000 1.020 0.979 0.988 0.988 1.003 0.984 0.997 1.048 0.978 100 1.112 1.025 1.025 1.000 1.000 1.013 0.977 0.986 0.987 0.995 0.984 0.992 1.024 0.975 200 1.111 1.016 1.016 1.000 1.000 1.007 0.974 0.984 0.984 0.989 0.983 0.987 0.997 0.971 10 50 1.137 1.059 1.059 1.000 1.000 1.029 0.992 0.995 0.995 1.017 0.994 1.033 1.178 0.991 100 1.139 1.050 1.049 1.000 1.000 1.021 0.990 0.995 0.995 1.011 0.993 1.018 1.147 0.989 200 1.138 1.044 1.041 1.000 1.000 1.013 0.989 0.995 0.995 1.004 0.993 1.006 1.084 0.988 20 50 1.147 1.069 1.067 1.000 1.000 1.031 0.996 0.997 0.998 1.021 0.997 1.083 1.223 0.995 100 1.148 1.058 1.057 1.000 1.000 1.023 0.995 0.997 0.997 1.015 0.996 1.051 1.293 0.994 200 1.148 1.053 1.051 1.000 1.000 1.016 0.995 0.998 0.998 1.010 0.996 1.026 1.215 0.994 4 4 50 1.243 1.074 1.074 1.000 0.991 1.001 0.950 0.968 0.957 0.950 0.952 0.947 0.954 0.922 100 1.241 1.056 1.056 1.000 0.989 0.988 0.946 0.966 0.953 0.936 0.951 0.938 0.910 0.915 200 1.242 1.042 1.042 1.000 0.989 0.982 0.942 0.963 0.950 0.929 0.950 0.934 0.872 0.909 10 50 1.317 1.134 1.134 1.000 0.986 0.987 0.978 0.988 0.973 0.955 0.968 0.953 1.044 0.948 100 1.313 1.117 1.117 1.000 0.985 0.968 0.976 0.987 0.972 0.936 0.968 0.931 0.986 0.942 200 1.317 1.107 1.107 1.000 0.985 0.959 0.975 0.986 0.971 0.926 0.968 0.923 0.908 0.939 20 50 1.336 1.150 1.150 1.000 0.983 0.973 0.989 0.994 0.977 0.948 0.975 0.964 1.069 0.958 100 1.339 1.138 1.138 1.000 0.983 0.952 0.988 0.994 0.977 0.928 0.974 0.930 1.096 0.954 200 1.334 1.123 1.123 1.000 0.983 0.937 0.987 0.994 0.976 0.913 0.974 0.905 0.997 0.950 5 4 50 1.241 1.049 1.049 1.000 0.989 1.010 0.939 0.959 0.955 0.969 0.950 0.962 0.993 0.926 100 1.245 1.038 1.034 1.000 0.989 0.998 0.934 0.957 0.952 0.958 0.949 0.955 0.962 0.919 200 1.243 1.023 1.023 1.000 0.988 0.991 0.930 0.954 0.949 0.951 0.949 0.952 0.934 0.915 10 50 1.322 1.122 1.122 1.000 0.994 1.036 0.972 0.985 0.981 1.012 0.977 1.017 1.149 0.966 100 1.320 1.103 1.103 1.000 0.994 1.021 0.971 0.985 0.981 1.000 0.976 1.000 1.119 0.964 200 1.320 1.087 1.087 1.000 0.993 1.009 0.968 0.983 0.979 0.990 0.976 0.988 1.051 0.960 20 50 1.353 1.151 1.149 1.000 0.997 1.049 0.986 0.993 0.991 1.030 0.988 1.076 1.212 0.983 100 1.352 1.132 1.128 1.000 0.996 1.031 0.984 0.992 0.990 1.015 0.987 1.040 1.275 0.980 200 1.356 1.116 1.113 1.000 0.996 1.020 0.984 0.992 0.990 1.007 0.987 1.016 1.196 0.979 6 4 50 1.370 1.240 1.240 1.000 0.966 0.962 0.961 0.975 0.928 0.919 0.929 0.912 0.934 0.898 100 1.367 1.224 1.224 1.000 0.964 0.950 0.956 0.972 0.923 0.906 0.927 0.904 0.901 0.891 200 1.366 1.212 1.212 1.000 0.964 0.944 0.952 0.970 0.921 0.899 0.928 0.900 0.872 0.886 10 50 1.508 1.363 1.363 1.000 0.980 1.003 0.981 0.990 0.964 0.980 0.962 0.980 1.113 0.946 100 1.507 1.349 1.349 1.000 0.978 0.986 0.979 0.990 0.962 0.965 0.961 0.964 1.077 0.942 200 1.499 1.331 1.331 1.000 0.979 0.975 0.977 0.988 0.961 0.956 0.961 0.954 1.012 0.940 20 50 1.554 1.410 1.408 1.000 0.990 1.031 0.989 0.994 0.982 1.014 0.980 1.046 1.196 0.973 100 1.552 1.389 1.389 1.000 0.988 1.012 0.989 0.994 0.980 0.998 0.979 1.017 1.254 0.969 200 1.553 1.379 1.379 1.000 0.987 0.998 0.988 0.995 0.979 0.986 0.978 0.994 1.170 0.966 Table 16 : AvgRelMSE for the simulation experiment (balanced panel of forecasts). Benchmark approach: ew. Bold entries identify the best performing approaches, italic entries identify the second best and red color denotes forecasts worse than the benchmark. Approach Sett. p N base ∗ base {}^{\ast}_{\text{shr}} base {}_{\text{shr}} ew ow {}_{\text{var}} ow {}_{\text{cov}} src scr {}_{\text{ew}} scr {}_{\text{var}} scr {}_{\text{cov}} occ {}_{\text{wls}} occ {}_{\text{bv}} occ {}_{\text{shr}} occ {}_{\text{be}} 1 4 50 1.712 1.130 1.120 1.000 1.004 1.056 0.847 0.901 0.905 0.939 0.893 0.924 0.954 0.818 100 1.708 1.078 1.074 1.000 1.001 1.029 0.837 0.895 0.896 0.913 0.892 0.912 0.883 0.801 200 1.702 1.052 1.049 1.000 1.000 1.013 0.832 0.888 0.888 0.895 0.891 0.904 0.825 0.791 10 50 2.010 1.327 1.315 1.000 1.002 1.108 0.925 0.960 0.963 1.040 0.948 1.032 1.317 0.908 100 2.007 1.267 1.262 1.000 1.001 1.068 0.920 0.958 0.959 1.005 0.947 1.000 1.232 0.899 200 1.996 1.236 1.232 1.000 1.000 1.039 0.918 0.953 0.953 0.979 0.946 0.977 1.077 0.895 20 50 2.136 1.411 1.398 1.000 1.001 1.129 0.958 0.980 0.982 1.081 0.971 1.146 1.459 0.949 100 2.139 1.351 1.345 1.000 1.001 1.090 0.956 0.980 0.981 1.046 0.971 1.084 1.657 0.945 200 2.118 1.314 1.309 1.000 1.000 1.055 0.955 0.977 0.977 1.015 0.970 1.029 1.416 0.942 2 4 50 1.502 1.111 1.108 1.000 1.003 1.054 0.901 0.936 0.939 0.973 0.929 0.957 1.026 0.888 100 1.503 1.077 1.074 1.000 1.001 1.029 0.893 0.933 0.933 0.951 0.928 0.944 0.962 0.876 200 1.500 1.052 1.051 1.000 1.000 1.013 0.888 0.928 0.927 0.935 0.927 0.935 0.906 0.868 10 50 1.674 1.238 1.235 1.000 1.001 1.092 0.955 0.975 0.977 1.044 0.968 1.056 1.359 0.949 100 1.675 1.200 1.195 1.000 1.000 1.060 0.953 0.976 0.976 1.018 0.968 1.019 1.283 0.944 200 1.670 1.171 1.170 1.000 1.000 1.036 0.950 0.973 0.973 0.997 0.967 0.994 1.129 0.940 20 50 1.739 1.287 1.281 1.000 1.001 1.103 0.976 0.987 0.988 1.065 0.984 1.175 1.477 0.973 100 1.740 1.247 1.242 1.000 1.000 1.074 0.976 0.988 0.988 1.042 0.983 1.100 1.686 0.971 200 1.736 1.217 1.216 1.000 1.000 1.046 0.974 0.988 0.988 1.019 0.983 1.040 1.451 0.968 3 4 50 1.240 1.073 1.071 1.000 1.001 1.043 0.957 0.975 0.976 1.006 0.967 0.994 1.105 0.954 100 1.241 1.052 1.052 1.000 1.000 1.027 0.953 0.972 0.972 0.990 0.966 0.983 1.048 0.948 200 1.242 1.036 1.035 1.000 1.000 1.015 0.948 0.968 0.969 0.979 0.966 0.975 0.995 0.943 10 50 1.301 1.124 1.124 1.000 1.000 1.061 0.983 0.990 0.990 1.037 0.987 1.071 1.406 0.981 100 1.305 1.105 1.102 1.000 1.000 1.044 0.980 0.990 0.990 1.022 0.986 1.037 1.324 0.978 200 1.305 1.092 1.087 1.000 1.000 1.028 0.978 0.989 0.989 1.009 0.985 1.012 1.181 0.975 20 50 1.324 1.144 1.143 1.000 1.000 1.064 0.991 0.995 0.995 1.044 0.993 1.181 1.515 0.990 100 1.327 1.124 1.121 1.000 1.000 1.048 0.990 0.994 0.994 1.031 0.993 1.107 1.691 0.988 200 1.328 1.112 1.106 1.000 1.000 1.035 0.989 0.995 0.995 1.021 0.993 1.055 1.490 0.987 4 4 50 1.546 1.152 1.152 1.000 0.981 1.001 0.901 0.937 0.915 0.902 0.905 0.896 0.910 0.849 100 1.542 1.114 1.114 1.000 0.978 0.977 0.895 0.933 0.909 0.877 0.905 0.881 0.829 0.836 200 1.543 1.087 1.087 1.000 0.977 0.965 0.889 0.928 0.904 0.864 0.903 0.873 0.762 0.826 10 50 1.734 1.287 1.287 1.000 0.971 0.975 0.956 0.976 0.947 0.913 0.938 0.908 1.089 0.899 100 1.730 1.253 1.253 1.000 0.970 0.939 0.953 0.975 0.945 0.878 0.937 0.870 0.976 0.889 200 1.731 1.221 1.221 1.000 0.970 0.919 0.951 0.974 0.943 0.857 0.937 0.851 0.824 0.882 20 50 1.785 1.325 1.325 1.000 0.967 0.948 0.978 0.988 0.954 0.900 0.950 0.931 1.144 0.918 100 1.789 1.293 1.293 1.000 0.967 0.906 0.976 0.988 0.954 0.862 0.949 0.865 1.202 0.910 200 1.778 1.261 1.261 1.000 0.966 0.877 0.974 0.988 0.954 0.832 0.949 0.818 0.993 0.903 5 4 50 1.539 1.099 1.099 1.000 0.978 1.019 0.881 0.920 0.911 0.939 0.901 0.924 0.985 0.857 100 1.547 1.077 1.069 1.000 0.977 0.996 0.871 0.916 0.905 0.916 0.900 0.912 0.924 0.844 200 1.545 1.049 1.046 1.000 0.976 0.983 0.867 0.910 0.900 0.904 0.901 0.906 0.873 0.838 10 50 1.750 1.260 1.260 1.000 0.988 1.075 0.946 0.970 0.963 1.025 0.954 1.035 1.322 0.934 100 1.744 1.216 1.216 1.000 0.987 1.041 0.944 0.970 0.962 1.000 0.953 1.000 1.251 0.929 200 1.744 1.181 1.181 1.000 0.986 1.018 0.937 0.966 0.958 0.979 0.952 0.977 1.105 0.921 20 50 1.830 1.325 1.321 1.000 0.994 1.102 0.971 0.984 0.981 1.060 0.976 1.158 1.467 0.965 100 1.829 1.283 1.272 1.000 0.993 1.064 0.969 0.985 0.980 1.031 0.975 1.082 1.626 0.961 200 1.838 1.245 1.238 1.000 0.993 1.040 0.968 0.984 0.979 1.013 0.975 1.033 1.431 0.959 6 4 50 1.836 1.488 1.488 1.000 0.940 0.935 0.922 0.949 0.868 0.854 0.869 0.841 0.883 0.813 100 1.824 1.443 1.443 1.000 0.936 0.912 0.912 0.945 0.859 0.830 0.866 0.826 0.820 0.800 200 1.821 1.414 1.414 1.000 0.936 0.901 0.905 0.941 0.855 0.817 0.867 0.820 0.770 0.792 10 50 2.202 1.782 1.782 1.000 0.963 1.011 0.962 0.978 0.932 0.964 0.928 0.965 1.243 0.897 100 2.198 1.740 1.740 1.000 0.961 0.976 0.959 0.979 0.930 0.936 0.927 0.933 1.164 0.890 200 2.179 1.698 1.698 1.000 0.961 0.956 0.955 0.976 0.927 0.917 0.927 0.915 1.030 0.887 20 50 2.348 1.903 1.903 1.000 0.981 1.065 0.979 0.988 0.966 1.030 0.962 1.097 1.432 0.947 100 2.343 1.849 1.849 1.000 0.978 1.027 0.978 0.989 0.963 0.998 0.959 1.039 1.581 0.940 200 2.335 1.815 1.815 1.000 0.975 0.999 0.976 0.989 0.959 0.974 0.957 0.989 1.371 0.936 Table 17 : AvgRelMAE for the simulation experiment (unbalanced panel of forecasts). Benchmark approach: ew. Bold entries identify the best performing approaches, italic entries identify the second best and red color denotes forecasts worse than the benchmark. Approach Sett. p N ew ow {}_{\text{var}} ow {}_{\text{cov}} scr {}_{\text{ew}} scr {}_{\text{var}} scr {}_{\text{cov}} occ {}_{\text{wls}} occ {}_{\text{bv}} occ {}_{\text{shr}} occ {}_{\text{be}} 1 4 50 1.000 1.031 1.479 0.903 1.053 1.122 0.897 0.927 0.898 0.892 100 1.000 1.024 1.341 0.903 1.032 1.114 0.893 0.922 0.893 0.885 200 1.000 1.010 1.191 0.902 1.002 1.090 0.890 0.921 0.889 0.880 10 50 1.000 1.220 2.999 0.943 1.276 1.492 0.943 0.967 0.943 0.941 100 1.000 1.216 2.924 0.940 1.250 1.488 0.933 0.959 0.933 0.928 200 1.000 1.183 2.688 0.940 1.190 1.464 0.929 0.955 0.929 0.923 20 50 1.000 1.351 4.250 0.973 1.426 1.797 0.983 0.997 0.983 0.981 100 1.000 1.335 4.405 0.974 1.385 1.814 0.971 0.986 0.971 0.968 200 1.000 1.287 4.077 0.973 1.302 1.709 0.962 0.979 0.962 0.958 2 4 50 1.000 1.022 1.396 0.928 1.031 1.076 0.921 0.947 0.923 0.919 100 1.000 1.020 1.314 0.929 1.022 1.077 0.918 0.944 0.920 0.914 200 1.000 1.013 1.191 0.927 1.008 1.067 0.916 0.943 0.916 0.910 10 50 1.000 1.147 2.536 0.963 1.173 1.316 0.961 0.980 0.961 0.960 100 1.000 1.145 2.470 0.962 1.161 1.317 0.954 0.975 0.954 0.952 200 1.000 1.129 2.088 0.961 1.133 1.260 0.950 0.973 0.950 0.947 20 50 1.000 1.226 3.433 0.985 1.259 1.518 0.989 1.000 0.989 0.989 100 1.000 1.221 3.561 0.986 1.245 1.537 0.982 0.993 0.982 0.981 200 1.000 1.199 3.475 0.986 1.206 1.512 0.976 0.988 0.976 0.974 3 4 50 1.000 1.321 1.824 0.969 1.377 1.459 0.961 0.979 0.964 0.961 100 1.000 1.325 1.862 0.969 1.360 1.479 0.958 0.977 0.961 0.958 200 1.000 1.313 1.852 0.966 1.328 1.498 0.957 0.977 0.963 0.957 10 50 1.000 1.462 2.819 0.988 1.523 1.647 0.984 0.997 0.984 0.984 100 1.000 1.462 2.712 0.986 1.503 1.619 0.979 0.994 0.979 0.979 200 1.000 1.437 2.256 0.988 1.455 1.506 0.977 0.992 0.977 0.977 20 50 1.000 1.527 3.547 0.997 1.594 1.801 0.997 1.004 0.997 0.997 100 1.000 1.514 3.682 0.998 1.563 1.798 0.992 0.998 0.992 0.992 200 1.000 1.482 3.599 0.999 1.504 1.755 0.990 0.998 0.990 0.990 4 4 50 1.000 0.999 1.343 0.922 1.008 1.049 0.912 0.944 0.914 0.909 100 1.000 1.001 1.277 0.922 1.004 1.049 0.909 0.943 0.911 0.904 200 1.000 0.993 1.130 0.921 0.988 1.032 0.906 0.940 0.908 0.900 10 50 1.000 1.129 2.507 0.956 1.155 1.290 0.948 0.981 0.948 0.947 100 1.000 1.126 2.388 0.956 1.141 1.283 0.941 0.977 0.941 0.938 200 1.000 1.114 2.072 0.955 1.119 1.240 0.937 0.973 0.937 0.933 20 50 1.000 1.214 3.456 0.982 1.248 1.500 0.976 1.002 0.976 0.975 100 1.000 1.206 3.482 0.981 1.230 1.519 0.966 0.992 0.966 0.964 200 1.000 1.186 3.329 0.981 1.193 1.452 0.960 0.989 0.960 0.957 5 4 50 1.000 0.989 1.346 0.916 0.998 1.040 0.904 0.943 0.906 0.901 100 1.000 0.986 1.251 0.915 0.988 1.038 0.899 0.942 0.900 0.895 200 1.000 0.982 1.136 0.915 0.977 1.030 0.899 0.942 0.899 0.892 10 50 1.000 1.120 2.421 0.953 1.145 1.292 0.946 0.981 0.946 0.945 100 1.000 1.118 2.349 0.953 1.134 1.280 0.938 0.976 0.938 0.936 200 1.000 1.105 2.083 0.950 1.109 1.248 0.933 0.971 0.933 0.930 20 50 1.000 1.212 3.480 0.979 1.246 1.514 0.981 1.001 0.981 0.980 100 1.000 1.204 3.568 0.980 1.228 1.533 0.971 0.991 0.971 0.969 200 1.000 1.186 3.461 0.980 1.193 1.496 0.965 0.988 0.965 0.963 6 4 50 1.000 0.871 1.212 0.848 0.870 0.904 0.850 0.965 0.852 0.840 100 1.000 0.869 1.099 0.847 0.864 0.899 0.846 0.961 0.842 0.830 200 1.000 0.863 0.997 0.844 0.853 0.884 0.844 0.957 0.835 0.826 10 50 1.000 1.016 2.396 0.893 1.036 1.180 0.897 1.006 0.897 0.891 100 1.000 1.013 2.297 0.891 1.025 1.176 0.886 1.000 0.886 0.878 200 1.000 1.005 2.055 0.893 1.007 1.163 0.884 0.998 0.884 0.875 20 50 1.000 1.143 3.443 0.945 1.175 1.459 0.954 1.024 0.954 0.952 100 1.000 1.135 3.527 0.942 1.155 1.469 0.940 1.011 0.940 0.936 200 1.000 1.118 3.310 0.941 1.125 1.410 0.932 1.005 0.932 0.927 Table 18 : AvgRelMSE for the simulation experiment (unbalanced panel of forecasts). Benchmark approach: ew. Bold entries identify the best performing approaches, italic entries identify the second best and red color denotes forecasts worse than the benchmark. Approach Sett. p N ew ow {}_{\text{var}} ow {}_{\text{cov}} scr {}_{\text{ew}} scr {}_{\text{var}} scr {}_{\text{cov}} occ {}_{\text{wls}} occ {}_{\text{bv}} occ {}_{\text{shr}} occ {}_{\text{be}} 1 4 50 1.000 1.063 3.884 0.811 1.108 1.272 0.800 0.855 0.804 0.792 100 1.000 1.046 2.532 0.811 1.060 1.246 0.792 0.846 0.795 0.779 200 1.000 1.020 1.638 0.810 1.001 1.190 0.789 0.845 0.789 0.771 10 50 1.000 1.494 34.050 0.885 1.630 2.414 0.887 0.932 0.887 0.883 100 1.000 1.480 28.860 0.882 1.563 2.393 0.870 0.918 0.870 0.861 200 1.000 1.404 18.107 0.880 1.416 2.302 0.860 0.909 0.860 0.849 20 50 1.000 1.836 84.355 0.946 2.045 3.705 0.969 0.997 0.969 0.966 100 1.000 1.787 89.608 0.946 1.922 3.820 0.943 0.971 0.943 0.937 200 1.000 1.662 69.338 0.946 1.699 3.380 0.926 0.958 0.926 0.918 2 4 50 1.000 1.042 3.352 0.859 1.061 1.164 0.846 0.896 0.853 0.842 100 1.000 1.036 2.474 0.860 1.041 1.163 0.840 0.889 0.846 0.833 200 1.000 1.025 1.690 0.858 1.013 1.140 0.837 0.888 0.837 0.826 10 50 1.000 1.313 22.856 0.925 1.372 1.840 0.922 0.959 0.922 0.920 100 1.000 1.307 19.212 0.924 1.344 1.822 0.908 0.950 0.908 0.904 200 1.000 1.276 9.649 0.922 1.282 1.647 0.901 0.944 0.901 0.895 20 50 1.000 1.506 52.634 0.970 1.590 2.555 0.982 1.001 0.982 0.981 100 1.000 1.490 55.401 0.971 1.549 2.608 0.964 0.985 0.964 0.962 200 1.000 1.438 48.233 0.973 1.456 2.559 0.952 0.977 0.952 0.949 3 4 50 1.000 1.738 5.907 0.936 1.881 2.137 0.920 0.956 0.928 0.920 100 1.000 1.742 5.729 0.937 1.831 2.192 0.916 0.953 0.922 0.916 200 1.000 1.712 5.168 0.932 1.745 2.243 0.913 0.951 0.939 0.912 10 50 1.000 2.125 25.490 0.974 2.301 2.850 0.966 0.992 0.966 0.966 100 1.000 2.121 21.027 0.972 2.237 2.747 0.957 0.987 0.957 0.956 200 1.000 2.051 10.766 0.975 2.101 2.349 0.953 0.983 0.953 0.952 20 50 1.000 2.324 49.384 0.994 2.526 3.512 0.993 1.012 0.993 0.993 100 1.000 2.280 55.099 0.995 2.425 3.561 0.983 0.997 0.983 0.983 200 1.000 2.181 48.296 0.997 2.245 3.429 0.979 0.995 0.979 0.979 4 4 50 1.000 0.994 2.993 0.847 1.010 1.102 0.827 0.887 0.833 0.822 100 1.000 0.995 2.329 0.847 0.999 1.098 0.823 0.885 0.831 0.813 200 1.000 0.983 1.474 0.846 0.971 1.062 0.817 0.880 0.830 0.806 10 50 1.000 1.272 22.092 0.910 1.331 1.751 0.898 0.960 0.898 0.894 100 1.000 1.264 17.674 0.911 1.298 1.731 0.883 0.952 0.883 0.877 200 1.000 1.239 9.583 0.909 1.248 1.599 0.875 0.944 0.875 0.868 20 50 1.000 1.475 54.937 0.963 1.561 2.493 0.954 1.005 0.954 0.951 100 1.000 1.453 52.381 0.962 1.510 2.580 0.934 0.986 0.934 0.930 200 1.000 1.406 43.904 0.961 1.422 2.324 0.921 0.976 0.921 0.916 5 4 50 1.000 0.970 3.043 0.833 0.987 1.081 0.811 0.886 0.817 0.806 100 1.000 0.963 2.197 0.833 0.968 1.074 0.804 0.882 0.806 0.795 200 1.000 0.958 1.509 0.832 0.946 1.055 0.801 0.881 0.810 0.789 10 50 1.000 1.251 19.939 0.904 1.307 1.778 0.893 0.959 0.893 0.890 100 1.000 1.244 16.563 0.904 1.278 1.719 0.877 0.949 0.877 0.873 200 1.000 1.216 9.717 0.899 1.224 1.625 0.867 0.941 0.867 0.861 20 50 1.000 1.472 54.645 0.960 1.554 2.538 0.964 1.003 0.964 0.962 100 1.000 1.449 56.087 0.960 1.507 2.644 0.943 0.983 0.943 0.941 200 1.000 1.407 48.361 0.959 1.424 2.483 0.931 0.977 0.931 0.927 6 4 50 1.000 0.765 2.523 0.726 0.763 0.831 0.726 0.934 0.736 0.708 100 1.000 0.760 1.705 0.724 0.751 0.818 0.718 0.925 0.713 0.693 200 1.000 0.751 1.171 0.719 0.733 0.790 0.714 0.917 0.703 0.683 10 50 1.000 1.034 20.803 0.799 1.074 1.478 0.805 1.013 0.805 0.795 100 1.000 1.027 17.133 0.795 1.050 1.462 0.787 0.998 0.787 0.773 200 1.000 1.010 10.024 0.796 1.013 1.416 0.780 0.992 0.780 0.763 20 50 1.000 1.312 55.538 0.894 1.387 2.407 0.915 1.053 0.915 0.910 100 1.000 1.292 57.402 0.889 1.338 2.440 0.887 1.025 0.887 0.878 200 1.000 1.256 44.016 0.888 1.270 2.207 0.870 1.010 0.870 0.862 Appendix F MCB Nemenyi test Figure 5 : MCB Nemenyi test for the electricity generation dataset using the MSE (first row) and MAE (second row) at different forecast horizon ( h=1,...,7 for the first column and h=1 for the second column). In each panel, the Friedman test p-value is reported in the lower-right corner. The mean rank of each approach is shown to the right of its name. Statistically significant differences in performance are indicated if the intervals of two forecast reconciliation procedures do not overlap. Thus, approaches that do not overlap with the green interval are considered significantly worse than the best, and vice versa. Appendix G Extended figures and tables Table 19 : AvgRelMAE of daily forecasts for the Australian electricity generation dataset for all, upper and bottom time series. Benchmark approach: ew. Bold entries identify the best performing approaches, italic entries identify the second best and red color denotes forecasts worse than the benchmark. Forecast horizon Approach 1 2 3 4 5 6 7 1:7 All 23 time series Base (incoherent forecasts) stlf 1.0697 1.0737 1.0996 1.1029 1.0806 1.0672 1.0801 1.0830 arima 1.0561 1.0650 1.0501 1.0426 1.0459 1.0414 1.0339 1.0471 tbats 1.0447 1.0515 1.0348 1.0266 1.0305 1.0288 1.0201 1.0331 Single model reconciliation stlf {}_{\text{shr}} 1.0618 1.0696 1.0970 1.1001 1.0776 1.0625 1.0758 1.0788 arima {}_{\text{shr}} 1.0512 1.0546 1.0334 1.0241 1.0232 1.0237 1.0182 1.0311 tbats {}_{\text{shr}} 1.0320 1.0413 1.0231 1.0134 1.0212 1.0208 1.0188 1.0235 Combination (incoherent forecasts) ew 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 2 1.0000 ow {}_{\text{var}} 0.9927 0.9921 0.9982 0.9983 0.9967 0.9967 0.9990 0.9965 ow {}_{\text{cov}} 1.0216 1.0208 1.0390 1.0423 1.0307 1.0250 1.0325 1.0309 Coherent combination src 0.9939 0.9941 0.9919 0.9895 0.9887 0.9908 0.9933 0.9915 scr {}_{\text{ew}} 0.9952 0.9959 0.9911 0.9908 0.9908 0.9932 0.9961 0.9930 scr {}_{\text{var}} 0.9819 0.9803 0.9869 0.9895 0.9887 0.9913 0.9972 0.9882 scr {}_{\text{cov}} 1.0081 1.0081 1.0270 1.0327 1.0245 1.0197 1.0250 1.0215 occ {}_{\text{bv}} 1.0157 1.0162 1.0344 1.0415 1.0289 1.0229 1.0283 1.0275 occ {}_{\text{shr}} 1.0061 1.0111 1.0262 1.0325 1.0342 1.0335 1.0390 1.0269 occ {}_{\text{wls}} 0.9885 0.9886 0.9956 0.9962 0.9945 0.9945 0.9975 0.9938 occ {}_{\text{be}} 0.9779 0.9745 0.9843 0.9852 0.9851 0.9880 0.9926 0.9843 8 upper time series Base (incoherent forecasts) stlf 1.0541 1.0736 1.1198 1.1272 1.1003 1.0785 1.0983 1.0953 arima 1.0900 1.0906 1.0664 1.0526 1.0568 1.0558 1.0439 1.0637 tbats 1.0662 1.0660 1.0423 1.0277 1.0366 1.0348 1.0219 1.0407 Single model reconciliation stlf {}_{\text{shr}} 1.0443 1.0654 1.1126 1.1224 1.0967 1.0753 1.0933 1.0893 arima {}_{\text{shr}} 1.0684 1.0694 1.0448 1.0324 1.0297 1.0300 1.0194 1.0401 tbats {}_{\text{shr}} 1.0379 1.0468 1.0316 1.0174 1.0299 1.0228 1.0177 1.0283 Combination (incoherent forecasts) ew 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1 1.0000 ow {}_{\text{var}} 0.9856 0.9864 0.9982 0.9988 0.9955 0.9943 0.9989 0.9945 ow {}_{\text{cov}} 1.0129 1.0191 1.0529 1.0588 1.0422 1.0292 1.0434 1.0385 Coherent combination src 0.9863 0.9911 0.9928 0.9918 0.9910 0.9891 0.9912 0.9904 scr {}_{\text{ew}} 0.9885 0.9923 0.9905 0.9913 0.9922 0.9909 0.9932 0.9912 scr {}_{\text{var}} 0.9663 0.9662 0.9841 0.9889 0.9894 0.9882 0.9986 0.9840 scr {}_{\text{cov}} 0.9912 0.9953 1.0316 1.0433 1.0334 1.0243 1.0345 1.0237 occ {}_{\text{bv}} 1.0026 1.0058 1.0410 1.0521 1.0371 1.0286 1.0372 1.0306 occ {}_{\text{shr}} 0.9810 0.9942 1.0256 1.0397 1.0374 1.0353 1.0454 1.0246 occ {}_{\text{wls}} 0.9774 0.9800 0.9967 0.9969 0.9959 0.9928 0.9959 0.9913 occ {}_{\text{be}} 0.9593 0.9610 0.9823 0.9849 0.9838 0.9842 0.9917 0.9791 15 bottom time series Base (incoherent forecasts) stlf 1.0781 1.0737 1.0890 1.0902 1.0703 1.0612 1.0704 1.0764 arima 1.0384 1.0517 1.0415 1.0372 1.0401 1.0337 1.0286 1.0384 tbats 1.0334 1.0438 1.0309 1.0260 1.0273 1.0256 1.0192 1.0290 Single model reconciliation stlf {}_{\text{shr}} 1.0712 1.0719 1.0888 1.0884 1.0676 1.0557 1.0666 1.0732 arima {}_{\text{shr}} 1.0421 1.0468 1.0273 1.0197 1.0197 1.0203 1.0175 1.0263 tbats {}_{\text{shr}} 1.0289 1.0384 1.0186 1.0112 1.0166 1.0197 1.0194 1.0210 Combination (incoherent forecasts) ew 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 ow {}_{\text{var}} 0.9965 0.9951 0.9982 0.9980 0.9973 0.9979 0.9990 0.9975 ow {}_{\text{cov}} 1.0263 1.0218 1.0316 1.0336 1.0246 1.0228 1.0266 1.0269 Coherent combination src 0.9979 0.9957 0.9915 0.9883 0.9875 0.9917 0.9944 0.9920 scr {}_{\text{ew}} 0.9988 0.9978 0.9914 0.9905 0.9900 0.9944 0.9976 0.9939 scr {}_{\text{var}} 0.9904 0.9878 0.9884 0.9898 0.9883 0.9929 0.9965 0.9905 scr {}_{\text{cov}} 1.0172 1.0150 1.0245 1.0271 1.0198 1.0172 1.0201 1.0204 occ {}_{\text{bv}} 1.0228 1.0218 1.0308 1.0358 1.0246 1.0198 1.0236 1.0258 occ {}_{\text{shr}} 1.0197 1.0203 1.0266 1.0288 1.0325 1.0325 1.0356 1.0282 occ {}_{\text{wls}} 0.9945 0.9933 0.9950 0.9958 0.9937 0.9955 0.9984 0.9952 occ {}_{\text{be}} 0.9879 0.9819 0.9853 0.9854 0.9859 0.9901 0.9931 0.9870 Table 20 : AvgRelMSE of daily forecasts for the Australian electricity generation dataset for all, upper and bottom time series. Benchmark approach: ew. Bold entries identify the best performing approaches, italic entries identify the second best and red color denotes forecasts worse than the benchmark. Forecast horizon Approach 1 2 3 4 5 6 7 1:7 All 23 time series Base (incoherent forecasts) stlf 1.1205 1.1629 1.2351 1.2494 1.2252 1.2151 1.2280 1.2146 arima 1.1106 1.1158 1.0842 1.0701 1.0741 1.0726 1.0615 1.0808 tbats 1.0796 1.0780 1.0445 1.0270 1.0322 1.0288 1.0142 1.0393 Single model reconciliation stlf {}_{\text{shr}} 1.1022 1.1512 1.2258 1.2418 1.2183 1.2051 1.2204 1.2045 arima {}_{\text{shr}} 1.0953 1.0904 1.0592 1.0398 1.0395 1.0433 1.0370 1.0532 tbats {}_{\text{shr}} 1.0478 1.0577 1.0304 1.0108 1.0219 1.0213 1.0116 1.0257 Combination (incoherent forecasts) ew 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 2 1.0000 ow {}_{\text{var}} 0.9840 0.9881 0.9995 1.0032 1.0020 1.0028 1.0054 0.9995 ow {}_{\text{cov}} 1.0279 1.0494 1.0972 1.1103 1.1009 1.0993 1.1055 1.0908 Coherent combination src 0.9827 0.9855 0.9863 0.9833 0.9852 0.9873 0.9911 0.9859 scr {}_{\text{ew}} 0.9875 0.9898 0.9859 0.9859 0.9885 0.9905 0.9962 0.9890 scr {}_{\text{var}} 0.9586 0.9683 0.9838 0.9942 0.9982 1.0017 1.0114 0.9910 scr {}_{\text{cov}} 1.0026 1.0287 1.0795 1.0972 1.0942 1.0913 1.0981 1.0773 occ {}_{\text{bv}} 1.0174 1.0420 1.0903 1.1056 1.0953 1.0915 1.0983 1.0834 occ {}_{\text{shr}} 0.9914 1.0201 1.0626 1.0813 1.0930 1.0972 1.1090 1.0713 occ {}_{\text{wls}} 0.9752 0.9810 0.9949 1.0012 1.0009 1.0015 1.0051 0.9960 occ {}_{\text{be}} 0.9481 0.9560 0.9754 0.9831 0.9891 0.9939 0.9993 0.9808 8 upper time series Base (incoherent forecasts) stlf 1.0772 1.1468 1.2474 1.2722 1.2344 1.2084 1.2267 1.2148 arima 1.1820 1.1781 1.1254 1.0947 1.0934 1.0978 1.0783 1.1143 tbats 1.1420 1.1319 1.0842 1.0533 1.0613 1.0573 1.0389 1.0744 Single model reconciliation stlf {}_{\text{shr}} 1.0549 1.1254 1.2294 1.2580 1.2232 1.1962 1.2165 1.1989 arima {}_{\text{shr}} 1.1473 1.1357 1.0925 1.0600 1.0507 1.0535 1.0415 1.0749 tbats {}_{\text{shr}} 1.0844 1.0924 1.0643 1.0367 1.0499 1.0417 1.0300 1.0529 Combination (incoherent forecasts) ew 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1 1.0000 ow {}_{\text{var}} 0.9668 0.9766 0.9981 1.0065 1.0037 1.0032 1.0079 0.9981 ow {}_{\text{cov}} 1.0004 1.0377 1.1091 1.1301 1.1107 1.0957 1.1062 1.0939 Coherent combination src 0.9730 0.9785 0.9864 0.9855 0.9862 0.9852 0.9906 0.9841 scr {}_{\text{ew}} 0.9800 0.9839 0.9839 0.9871 0.9898 0.9890 0.9975 0.9874 scr {}_{\text{var}} 0.9292 0.9466 0.9769 0.9978 1.0026 1.0033 1.0195 0.9875 scr {}_{\text{cov}} 0.9589 0.9974 1.0738 1.1029 1.0962 1.0825 1.0936 1.0679 occ {}_{\text{bv}} 0.9817 1.0163 1.0879 1.1151 1.1002 1.0878 1.0973 1.0783 occ {}_{\text{shr}} 0.9385 0.9883 1.0541 1.0837 1.0892 1.0861 1.1064 1.0590 occ {}_{\text{wls}} 0.9531 0.9618 0.9908 1.0042 1.0035 1.0015 1.0063 0.9919 occ {}_{\text{be}} 0.9117 0.9292 0.9664 0.9818 0.9857 0.9876 0.9971 0.9710 15 bottom time series Base (incoherent forecasts) stlf 1.1443 1.1716 1.2286 1.2375 1.2202 1.2186 1.2287 1.2145 arima 1.0744 1.0840 1.0628 1.0572 1.0639 1.0593 1.0526 1.0634 tbats 1.0477 1.0503 1.0240 1.0132 1.0170 1.0140 1.0013 1.0211 Single model reconciliation stlf {}_{\text{shr}} 1.1283 1.1652 1.2239 1.2332 1.2157 1.2099 1.2224 1.2075 arima {}_{\text{shr}} 1.0686 1.0670 1.0418 1.0291 1.0336 1.0379 1.0345 1.0417 tbats {}_{\text{shr}} 1.0287 1.0397 1.0127 0.9973 1.0073 1.0106 1.0020 1.0115 Combination (incoherent forecasts) ew 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 1.0000 ow {}_{\text{var}} 0.9934 0.9943 1.0003 1.0015 1.0011 1.0026 1.0041 1.0003 ow {}_{\text{cov}} 1.0429 1.0556 1.0910 1.0998 1.0957 1.1013 1.1051 1.0892 Coherent combination src 0.9880 0.9892 0.9863 0.9822 0.9847 0.9884 0.9913 0.9868 scr {}_{\text{ew}} 0.9916 0.9930 0.9870 0.9853 0.9878 0.9913 0.9955 0.9898 scr {}_{\text{var}} 0.9747 0.9801 0.9875 0.9923 0.9959 1.0009 1.0072 0.9928 scr {}_{\text{cov}} 1.0268 1.0457 1.0826 1.0942 1.0931 1.0961 1.1005 1.0824 occ {}_{\text{bv}} 1.0370 1.0559 1.0916 1.1006 1.0927 1.0935 1.0988 1.0862 occ {}_{\text{shr}} 1.0207 1.0375 1.0672 1.0801 1.0951 1.1032 1.1103 1.0779 occ {}_{\text{wls}} 0.9872 0.9914 0.9971 0.9996 0.9994 1.0016 1.0045 0.9982 occ {}_{\text{be}} 0.9682 0.9706 0.9802 0.9837 0.9909 0.9973 1.0005 0.9861 Figure 6 : Pairwise DM-test results for the Australian electricity generation dataset, evaluated using absolute loss (top panels) and quadratic loss (bottom panel) across different forecast horizons. The left panel corresponds to forecast horizon h=1 , while the right panel is for h=1,\dots,7 . Each cell reports the percentage of series for which the p -value of the DM-test is below 0.05 . Table 21 : Model Confidence Set results for the Australian electricity generation dataset, evaluated using absolute loss across different forecast horizons ( h=1 and h=1,\dots,7 ) and aggregation level (all, upper and bottom times series). Each cell reports the percentage of series for which that approach is in the Model Confidence Set across different thresholds ( \delta\in\{95\%,90\%,80\%\} ). h=1 h=1:7 Approach \delta=95\% \delta=90\% \delta=80\% \delta=95\% \delta=90\% \delta=80\% All 23 time series Base (incoherent forecasts) stlf 47.8 39.1 26.1 47.8 43.5 34.8 arima 60.9 60.9 56.5 73.9 73.9 69.6 tbats 69.6 65.2 56.5 87.0 87.0 82.6 Single model reconciliation stlf {}_{\text{shr}} 60.9 52.2 43.5 47.8 47.8 34.8 arima {}_{\text{shr}} 65.2 56.5 52.2 87.0 87.0 82.6 tbats {}_{\text{shr}} 91.3 87.0 73.9 87.0 87.0 82.6 Combination (incoherent forecasts) ew 91.3 91.3 82.6 95.7 91.3 91.3 ow {}_{\text{var}} 95.7 95.7 91.3 95.7 91.3 91.3 ow {}_{\text{cov}} 82.6 69.6 65.2 82.6 65.2 60.9 Coherent combination src 95.7 91.3 87.0 100.0 95.7 95.7 scr {}_{\text{ew}} 91.3 91.3 87.0 100.0 95.7 91.3 scr {}_{\text{var}} 100.0 100.0 95.7 95.7 95.7 95.7 scr {}_{\text{cov}} 82.6 78.3 78.3 78.3 73.9 73.9 occ {}_{\text{bv}} 91.3 73.9 69.6 69.6 69.6 56.5 occ {}_{\text{shr}} 82.6 82.6 69.6 69.6 65.2 65.2 occ {}_{\text{wls}} 100.0 95.7 87.0 91.3 91.3 91.3 occ {}_{\text{be}} 100.0 100.0 95.7 100.0 95.7 91.3 8 upper time series Base (incoherent forecasts) stlf 50.0 37.5 25.0 37.5 37.5 25.0 arima 37.5 37.5 37.5 62.5 62.5 50.0 tbats 50.0 50.0 50.0 87.5 87.5 87.5 Single model reconciliation stlf {}_{\text{shr}} 62.5 62.5 50.0 37.5 37.5 37.5 arima {}_{\text{shr}} 37.5 37.5 37.5 87.5 87.5 75.0 tbats {}_{\text{shr}} 87.5 75.0 62.5 87.5 87.5 87.5 Combination (incoherent forecasts) ew 87.5 87.5 87.5 100.0 100.0 100.0 ow {}_{\text{var}} 100.0 100.0 100.0 100.0 100.0 100.0 ow {}_{\text{cov}} 75.0 75.0 62.5 75.0 62.5 62.5 Coherent combination src 87.5 87.5 87.5 100.0 100.0 100.0 scr {}_{\text{ew}} 87.5 87.5 87.5 100.0 100.0 100.0 scr {}_{\text{var}} 100.0 100.0 100.0 100.0 100.0 100.0 scr {}_{\text{cov}} 87.5 87.5 87.5 75.0 75.0 75.0 occ {}_{\text{bv}} 87.5 87.5 87.5 62.5 62.5 62.5 occ {}_{\text{shr}} 87.5 87.5 87.5 62.5 62.5 62.5 occ {}_{\text{wls}} 100.0 100.0 87.5 100.0 100.0 100.0 occ {}_{\text{be}} 100.0 100.0 100.0 100.0 100.0 100.0 15 bottom time series stlf 46.7 40.0 26.7 53.3 46.7 40.0 arima 73.3 73.3 66.7 80.0 80.0 80.0 tbats 80.0 73.3 60.0 86.7 86.7 80.0 stlf {}_{\text{shr}} 60.0 46.7 40.0 53.3 53.3 33.3 arima {}_{\text{shr}} 80.0 66.7 60.0 86.7 86.7 86.7 tbats {}_{\text{shr}} 93.3 93.3 80.0 86.7 86.7 80.0 ew 93.3 93.3 80.0 93.3 86.7 86.7 ow {}_{\text{var}} 93.3 93.3 86.7 93.3 86.7 86.7 ow {}_{\text{cov}} 86.7 66.7 66.7 86.7 66.7 60.0 src 100.0 93.3 86.7 100.0 93.3 93.3 scr {}_{\text{ew}} 93.3 93.3 86.7 100.0 93.3 86.7 scr {}_{\text{var}} 100.0 100.0 93.3 93.3 93.3 93.3 scr {}_{\text{cov}} 80.0 73.3 73.3 80.0 73.3 73.3 occ {}_{\text{bv}} 93.3 66.7 60.0 73.3 73.3 53.3 occ {}_{\text{shr}} 80.0 80.0 60.0 73.3 66.7 66.7 occ {}_{\text{wls}} 100.0 93.3 86.7 86.7 86.7 86.7 occ {}_{\text{be}} 100.0 100.0 93.3 100.0 93.3 86.7 Table 22 : Model Confidence Set results for the Australian electricity generation dataset, evaluated using quadratic loss across different forecast horizons ( h=1 and h=1,\dots,7 ) and aggregation level (all, upper and bottom times series). Each cell reports the percentage of series for which that approach is in the Model Confidence Set across different thresholds ( \delta\in\{95\%,90\%,80\%\} ). h=1 h=1:7 Approach \delta=95\% \delta=90\% \delta=80\% \delta=95\% \delta=90\% \delta=80\% All 23 time series Base (incoherent forecasts) stlf 60.9 52.2 17.4 43.5 43.5 26.1 arima 60.9 60.9 60.9 87.0 87.0 69.6 tbats 69.6 65.2 65.2 100.0 95.7 87.0 Single model reconciliation stlf {}_{\text{shr}} 69.6 60.9 47.8 52.2 47.8 34.8 arima {}_{\text{shr}} 56.5 56.5 56.5 100.0 100.0 95.7 tbats {}_{\text{shr}} 78.3 78.3 69.6 100.0 95.7 87.0 Combination (incoherent forecasts) ew 91.3 87.0 82.6 91.3 91.3 91.3 ow {}_{\text{var}} 100.0 95.7 87.0 95.7 91.3 91.3 ow {}_{\text{cov}} 87.0 82.6 69.6 82.6 73.9 56.5 Coherent combination src 95.7 91.3 91.3 95.7 95.7 91.3 scr {}_{\text{ew}} 95.7 91.3 91.3 95.7 95.7 91.3 scr {}_{\text{var}} 95.7 95.7 95.7 95.7 95.7 95.7 scr {}_{\text{cov}} 91.3 91.3 82.6 78.3 73.9 69.6 occ {}_{\text{bv}} 91.3 91.3 82.6 87.0 87.0 69.6 occ {}_{\text{shr}} 82.6 78.3 73.9 69.6 69.6 69.6 occ {}_{\text{wls}} 100.0 95.7 91.3 91.3 91.3 91.3 occ {}_{\text{be}} 100.0 95.7 95.7 95.7 95.7 91.3 8 upper time series Base (incoherent forecasts) stlf 62.5 62.5 12.5 50.0 50.0 37.5 arima 37.5 37.5 37.5 87.5 87.5 62.5 tbats 50.0 50.0 50.0 100.0 87.5 87.5 Single model reconciliation stlf {}_{\text{shr}} 75.0 75.0 50.0 62.5 50.0 37.5 arima {}_{\text{shr}} 37.5 37.5 37.5 100.0 100.0 100.0 tbats {}_{\text{shr}} 62.5 62.5 50.0 100.0 100.0 100.0 Combination (incoherent forecasts) ew 87.5 87.5 75.0 100.0 100.0 100.0 ow {}_{\text{var}} 100.0 100.0 87.5 100.0 100.0 100.0 ow {}_{\text{cov}} 87.5 75.0 62.5 87.5 87.5 62.5 Coherent combination src 87.5 87.5 87.5 100.0 100.0 100.0 scr {}_{\text{ew}} 87.5 87.5 87.5 100.0 100.0 100.0 scr {}_{\text{var}} 100.0 100.0 100.0 100.0 100.0 100.0 scr {}_{\text{cov}} 100.0 100.0 87.5 87.5 75.0 62.5 occ {}_{\text{bv}} 100.0 100.0 100.0 87.5 87.5 62.5 occ {}_{\text{shr}} 87.5 87.5 87.5 62.5 62.5 62.5 occ {}_{\text{wls}} 100.0 100.0 100.0 100.0 100.0 100.0 occ {}_{\text{be}} 100.0 100.0 100.0 100.0 100.0 100.0 15 bottom time series stlf 60.0 46.7 20.0 40.0 40.0 20.0 arima 73.3 73.3 73.3 86.7 86.7 73.3 tbats 80.0 73.3 73.3 100.0 100.0 86.7 stlf {}_{\text{shr}} 66.7 53.3 46.7 46.7 46.7 33.3 arima {}_{\text{shr}} 66.7 66.7 66.7 100.0 100.0 93.3 tbats {}_{\text{shr}} 86.7 86.7 80.0 100.0 93.3 80.0 ew 93.3 86.7 86.7 86.7 86.7 86.7 ow {}_{\text{var}} 100.0 93.3 86.7 93.3 86.7 86.7 ow {}_{\text{cov}} 86.7 86.7 73.3 80.0 66.7 53.3 src 100.0 93.3 93.3 93.3 93.3 86.7 scr {}_{\text{ew}} 100.0 93.3 93.3 93.3 93.3 86.7 scr {}_{\text{var}} 93.3 93.3 93.3 93.3 93.3 93.3 scr {}_{\text{cov}} 86.7 86.7 80.0 73.3 73.3 73.3 occ {}_{\text{bv}} 86.7 86.7 73.3 86.7 86.7 73.3 occ {}_{\text{shr}} 80.0 73.3 66.7 73.3 73.3 73.3 occ {}_{\text{wls}} 100.0 93.3 86.7 86.7 86.7 86.7 occ {}_{\text{be}} 100.0 93.3 93.3 93.3 93.3 86.7 Figure 7 : MCB Nemenyi test for the Australian electricity generation dataset using the MAE at different forecast horizon ( h=1,...,7 for the first column and h=1 for the second column). In each panel, the Friedman test p-value is reported in the lower-right corner. The mean rank of each approach is shown to the right of its name. Statistically significant differences in performance are indicated if the intervals of two forecast reconciliation procedures do not overlap. Thus, approaches that do not overlap with the green interval are considered significantly worse than the best, and vice versa. Figure 8 : MCB Nemenyi test for the Australian electricity generation dataset using the MSE at different forecast horizon ( h=1,...,7 for the first column and h=1 for the second column). In each panel, the Friedman test p-value is reported in the lower-right corner. The mean rank of each approach is shown to the right of its name. Statistically significant differences in performance are indicated if the intervals of two forecast reconciliation procedures do not overlap. Thus, approaches that do not overlap with the green interval are considered significantly worse than the best, and vice versa.