Bayesian Modal Regression for Forecast Combinations

Henry D. van Eijk, Sujit K. Ghosh · 2025

Read Bayesian Modal Regression for Forecast Combinations by Henry D. van Eijk, Sujit K. Ghosh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-03859.txt.

Introduction

Van Eijk and Ghosh bring modal regression into forecast combination, in a statistics paper from 2025. Combining forecasts is a standard way to improve predictions, and equal weights are often defended as a safe choice. That defense rests on symmetric loss, yet real forecast errors are often lopsided and heavy-tailed.

Modal regression aims at the most likely value rather than the average, which suits skewed errors better. The authors build a Bayesian layered model with weights that shift over time and fade past data. They try three skewed error forms, led by the asymmetric Laplace. Tests on made-up data checked the fitting, and a real set of analyst forecasts came next. The modal method beat mean regression on hit rate and win rate for revenue surprise calls.

Catalog record

CREATORHenry D. van Eijk, Sujit K. Ghosh
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE70 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-03859

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bayesian Modal Regression for Forecast Combinations Henry D. van Eijk, Sujit K. Ghosh Abstract Forecast combination methods have traditionally emphasized symmetric loss functions, particularly squared error loss, with equally weighted combinations often justified as a robust approach under such criteria. However, these justifications do not extend to asymmetric loss functions, where optimally weighted combinations may provide superior predictive performance. This study introduces a novel contribution by incorporating modal regression into forecast combinations, offering a Bayesian hierarchical framework that models the conditional mode of the response through combinations of time-varying parameters and exponential discounting. The proposed approach utilizes error distributions characterized by asymmetry and heavy tails, specifically the asymmetric Laplace, asymmetric normal, and reverse Gumbel distributions. Simulated data validate the parameter estimation for the modal regression models, confirming the robustness of the proposed methodology. Application of these methodologies to a real-world analyst forecast dataset shows that modal regression with asymmetric Laplace errors outperforms mean regression based on two key performance metrics: the hit rate, which measures the accuracy of classifying the sign of revenue surprises, and the win rate, which assesses the proportion of forecasts surpassing the equally weighted consensus. These results underscore the presence of skewness and fat-tailed behavior in forecast combination errors for revenue forecasting, highlighting the advantages of modal regression in financial applications. August 24, 2026 K eywords asymmetric loss functions \cdot Bayesian methods \cdot modal regression \cdot revenue forecasts \cdot rolling window forecasts 1 Introduction In the literature on forecast combinations, Timmermann (2006) and Lin et al. (2022) note that squared error loss is the most widely used loss function. Minimizing squared error loss, or more generally, mean squared error (MSE), is equivalent to minimizing the negative log-likelihood with a normality assumption for the error distribution. However, this assumption of normality for errors is not always supported in financial applications ( Tsay, 2005 , p. 14) , which is not surprising since financial data typically exhibit both asymmetry and fat tails; see Fama (1965) , Boothe and Glassman (1987) , Peiro (1999) , and Campisi et al. (2023) . When the normality assumption is violated, even after transformations such as the logarithmic transformation, an asymmetric error distribution may help to capture the asymmetry. Elliott and Timmermann (2004) note several asymmetric loss functions that are useful in forecast combinations: (i) lin-lin, (ii) asymmetric quadratic, and (iii) linex. Furthermore, Elliott and Timmermann (2004) support the idea that, with respect to MSE, the equally weighted combination may lead to better performance than the optimally weighted combination; however, they overturn these results with asymmetric loss functions for skewed error distributions. In order to find the optimally weighted combination with an asymmetric loss function, one could use direct optimization. However, this approach lacks measures of uncertainty. To overcome this limitation, consider a Bayesian hierarchical framework. This framework does not easily support setting a loss function as an optimization problem; thus, one must find an equivalent distribution for the errors. We connect the lin-lin, asymmetric quadratic, and linex loss functions to the asymmetric Laplace, asymmetric normal (a reparameterized split/two-piece normal distribution) and the reverse Gumbel distribution, respectively. Consequently, we show how these three error distributions relate to the quantile, expectile, and extreme value regressions. For each pair of the loss function and error distribution described above, we show that by fixing the value of the asymmetry parameter, minimizing the negative log-likelihood with respect to the location parameter is equivalent to minimizing the corresponding loss function. We present the derivations of these equivalences in Section 2 . It is well-known that minimizing mean absolute error (MAE) is equivalent to minimizing the negative log-likelihood under the assumption that the error distribution follows a Laplace distribution. The asymmetric Laplace distribution is an extension of the Laplace that can capture asymmetry. Since the asymmetric Laplace distribution can handle fat tails and asymmetry, Kozubowski and Podgórski (2001) note that it applies to financial data (e.g., currency exchange rates). Next, Wallis (2014) mentions that the financial industry has utilized the split/two-piece normal (the asymmetric normal in our case) since the 1990s. Specifically, the Bank of England used this distribution to release probabilistic forecasts of future inflation through its fan chart. Lastly, the reverse Gumbel distribution is not as well known as the Gumbel distribution. Both Gumbel distributions are advantageous in forecasting extreme events. Purohit and Lalit (2022) suggest that the Gumbel distribution is advantageous in option pricing. Liu et al. (2024a) extended the Gumbel distribution by introducing the flexible Gumbel to handle both the maxima (Gumbel) and minima (reverse Gumbel) cases. As shown in Section 2 , regression assuming that the error distribution follows an asymmetric Laplace, asymmetric normal, or reverse Gumbel is essentially a quantile, expectile, or extreme value regression, respectively. However, this result is only valid for a fixed value of the asymmetry parameter. What happens if we do not fix a value of the asymmetry parameter? By treating this parameter as a random variable (r.v.) in our Bayesian hierarchical framework and placing a prior distribution on it, the problems of quantile, expectile, and extreme value regression translate to modal regression since the interest is now to forecast the conditional mode of the response Y conditioned on X . This result is because these distributions all have their location parameter as the mode. Figure 1: Comparison of the mode, median, and mean for the asymmetric Laplace distribution density plot with \mu=0 , \sigma=1 , and \tau=0.2 . See ( 5 ) for the pdf definition. Our interest lies in modeling central tendency . Thus, we present why modal regression is advantageous over mean and median regression; see Jing and Cho (2025) as an example of modal regression outperforming both mean and median regression for COVID-19 data. For a simple illustration, consider Figure 1 that displays how the mode, median, and mean differ across an asymmetric distribution, specifically the asymmetric Laplace distribution. Notice that the mode is more robust as it is not pulled away from the center, unlike the mean and median when the distribution exhibits asymmetry. Another interesting takeaway is that the likelihood of the mode is approximately 0.15; meanwhile, the median is approximately 0.10, and the mean is approximately 0.075. This result indicates that the mode is approximately two times as likely as the mean and about one and a half times as likely as the median. Liu et al. (2024b) mention three benefits of modal regression over mean and median regression: (i) more robust to outliers, (ii) narrower prediction intervals, and (iii) better interpretability. Result (i) is beneficial in financial forecasting as outliers are common. For example, consider forecasting quarterly revenue—outliers could include revenues during COVID-19 or other periods of market uncertainty that present large deviations or asymmetry in the error distributions. Removing these outliers would be subjective and risks discarding valuable information. Next, modal regression exhibits narrower predictive intervals than mean and median regression when the error distribution is unimodal and skewed; see Yao and Li (2014) and Xiang and Yao (2022) . Lastly, the interpretability of modal regression may be ideal over mean or median regression since we can predict the most likely or most probable value instead of the mean or median value. To summarize, the conditional mode, as opposed to

Read the complete text