Optimizing Forecast Combination Weights Using Exponentially Weighted Hit and Win Rate Losses

Henry D. van Eijk, Sujit K. Ghosh · 2025

Read Optimizing Forecast Combination Weights Using Exponentially Weighted Hit and Win Rate Losses by Henry D. van Eijk, Sujit K. Ghosh (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-20082.txt.

Introduction

Henry van Eijk and Sujit Ghosh improve how analyst forecasts are blended in a 2025 finance paper. Funds forecast company revenue by pooling many analysts, and a plain average is the usual pool. Two scores matter here: calling the sign of the revenue surprise right, and beating that plain average.

The authors fit blend weights directly to those two scores, using loss functions that weight recent calls more heavily and solving the fit by nonlinear programming. Missing analyst forecasts, a daily headache, get a Bayesian fill-in that respects the shape of the data. On real analyst records, the tailored blends beat both the plain average and standard linear mixes. The authors pitch the work to practitioners who must squeeze signal from patchy forecast panels without discarding partial information.

Catalog record

CREATORHenry D. van Eijk, Sujit K. Ghosh
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-20082

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Optimizing Forecast Combination Weights Using Exponentially Weighted Hit and Win Rate Losses Henry D. van Eijk, Sujit K. Ghosh Abstract Forecasting revenues by aggregating analyst forecasts is a fundamental problem in financial research and practice. A key objective in this context is to improve the accuracy of the forecast by optimizing two performance metrics: the hit rate, which measures the proportion of correctly classified revenue surprise signs, and the win rate, which quantifies the proportion of individual forecasts that outperform an equally weighted consensus benchmark. While researchers have extensively studied forecast combination techniques, two critical gaps remain: (i) the estimation of optimal combination weights tailored to these specific performance metrics and (ii) the development of Bayesian methods for handling missing or incomplete analyst forecasts. This paper proposes novel approaches to address these challenges. First, we introduce a method for estimating optimal forecast combination weights using exponentially weighted hit and win rate loss functions via nonlinear programming. Second, we develop a Bayesian imputation framework that leverages exponentially weighted likelihood methods to account for missing forecasts while preserving key distributional properties. Through extensive empirical evaluations using real-world analyst forecast data, we demonstrate that our proposed methodologies yield superior predictive performance compared to traditional equally weighted and linear combination benchmarks. These findings highlight the advantages of incorporating tailored loss functions and Bayesian inference in forecast combination models, offering valuable insights for financial analysts and practitioners seeking to improve revenue prediction accuracy. August 24, 2026 K eywords Bayesian methods \cdot nonlinear optimization \cdot revenue forecasts \cdot rolling window forecasts 1 Introduction In the financial industry, the U.S. Securities and Exchange Commission (SEC) mandates that publicly traded companies disclose their financial statements every quarter to ensure transparency and provide investors with key insights into their financial health. Anticipating these disclosures, financial analysts generate forecasts of fundamental financial metrics—such as earnings per share (EPS) and revenue—that serve as critical indicators of a company’s profitability and growth potential. In addition to these widely tracked metrics, analysts also forecast company-specific indicators, such as gross bookings for Uber or the number of video subscribers for Netflix ( Yahoo Finance, 2020 ) . These forecasts are pivotal in shaping market expectations, influencing investment decisions, and guiding corporate strategies. The financial media closely monitor these earnings announcements and assess company performance by comparing reported results against market expectations. A company either “beats” or “misses” expectations depending on whether its financial figures exceed or fall short of the forecasted consensus. The consensus forecast for a given metric, such as EPS or revenue, is typically computed as the average of all available analyst estimates. This equally weighted aggregation is a standard benchmark for evaluating forecast accuracy in the forecast combinations literature. However, equally weighting all analysts’ forecasts may not always be optimal, as individual analysts differ in expertise, methodologies, and access to proprietary information. This has led to growing interest in methods that optimally combine analyst forecasts to improve predictive performance. Generally, the goal of forecast combinations for a single point forecast is to optimally combine multiple forecasts to minimize some loss function \mathcal{L}(\cdot) . The equally weighted combination has been justified as a robust method because “(i) combination weights are equal and do not have to be estimated; (ii) simple averaging significantly reduces variance and bias by averaging out individual bias in many cases; and (iii) simple averaging should be considered when the uncertainty of weight estimation is taken into account” ( Wang et al., 2023 ) . However, the simple average (i.e., equally weighted combination) of heterogeneous variables is known to be suboptimal in reducing variance due to the following lemma. Lemma 1 . Let X_{1},\ldots,X_{m} be pairwise uncorrelated random variables with E(X_{j})=\mu\;\;\forall\;j and Var(X_{j})=\sigma_{j}^{2} for j=1,2,\ldots,m and weights \bm{\omega}=(\omega_{1},\ldots,\omega_{m})^{\prime} satisfying \bm{\omega}\in\mathcal{S}_{m}=\{\bm{\omega}\succeq\bm{0}:\bm{\omega}^{\prime}\bm{1}_{m}=1\} . Then E(\sum_{j=1}^{m}\omega_{j}X_{j})=\mu and Var(\sum_{j=1}^{m}\omega_{j}X_{j})\geq Var(\sum_{j=1}^{m}\omega^{*}_{j}X_{j}) where w^{*}_{j}=\frac{\frac{1}{\sigma^{2}_{j}}}{\sum_{k=1}^{m}\frac{1}{\sigma^{2}_{k}}} . Clearly, if the \sigma^{2}_{j} ’s are not all equal, then \omega^{*}_{j}\neq\frac{1}{m} for some j and hence Var(\sum_{j=1}^{m}\omega^{*}_{j}X_{j})<Var(\bar{X})=Var(\frac{1}{m}\sum_{j=1}^{m}X_{j}) . Therefore, the variance of some optimally weighted combinations is less than the variance of the equally weighted combination. The above lemma can be extended to correlated random variables as well. E.g., if Var(\bm{X})=\Sigma , where \bm{X}=(X_{1},\ldots,X_{m})^{\prime} is a vector of random variables with mean E(\bm{X})=\mu\bm{1}_{m} , then the optimal weight vector is obtained by solving the following quadratic programming problem: \bm{\omega}^{*}=\arg\min_{\bm{\omega}\in\mathcal{S}_{m}}\bm{\omega}^{\prime}\Sigma\bm{\omega}=\frac{1}{\bm{1}_{m}^{\prime}\Sigma^{-1}\bm{1}_{m}}\Sigma^{-1}\bm{1}_{m} if \Sigma^{-1}\bm{1}_{m},\succeq\bm{0} . Clearly, the above solution reduces to the solution given in the above lemma when \Sigma is a diagonal matrix (i.e., when X_{j} ’s are pairwise uncorrelated). Among many alternative methods of combining forecasts, choosing the best forecaster model is a common method where given m forecasters, only the “best” forecaster is considered (i.e., assigning a weight of one to them and zeros otherwise). However, previous literature has mentioned that the model does not perform well, such as Makridakis et al. (1982) , Makridakis and Winkler (1983) , Gupta and Wilton (1987) , and Hendry and Clements (2002) ( Timmermann, 2006 ) . Aside from the equally weighted combination and the best forecaster model, how can one produce an optimally weighted combination? The previous literature extensively focuses on minimizing the mean squared error (MSE) as Timmermann (2006) and Lin et al. (2022) mention the squared error loss as the typical loss function for forecast combinations. In addition, Stock and Watson (2001) and Aiolfi and Timmermann (2006) find strong evidence in favor of minimizing MSE in forecast combinations with macroeconomic data ( Timmermann, 2006 ) . In forecast combinations applications, specifically earnings and revenue forecasting, squared error loss may not be the ideal loss function. Bernard and Thomas (1989) introduced the concept of post-earnings announcement drift (PEAD), which Fink (2021) describes as “the drift of a firm’s stock price in the direction of the firm’s earnings surprise over an extended period of time”. Current literature has found minimal evidence against PEAD, also known as the earnings momentum effect, and Griffin et al. (2010) and Hung et al. (2015) find evidence of PEAD in both less and highly developed financial markets ( Fink, 2021 ) . Furthermore, Skinner and Sloan (2002) denote the earnings torpedo effect as the “fact that missing analysts’ forecasts [i.e., the consensus], even by small amounts, causes disproportionately large stock price declines \ldots it is the simple fact of an earnings disappointment that matters for investors \ldots rather than the magnitude of the disappointment”. Since forecasting whether a company will beat or miss consensus for a given metric is necessary, a loss function for binary classification may be ideal for such scenarios. To solve this problem, consider hit rate loss that aligns with Skinner and Sloan (2002) where we define a hit as correctly classifying whether the actual value beats (exceeds) or misses (fails to exceed) the analysts’ consensus estimate. This definition aligns with the revenue nowcasting company AKAnomics that defines a hit as when “both the AKAnomics estimate and the actual value came in on the same side of consensus ” (i.e., predicting the sign of the revenue surprise, predicting a beat/miss) ( Agrawal et al., 2023 ) . Furthermore, they note that “Confidence can be expressed through many metrics (e.g., historical errors, hit rates, forward returns). Our favorite metric for this purpose is the hit rate \ldots Without access to differentiated information, one shouldn’t expect

Read the complete text