Prior-Agnostic Robust Forecast Aggregation
Zhi Chen, Cheng Peng, Wei Tang · 2026
Read Prior-Agnostic Robust Forecast Aggregation by Zhi Chen, Cheng Peng, Wei Tang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-24517.txt.
Introduction
Chen, Peng, and Tang design a simple closed-form rule for pooling expert forecasts. It works when the forecaster knows neither the shared prior nor even the range of possible outcomes. Their log-odds combiner pools reports in logit space and carries near-tight worst-case regret guarantees across three knowledge settings, including cases where experts see independent signals. It also sets a new mark in the classic binary setting and extends to forecasters whose marginal distributions are known.
Catalog record
| CREATOR | Zhi Chen, Cheng Peng, Wei Tang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 86663 |
| LICENSE | http://creativecommons.org/publicdomain/zero/1.0/ |
| RIGHTS | CC0 |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.24517
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Prior-Agnostic Robust Forecast Aggregation Zhi Chen, Cheng Peng, Wei Tang Abstract Robust forecast aggregation combines the predictions of multiple information sources to perform well in the worst case across all possible information structures. Previous work largely focuses on settings with a known binary state space, where the state is either 0 0 or 1 1 . We study prior-agnostic robust forecast aggregation in which the aggregator observes only experts’ reports, yet is ignorant of both the underlying joint information structure and the full prior, including the underlying state space. Unlike the standard model that fixes the binary state space { 0 , 1 } \{0,1\} , we allow the (binary) unknown state values to be arbitrary numbers in [ 0 , 1 ] [0,1] , so the same reported probability may correspond to very different realized outcome frequencies across environments. Our main contribution is a simple, explicit, closed-form log-odds aggregator that linearly pools forecasts in logit space, together with (nearly-)tight minimax-regret guarantees across three knowledge regimes. We first show that under conditionally independent (CI) signals, robust aggregation with an unknown state space is strictly harder than in the known-state setting by establishing a larger lower bound, and our aggregation rule can achieve worst-case regret of 0.0255 0.0255 . Along the way, we also characterize tight regret bounds for Blackwell-ordered structures and for general information structures. In the classical setting with known state space { 0 , 1 } \{0,1\} , our aggregator achieves regret strictly below 0.0226 0.0226 for CI structures. To the best of our knowledge, this is the first explicit closed-form aggregator that achieves a regret upper bound strictly less than 0.0226 0.0226 . Finally, we extend the model to allow the aggregator to additionally know each expert’s marginal forecast distribution; in this setting, with the CI structures, we show that a generalized log-odds rule achieves regret of 0.0228 0.0228 , and we complement this guarantee with a lower bound of 0.0225 0.0225 . 1 Introduction When checking tomorrow’s weather, reputable sources often sharply disagree on the likelihood of rain, leaving the downstream decision-maker unsure how to combine these multiple predictions into a single, reliable forecast. In practice, each expert (e.g., a forecasting service) forms their forecast based on observable covariates describing the current atmospheric state, such as pressure patterns, humidity levels, and radar signatures, which collectively encode a latent ‘‘likelihood of rain.’’ Importantly, these informational signals are generated from such features before the rain outcome is realized: they are informative about rain only through the underlying feature state, 1 1 1 For example, the weather forecasting service may observe a summary of atmospheric measurements, such as upstream radar reflectivity and local humidity profiles, which together provide a noisy cue about tomorrow’s rainfall. rather than being conditionally drawn from the eventual binary rain/no-rain outcome itself. The aggregator, however, typically observes only the experts’ reported probabilities, not the underlying features or the mapping from features to signals, while still hoping to choose an aggregation rule that performs well uniformly across all possible (and unknown) signal structures that could have produced the experts’ reports. If the features perfectly revealed whether it would rain, then the latent uncertainty collapses to a binary state space \{0,1\} , recovering the classic robust aggregation problem with a known state space. This problem was first studied in 3 and later extended by 16 ; 13 ; 11 . In reality, the features only partially predict rain, and because the aggregator does not observe them, they face a genuinely prior-agnostic robust aggregation problem in which the relevant “state” is the (unknown) latent likelihood encoded by those features, rather than a fixed and known binary variable. This same feature-outcome separation appears in many real-world applications. For example, election forecasters base their predictions on poll responses, turnout proxies, demographic composition, and economic indicators, not on the election outcome that will only be observed later; physicians form prognoses from symptoms, lab tests, imaging, and patient history, not from the future health outcome itself; and financial analysts recommend portfolios using earnings reports, macro signals, order flow, and risk exposures, not the realized returns. In each case, experts’ forecasts are best viewed as posterior beliefs induced by intermediate features, while the aggregator must reconcile conflicting posteriors without observing either those features or the experts’ information-generating processes. Motivated by the above observations, we generalize the robust forecast aggregation problem studied in 3 , which assumes a known and fixed binary state space \{0,1\} , to a setting in which the state space is unknown to the aggregator. More formally, we consider a stochastic environment in which there is an unobserved state that captures the underlying “situation” of the world relevant for predicting a binary outcome. Here, the state should be thought of as a latent driver of the outcome’s likelihood, such as an underlying atmospheric configuration that makes rain more or less likely, and, more generally, as any hidden condition that determines the event’s likelihood. To capture such latent uncertainty while keeping the model parsimonious, we allow the latent likelihood to take one of two (a priori unknown) states, drawn from an unknown prior distribution. The outcome is then generated conditionally on the realized state via a Bernoulli distribution, with a success probability equal to the likelihood encoded by that state. There are two experts, each observing a private signal stochastically related to the state through an unknown joint information structure, and then reporting a probabilistic forecast equal to their posterior belief about the outcome. The aggregator observes only the experts’ reported probabilities, and does not observe the state, the experts’ raw signals, the prior, or the signal generation process, and must map the pair of reports into a single forecast. We evaluate the aggregator’s performance by squared-error loss, and regret is defined relative to an omniscient Bayesian benchmark that knows the full environment and has access to the experts’ signals. Our goal is to design an aggregation function that achieves small worst-case regret uniformly over all priors (including the unknown states) and information structures (or a specified class of structures). 1.1 Our Contributions We initiate the study of prior-agnostic robust forecast aggregation with an unknown state space, motivated by settings in which experts’ reports are induced by latent feature states that are not directly observed by the aggregator. Relative to the classic robust aggregation model with a known binary state space, our formulation treats the “state” as an unknown latent likelihood that corresponds to the event/outcome probability. Our goal is to design an aggregation rule whose performance is uniformly good over all priors and information structures consistent with the experts’ reports, including uncertainty about the underlying state space itself. Our first technical contribution is a simple, explicit, closed-form log-odds aggregation function that linearly pools experts’ forecasts in logit space. In the setting of conditionally independent signals (i.e., experts’ signals are distributed independently conditional on the realized state), we provide a near-tight minimax regret bound: our aggregation function achieves worst-case regret 0.0255 ( Theorem 3.2 ), and we complement this upper bound by showing that the optimal scheme cannot do much better. In particular, we show a lower bound that no aggregation scheme can achieve regret below \nicefrac{{31}}{{1326}}\approx 0.0234 ( Theorem 3.4