When Individually Calibrated Models Become Collectively Miscalibrated
Zhaohui Wang · 2026
Read When Individually Calibrated Models Become Collectively Miscalibrated by Zhaohui Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-18858.txt.
Introduction
Zhaohui Wang shows pooling predictors that are each well calibrated can still give a badly calibrated group decision. When agents are scored by the Brier rule and their beliefs move together, each best report understates the chance of a positive case. In one setup the false-negative rate grows more than sevenfold, with no planned coordination, from shared training data alone. A VCG-style rule rewarding added value instead lines up incentives, stays near-optimal on three real datasets, and holds up when data are scarce or hostile.
Catalog record
| CREATOR | Zhaohui Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 115511 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.18858
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
When Individually Calibrated Models Become Collectively Miscalibrated Zhaohui Wang Abstract Probabilistic prediction systems often aggregate probability estimates from multiple models into a single decision. A natural assumption is that if each model is individually calibrated, the aggregate prediction will also be well calibrated. We show that this assumption fails in multi-agent settings: individually calibrated predictors can become collectively miscalibrated when their predictions interact strategically—where “strategically” refers to the game-theoretic sense of Brier-optimal local response, not deliberate gaming or collusion, and arises naturally whenever agents are independently trained on overlapping data. This phenomenon affects multiple independent agents in federated healthcare, multi-vendor intrusion detection, and crowdsourced forecasting, where agents optimize their own objectives. Specifically, we prove that under Brier-score-based aggregation with positively correlated beliefs each agent’s individually optimal report systematically underestimates the positive-class probability, yielding a Price of Anarchy strictly greater than one whenever Cov ( b i , b j ) > 0 \mathrm{Cov}(b_{i},b_{j})>0 . At our canonical setting ( n = 5 n{=}5 agents, pairwise correlation ρ = 0.5 \rho{=}0.5 , base rate μ = 0.3 \mu{=}0.3 , threshold τ = 0.3 \tau{=}0.3 ) the empirically measured PoA in false-negative rate is 7.25 × 7.25\times (mean aggregate bias − 0.375 -0.375 ). In contrast, VCG-based aggregation, which rewards each agent’s marginal contribution to aggregate accuracy, achieves dominant-strategy incentive compatibility and the lowest empirical PoA among all mechanisms studied (PoA ≈ 1.0 × \approx 1.0\times ). On three real-world datasets (NSL-KDD, UNSW-NB15, Credit Card Fraud) with feature-partitioned agents, VCG provides the strongest robustness guarantees among the aggregation methods we evaluate, while maintaining comparable accuracy. In data-sparse regimes ( n ≤ 500 n\leq 500 ), VCG consistently outperforms stacking and majority voting; under adversarial agents, VCG maintains substantially lower false-negative rates than robust aggregation baselines. Adaptive weight updates further reduce false negatives by 20–22% under distribution shift, with O ( T ) O(\sqrt{T}) online regret guarantees. These results establish that how probabilistic predictions are aggregated matters as much as how well individual models are calibrated. 1 Introduction Probabilistic prediction plays a central role in modern machine learning systems. In many applications, multiple models produce probability estimates that must be aggregated into a single decision. Examples include ensemble forecasting, federated prediction systems, and multi-organization monitoring platforms ( Rajkomar et al. 2018 ; Tomašev et al. 2019 ) . A common assumption in probabilistic forecasting is that if each model is individually calibrated, their aggregate prediction will also be well calibrated ( Dawid 1982 ; Guo et al. 2017 ) . Proper scoring rules such as the Brier score ( Brier 1950 ; Gneiting and Raftery 2007 ) provide a principled foundation: they guarantee that each agent maximizes expected utility by reporting its true belief. Deep ensembles ( Lakshminarayanan et al. 2017 ) and Bayesian model averaging ( Wilson and Izmailov 2020 ) build on this assumption. This reasoning implicitly assumes that models behave independently. However, in many real deployments—including federated learning ( McMahan et al. 2017 ) —predictions originate from multiple independently optimized models, corresponding to different organizations, vendors, or federated participants, each tuned to its own local objective. Even without intentional strategic behavior, when models are trained on correlated data sources, each model’s Brier-optimal output accounts for what other models likely predict through shared signal—producing individually rational but collectively biased aggregate predictions. Since agents share training data, respond to the same distribution shifts, and may be tuned by teams with competing incentives ( Obermeyer et al. 2019 ) , individual calibration does not guarantee collective calibration . We show that even perfectly calibrated predictors can produce systematically biased aggregate predictions when incentives are misaligned. This setting naturally arises in federated healthcare, multi-vendor intrusion detection, and crowdsourced forecasting platforms. We formalize this gap using mechanism design ( Vickrey 1961 ; Clarke 1971 ; Groves 1973 ; Nisan et al. 2007 ) and show that the choice of aggregation mechanism determines whether the system remains well-calibrated under strategic interaction: 1. Collective miscalibration under proper scoring : When agents’ beliefs are positively correlated, Brier-optimal reports systematically underestimate positive-class probability. Theorem 4 establishes that the resulting Price of Anarchy is strictly greater than 1 whenever \mathrm{Cov}(b_{i},b_{j})>0 and \mu<\tfrac{1}{2} ; at our canonical operating point ( n{=}5 , \rho{=}0.5 , \mu{=}0.3 , \tau{=}0.3 ), this produces an empirically measured PoA of 7.25\times in aggregate false-negative rate. VCG achieves the lowest PoA among all mechanisms studied ( Sections 5.3 and 4 ). 2. Data efficiency and rare event detection : In low-data regimes (50–100 labeled samples), VCG achieves 68% lower false negative rates than neural aggregation ( Section 5.4 ) and 70% better rare-class recall than majority voting ( Section 5.5 ). 3. Robustness to distribution shift : Adaptive weight updates reduce false negatives by 20–22% under drift, with O(\sqrt{T}) regret guarantees ( Section 5.6 ). 4. General- n analysis : We empirically observe that collective miscalibration persists as more agents are added, and provide empirical evidence for a conjectured closed-form scaling law ( Section 4.1 ). Our contribution is a probabilistic analysis of prediction aggregation under strategic interaction, establishing that how probabilistic predictions are aggregated matters as much as how well individual models are calibrated. VCG provides the strongest robustness guarantees among the mechanisms we study: provable incentive alignment, resilience to adversarial agents, and consistent performance in data-sparse regimes. Figure 1 provides a visual summary. 2 Related Work Probabilistic calibration and scoring rules. Dawid 1982 and DeGroot and Fienberg 1983 established the framework for evaluating probabilistic forecasters. Gneiting and Raftery 2007 proved that proper scoring rules uniquely incentivize calibrated predictions. Guo et al. 2017 showed that modern neural networks are often miscalibrated, motivating post-hoc calibration methods. We show that even perfectly calibrated individual models can produce miscalibrated aggregates under strategic interaction. Ensemble methods and uncertainty. Dietterich 2000 surveys classical ensemble methods; Lakshminarayanan et al. 2017 proposed deep ensembles for uncertainty estimation; Wilson and Izmailov 2020 connect deep ensembles to Bayesian model averaging. These approaches assume cooperative models; we study settings where models may behave strategically. Mechanism design foundations. VCG ( Vickrey 1961 ; Clarke 1971 ; Groves 1973 ) and the Shapley value ( Shapley 1953 ) provide the algorithmic game-theory backbone of our approach; Nisan et al. 2007 give a textbook treatment. Miller et al. 2005 ; Liu and Chen 2017 ; Dawid and Skene 1979 develop related elicitation frameworks. We apply these tools to the inference-time aggregation problem where the cost of errors is asymmetric (false negatives far costlier than false positives), an asymmetry not captured by prior elicitation work. Probabilistic forecast aggregation and opinion pooling. The problem of combining probabilistic predictions has been studied extensively in the opinion-pooling literature ( Genest and Zidek 1986 ; Ranjan and Gneiting 2010 ) . The dominant families are linear pooling ( \hat{p}=\sum_{i}w_{i}m_{i} ; convex combinations preserve calibration under independence), logarithmic pooling ( \log\hat{p}\propto\sum_{i}w_{i}\log m_{i} ; equivalent to naive Bayes aggregation of log-odds), and the supra-Bayesian formulation that treats agents’ reports as data to be updated on. All three frameworks are axiomatically well-founded under the assumption of cooperative agents reporting their true beliefs; none of them model the situation we study, where each agent is individually calibrated but optimizes its own scoring objective and therefore may