On Arbitrary Predictions from Equally Valid Models
Sarah Lockfisch, Kristian Schwethelm, Martin Menten, Rickmer Braren, Daniel Rückert, Alexander Ziller, Georgios Kaissis · 2025
Read On Arbitrary Predictions from Equally Valid Models by Sarah Lockfisch, Kristian Schwethelm, Martin Menten, Rickmer Braren, Daniel Rückert, Alexander Ziller, Georgios Kaissis (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-19408.txt.
Introduction
Sarah Lockfisch and co-authors warn in 2025 that equally good medical models can still split on one patient. Many models can fit the same data just as well yet call the same case in opposed ways, and the risk is poorly tracked in medicine.
Across tasks and model types, standard scores fail to crown one best model. A large share of calls hinge on chance choices made while building the model. Small groups of models, paired with a rule to hold back when they split, erase most of the split in practice. Bigger models also split less. The team urge group based care over single model calls.
Catalog record
| CREATOR | Sarah Lockfisch, Kristian Schwethelm, Martin Menten, Rickmer Braren, Daniel Rückert, Alexander Ziller, Georgios Kaissis |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-19408
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
On Arbitrary Predictions from Equally Valid Models Sarah Lockfisch, Kristian Schwethelm, Martin Menten, Rickmer Braren, Daniel Rückert, Alexander Ziller, Georgios Kaissis Abstract Model multiplicity refers to the existence of multiple machine learning models that describe the data equally well but may produce different predictions on individual samples. In medicine, these models can admit conflicting predictions for the same patient – a risk that is poorly understood and insufficiently addressed. In this study, we empirically analyze the extent, drivers, and ramifications of predictive multiplicity across diverse medical tasks and model architectures, and show that even small ensembles can mitigate/eliminate predictive multiplicity in practice. Our analysis reveals that (1) standard validation metrics fail to identify a uniquely optimal model and (2) a substantial amount of predictions hinges on arbitrary choices made during model development. Using multiple models instead of a single model reveals instances where predictions differ across equally plausible models – highlighting patients that would receive arbitrary diagnoses if any single model were used. In contrast, (3) a small ensemble paired with an abstention strategy can effectively mitigate measurable predictive multiplicity in practice; predictions with high inter-model consensus may thus be amenable to automated classification. While accuracy is not a principled antidote to predictive multiplicity, we find that (4) higher accuracy achieved through increased model capacity reduces predictive multiplicity. Our findings underscore the clinical importance of accounting for model multiplicity and advocate for ensemble-based strategies to improve diagnostic reliability. In cases where models fail to reach sufficient consensus, we recommend deferring decisions to expert review. keywords Model Multiplicity, Predictive Multiplicity, Rashomon Effect, Rashomon Set † † equal-contributors: These authors contributed equally to this work. † † equal-contributors: These authors contributed equally to this work. 1 Introduction and Prior Work Model multiplicity Black et al. 2022b describes the existence of many plausible models of the same dataset without a principled way to determine a single “true” model, reflecting the underlying uncertainty in how the data should be interpreted. 1 1 1 In theory, the Bayes optimal predictor represents the true solution, i.e., the model that minimizes expected loss with full knowledge of the data-generating distribution. However, this ideal predictor is not attainable in practice, as the true underlying distribution is unknown, and only finite data are available. In practice, multiple machine learning models can fit the same data equally well according to a given performance metric (e.g., loss or accuracy), yet may differ substantially in their internal structure (e.g., the value of their parameters) and, more critically, in their individual predictions. Yet for deployment, typically a single model is chosen -- commonly, without any consideration for other, equally valid and plausible model options. Using such an arbitrary 2 2 2 In contrast, selecting the/ a single best model would be non-arbitrary from the perspective of instrumental rationality : the model that performs as well as it can according to its own metric of success Citron and Pasquale 2014 . However, model multiplicity highlights the existence of multiple equally optimal models that yield different predictions for individual cases. In such scenarios, there is no self-interested reason to choose one optimal model over another Creel and Hellman 2022 . model is particularly problematic in high-stakes scenarios when other, equally well-performing models exist that produce different predictions on the same data point(s). If such a model is deployed in a clinical setting, a patient’s diagnosis – and ultimately their treatment – may depend on the randomness in the training rather than on relevant properties of the patient’s data, raising critical concerns about the justification of the model and its predictions. We illustrate the problem in Figure 1 . Figure 1: Predictive multiplicity in clinical decision-making. To illustrate, we assume multiple models ( Model 1 to n ) to evaluate a patient’s data. The individual models achieve similar on-average accuracy and are thus equally valid model options. However, these models may produce different predictions (e.g., low , medium , high ) for the same patient, which results in divergent treatment recommendations (e.g., monitor , hospital admission , ICU transfer ). As a consequence, the patient’s care pathway can vary markedly – ultimately resulting in an arbitrary treatment – depending on which specific model is deployed. Rather than relying on a single model, we can adopt an ensemble -based approach, i.e., relying on the predictions of multiple models. If there is sufficient consensus among models, decisions may be automated; cases with insufficient agreement can be flagged for expert review. The phenomenon of model multiplicity was first described by Breiman 2001 in 2001 as the Rashomon Effect . They observed that small perturbations in the training set for decision trees and different weight initializations for small neural networks can lead to different solutions while having approximately equal error rates. More recent work showed that model multiplicity is ubiquitous in modern machine learning and a key obstacle to reliable training models that behave as expected in deployment D’Amour et al. 2022 . The existence of multiple equally performing models is particularly relevant with respect to their effect and consequences in the real world. Several works highlight the opportunities that model multiplicity offers Rudin et al. 2024 , like the selection of fairer Dutta et al. 2020 ; Wick et al. 2019 , more interpretable Chen et al. 2018 , or more robust models D’Amour et al. 2022 without impairing predictive performance. Challenges arising from model multiplicity are, inter alia , the inconsistency of explanations Hancox-Li 2020 ; Pawelczyk et al. 2020 , the risk of fair-washing explanations Anders et al. 2020 or fairness metrics Black et al. 2024 , and predictive multiplicity Marx et al. 2020 ; Black et al. 2022b – the phenomenon of equally optimal models producing conflicting predictions. While predictive multiplicity may be irrelevant (e.g., in low-stakes settings) or even desirable (for avoiding systemic exclusion) Creel and Hellman 2022 in some cases, it poses a serious challenge to leveraging machine learning in medical applications: When decisions differ across equally valid models, outcomes can depend on random factors in training rather than on meaningful data characteristics, rendering such decisions effectively arbitrary. The arbitrariness of predictions can be analyzed using the Rashomon set Breiman 2001 , which comprises models that explain the data equally well. This set typically consists of models whose performance on a validation set is statistically indistinguishable, often measured by metrics such as average loss or accuracy. However, this approach relies on the assumption that validation performance reliably reflects generalization to the underlying data distribution. Jordan 2024 demonstrated that for CIFAR-10 Krizhevsky 2009 and ImageNet Deng et al. 2009 , models exhibiting significant variance across two test sets drawn from the same distribution show minimal variance on the underlying test distribution itself. The variability on the test sets in performance is largely due to finite-sample noise arising from the limited size of the test sets – a problem that becomes even more pronounced with smaller datasets. Unlike CIFAR-10 and ImageNet, which contain (tens of) thousands of validation and test samples, medical datasets are often substantially smaller due to privacy concerns, regulatory constraints, and the high cost of expert annotation Kaissis et al. 2020 . With such limited validation data, sampling variability can distort the composition