Reconciling Predictive Multiplicity in Practice

Tina Behzad, Sílvia Casacuberta, Emily Ruth Diana, Alexander Williams Tolbert · 2025

Read Reconciling Predictive Multiplicity in Practice by Tina Behzad, Sílvia Casacuberta, Emily Ruth Diana, Alexander Williams Tolbert (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-16549.txt.

Introduction

Tina Behzad, Sílvia Casacuberta, Emily Diana, and Alexander Tolbert study what to do when equally good models disagree about a person, in a 2025 paper. Different models trained on the same data often give the same person different risk scores, a problem called predictive multiplicity. An earlier algorithm, Reconcile, uses a disagreement between two models to prove at least one of them wrong and improve it. The authors put that algorithm to work on five widely used fairness datasets.

The datasets cover criminal risk, crime rates, income, credit, and census outcomes. The study examines how reconciliation behaves in practice, where accuracy and fairness pull against each other. The work matters because a person's loan or bail outcome should not hinge on which good model a clerk happened to pick.

Catalog record

CREATORTina Behzad, Sílvia Casacuberta, Emily Ruth Diana, Alexander Williams Tolbert
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE105 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-16549

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Reconciling Predictive Multiplicity in Practice Tina Behzad, Sílvia Casacuberta, Emily Ruth Diana, Alexander Williams Tolbert Abstract Many machine learning applications predict individual probabilities, such as the likelihood that a person develops a particular illness. Since these probabilities are unknown, a key question is how to address situations in which different models trained on the same dataset produce varying predictions for certain individuals. This issue is exemplified by the model multiplicity (MM) phenomenon, where a set of comparable models yield inconsistent predictions. Roth, Tolbert, and Weinstein recently introduced a reconciliation procedure, the Reconcile algorithm , to address this problem. Given two disagreeing models, the algorithm leverages their disagreement to falsify and improve at least one of the models. In this paper, we empirically analyze the Reconcile algorithm using five widely-used fairness datasets: COMPAS, Communities and Crime, Adult, Statlog (German Credit Data), and the ACS Dataset. We examine how Reconcile fits within the model multiplicity literature and compare it to existing MM solutions, demonstrating its effectiveness. We also discuss potential improvements to the Reconcile algorithm theoretically and practically. Finally, we extend the Reconcile algorithm to the setting of causal inference, given that different competing estimators can again disagree on specific causal average treatment effect (CATE) values. We present the first extension of the Reconcile algorithm in causal inference, analyze its theoretical properties, and conduct empirical tests. Our results confirm the practical effectiveness of Reconcile and its applicability across various domains. 1 Introduction In recent years, as algorithms have increasingly been deployed in society to determine life-altering outcomes for individuals, a growing body of research has focused on studying the fairness and robustness properties of these predictors. However, many approaches implicitly assume that there is one unique predictor that is adequate for the given task and data. Recent work has started to pay closer attention to the problem of model multiplicity ( Marx et al. 2020 ) : what should we do when we have competing models that assign conflicting predictions to certain individuals? This issue is particularly significant in fairness-sensitive applications, such as loan approvals or predictions of criminal recidivism, where inconsistent individual predictions can lead to arbitrary and potentially discriminatory outcomes. The phenomenon is also known as the Rashomon effect ( Hsu and Calmon 2022 ; Breiman 2003 ) , which emphasizes the existence of multiple plausible models that explain the data equally well. Predictive multiplicity (PM), a subset of MM, specifically refers to the variability in the predictions of different models within the same accuracy threshold ( Marx et al. 2020 ) . Beyond machine learning, model multiplicity is an instance of the broader reference class problem , which is a fundamental challenge in probabilistic reasoning that arises has been extensively documented across several kinds of literature from philosophy to the causal inference literature ( Bolinger 2020 ; Gardiner 2018 ; Dahabreh et al. 2017 ; Roth et al. 2023 ) . The challenges that arise within the MM problem have also recently been explored in the legal domain, where it has been argued that entities should have a legal duty to search for the least discriminatory algorithm within the set of competing models ( Black et al. 2024 ; Laufer et al. 2024 ) . Recently, Roth and Tolbert proposed a new algorithm aimed at reconciling two predictors that agree on the underlying data but disagree on specific individual predictions: they showed that this is resolvable through an efficient reconciliation process that updates the two predictors such that their respective accuracies can only improve, and the two updated models approximately agree on their predictions of individual probabilities almost on the entire domain ( Roth et al. 2023 ) . Throughout this paper, we call this algorithm (formalized in Sections 3 and A ) Reconcile . While the Reconcile algorithm is theoretically able to resolve the predictive multiplicity problem among predictors that agree on the underlying data, the original paper by Roth et al. 2023 provides no empirical analysis of the efficacy of the reconciliation process in practice nor further exploration of the various ways in which the Reconcile algorithm can be used on actual predictors and datasets. Moreover, while the authors mention the connections of the Reconcile algorithm to the model multiplicity problem, they do not explicitly compare the Reconcile approach to the solutions and metrics that have been proposed in the MM literature. In this paper, we investigate the Reconcile algorithm in the context of the model multiplicity problem, and so our empirical studies are centered on previous works on the predictive multiplicity problem. Our contributions. We perform an in-depth analysis of the Reconcile algorithm. For the prediction setting (i.e., the usual PM setting), we provide the first implementation of the Reconcile algorithm and apply it to five of the most popular datasets in fair machine learning: COMPAS ( Larson et al. 2016 ) , Communities and Crime ( Redmond 2009 ) , Adult ( Becker and Kohavi 1996 ) , Statlog (German Credit Data) ( Hofmann 1994b ) , and the ACS Dataset from the Folktables package ( Ding et al. 2021 ) . For each of the datasets, we generate various model pairs with comparable accuracies but with disagreeing predictions using four different strategies. We then apply the Reconcile algorithm to each of the pairs and record the evolution of the square losses and the fraction of disagreement between the models throughout the iterations of the algorithm. Our results indicate that Reconcile offers a fast-converging solution to reduce disagreement between models to the point that the models become almost identical in all their predictions. Next, we compare Reconcile to the solutions previously proposed in the model multiplicity literature, clarifying the various conceptual connections and performing an empirical evaluation of the different methods. The various solutions proposed in the MM literature can roughly be divided into classes addressing two different goals: The first and main goal is to determine a way of choosing a single model m derived from a class \mathcal{M} of competing models in a non-arbitrary way. A second goal is to quantify the severity of the PM problem in a given class of models \mathcal{M} using different metrics. In this case, we do not necessarily wish to select a final model; we only want to quantify the degree of disagreement within the class \mathcal{M} . As we demonstrate in this paper, Reconcile is an extremely useful algorithm for both use cases. For the first goal, given a class of competing models \mathcal{M} , we propose a new model aggregation method based on the sequential application of the Reconcile algorithm, which we call sequential Reconcile , and compare it with the three solutions arising from the MM literature described in ( Black et al. 2022 ) . For the second goal, we describe different ways in which we can apply the Reconcile algorithm to a class \mathcal{M} of models by repeatedly applying the reconciliation process (since the Reconcile algorithm only takes as input two models at a time). Through this repeated application of the Reconcile algorithm, we obtain a new class \mathcal{M}^{\prime} of models that have undergone the reconciliation process. Next, we apply various metrics proposed in the predictive multiplicity literature to both \mathcal{M} and

Read the complete text