From Abstract to Actionable: Pairwise Shapley Values for Explainable AI

Jiaxin Xu †, Hung Chau, Angela Burden · 2025

Read From Abstract to Actionable: Pairwise Shapley Values for Explainable AI by Jiaxin Xu †, Hung Chau, Angela Burden (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-12525.txt.

Introduction

Explaining a model's decision often means splitting credit among its inputs, and Shapley values do that splitting with fairness rules. Jiaxin Xu, Hung Chau, and Angela Burden find two flaws in common practice: the reference points used for comparison are abstract, and the calculations grow heavy. Their fix, Pairwise Shapley Values, grounds each explanation in a real comparison between two similar cases.

For a case under study, the method picks a nearby partner case and fills the gaps with single-value imputation, so the credit split reads as a contrast a person can follow. The approach works with any model and cuts the computing cost sharply. The team tests it on house prices, polymer properties, and drug discovery data, across both regression and classification tasks. Explanations stayed faithful while becoming easier to grasp. The authors argue that anchoring explanations in pairs makes automated decisions easier to audit and trust.

Catalog record

CREATORJiaxin Xu †, Hung Chau, Angela Burden
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-12525

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

From Abstract to Actionable: Pairwise Shapley Values for Explainable AI Jiaxin Xu †, Hung Chau, Angela Burden Abstract Explainable AI (XAI) is critical for ensuring transparency, accountability and trust in machine learning systems as black-box models are increasingly deployed within high-stakes domains. Among XAI methods, Shapley values are widely used for their fairness and consistency axioms. However, prevalent Shapley value approximation methods commonly rely on abstract baselines or computationally intensive calculations, which can limit their interpretability and scalability. To address such challenges, we propose Pairwise Shapley Values, a novel framework that grounds feature attributions in explicit, human-relatable comparisons between pairs of data instances proximal in feature space. Our method introduces pairwise reference selection combined with single-value imputation to deliver intuitive, model-agnostic explanations while significantly reducing computational overhead. Here, we demonstrate that Pairwise Shapley Values enhance interpretability across diverse regression and classification scenarios—including real estate pricing, polymer property prediction, and drug discovery datasets. We conclude that the proposed methods enable more transparent AI systems and advance the real-world applicability of XAI. \textsuperscript{\textdagger} \textsuperscript{\textdagger} footnotetext: This work was done during Jiaxin Xu’s internship at Zillow Group. Keywords : Explainable AI, Model Interpretability, Model-Agnostic Explanations, Feature Attribution, Shapley Values 1 Main With the rapid advancement and widespread adoption of increasingly complex artificial intelligence (AI) black-box models across diverse applications, ensuring model outputs are transparent and understandable is becoming crucial, particularly when they have the potential to significantly impact people’s lives. Consequently, Explainable Artificial Intelligence (XAI) has become an essential component of modern machine learning (ML) [ 1 , 2 , 3 ] . The importance of XAI centers around three key aspects: (i) building user understanding and trust, (ii) promoting stakeholder accountability by making AI systems auditable, and (iii) supporting adherence to legal requirements and fairness standards [ 4 , 5 , 6 ] . Among diverse XAI methods [ 1 , 2 , 3 , 4 , 5 , 6 ] , feature attribution [ 7 , 8 , 9 ] plays a pivotal role by identifying and quantifying the contribution of individual input features to a model’s output, clarifying their influence on model predictions at both global and local levels. A common subset of feature attribution is additive feature attribution, where the attribution quantities sum to a specific value, such as the model’s prediction [ 10 ] . Shapley values, derived from cooperative game theory [ 11 ] , are recognized for their mathematical fairness and consistency in assigning contributions to features by evaluating all possible combinations [ 12 ] . To unify additive feature attribution methods, Lundberg and Lee [ 10 ] introduced SHAP (SHapley Additive exPlanations), a framework that satisfies desirable properties like consistency and local accuracy, making it effective for interpreting models of increasing complexity. Despite their theoretical appeal, Shapley value estimation methods in XAI face significant challenges in practical interpretability. Traditional explanations based on feature attribution can be complex and difficult for users to interpret. For instance, as shown in Fig. 1 , traditional feature attribution explanation is inherently implicit , as it often relies on sampling from empirical feature distributions using reference explicands \textit{{X}}^{\prime} (also referred to as the background dataset) [ 10 ] . This opacity stems from the abstract baseline value \mathbb{E}[f(\textit{{X}}^{\prime})] , which represents the feature attribution when no features of target explicand x are known. Additionally, Shapley values for individual features, such as x_{1} ( \phi_{1} ), are computed from expectations based on the empirical feature distribution ( \mathbb{E}[f(\textit{{X}}^{\prime})\mid\textit{{X}}^{\prime}_{:,1}=x_{1}] ), obscuring the specific reference values. This abstraction makes it difficult to relate explanations to tangible comparisons, limiting their practical utility. Furthermore, while the Shapley value is uniquely defined by certain axioms [ 11 ] , its application in model explanation varies based on how the model, training data, and explanation context are utilized, leading to inconsistent outputs which challenges the applicability of its theoretical uniqueness [ 12 ] . Additionally, Shapley value methods often face a trade-off between being true to the model (e.g., marginal Shapley values) and being true to the data (e.g., conditional Shapley values), complicating the attribution process and further reducing interpretability [ 13 ] . These challenges underscore the need for a more intuitive and accurate feature attribution method that balances model fidelity with human interpretability. Figure 1: Shapley value attribution comparison between traditional implicit methods using empirical feature distributions and the proposed explicit pair selection method. In cognitive psychology, analogical reasoning refers to the process by which individuals understand novel situations by relating them to similar and familiar ones, thereby facilitating learning and problem-solving [ 14 , 15 ] . For example, in real estate valuation, homes are valued via a comparative market analysis (CMA) [ 16 , 17 , 18 ] . In a CMA, a property’s value (the subject home) is estimated by comparing it to recently sold properties with similar attributes (comparable homes), such as location, size, and condition. To determine a fair market price for the subject home, the sale price of the comparable home is adjusted for differences in amenities, location and time. Similarly, in drug design, the concept of a “comparable reference” can be applied in developing HIV treatments. Comparisons often focus on protease inhibitors sharing a common functional group essential for activity. Once this critical functional group is established, medicinal chemists can systematically modify other parts of the molecule to enhance efficacy, selectivity, and pharmacokinetics. Inspired by these human evaluative strategies, our proposed Pairwise Shapley Value method introduces a tangible reference point into the feature attribution process (Fig. 1 ). By selecting a comparable baseline from the background dataset that closely matches the target explicand, the pairwise method assigns attributions to the differences in feature values between the target explicand and its reference. Pairwise Shapley values are explicit as they ground explanations in concrete, relatable comparisons, mimicking the human decision process. Furthermore, by conditioning on certain important features in the input space, the risk of generating off-manifold data is reduced and complex feature interactions are eliminated, leading to simpler and more intuitive explanations. In summary, our key contributions are: • Pairwise Shapley Values, a novel Shapley values-based approach that enhances human-relatable explainability through pairwise comparisons, offering greater interpretability, computational efficiency, and robustness. • Extensive benchmarking of Pairwise Shapley Values against prevalent Shapley-based post-hoc explainability methods, evaluated on real-world datasets spanning real estate pricing, polymer property prediction, and drug discovery. 2 Related Work 2.1 Feature Attribution Methods Feature attribution methods quantify individual feature contributions to an ML model’s prediction, either locally (for specific instances) or globally (aggregated across all predictions). Additive feature attribution methods, which sum feature contributions to a specific value, such as the model’s output, are notable for their clear and interpretable decomposition of predictions. Feature attribution methods can be categorized into (i) model-agnostic methods, which generate explanations by sampling predictions from a black-box model. This includes method such as LIME (Local Interpretable Model-agnostic Explanations) [ 19 , 20 , 21 , 22 ] , SHAP [ 10 , 21 , 22 ] and Shapley sampling values [ 23 ] ; and (ii) model-dependent methods, which leverages the specific ML model architecture. This includes techniques such as using linear models, Saliency Maps [ 24 , 25 , 26 ,

Read the complete text