InstaSHAP: Interpretable Additive Models Explain Shapley Values Instantly

James Enouen, Yan Liu · 2025

Read InstaSHAP: Interpretable Additive Models Explain Shapley Values Instantly by James Enouen, Yan Liu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-14177.txt.

Introduction

James Enouen and Yan Liu speed up a dominant method for explaining model predictions in a 2025 study. SHAP explanations assign each input feature a fair share of a prediction, grounded in Shapley values from game theory. Computing them for every query is slow and their form can be hard to read. The authors stress a link the literature underplays: Shapley explanations and additive models are close relatives.

A variational view of that link yields models whose explanations are available instantly rather than by fresh computation. Fast, faithful explanations matter wherever a model's reasons must be shown at the moment of decision.

Catalog record

CREATORJames Enouen, Yan Liu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE118 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-14177

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

InstaSHAP: Interpretable Additive Models Explain Shapley Values Instantly James Enouen, Yan Liu Abstract In recent years, the Shapley value and SHAP explanations have emerged as one of the most dominant paradigms for providing post-hoc explanations of black-box models. Despite their well-founded theoretical properties, many recent works have focused on the limitations in both their computational efficiency and their representation power. The underlying connection with additive models, however, is left critically under-emphasized in the current literature. In this work, we find that a variational perspective linking GAM models and SHAP explanations is able to provide deep insights into nearly all recent developments. In light of this connection, we borrow in the other direction to develop a new method to train interpretable GAM models which are automatically purified to compute the Shapley value in a single forward pass. Finally, we provide theoretical results showing the limited representation power of GAM models is the same Achilles’ heel existing in SHAP and discuss the implications for SHAP’s modern usage in CV and NLP. 1 Introduction Since their introduction into machine learning, Shapley values have had a meteoric rise within the space of model explanation. The principled axioms of Shapley ( Shapley, 1953 ) and the easy-to-use framework of SHAP ( Lundberg & Lee, 2017 ) have led to their widespread adoption when compared with alternatives in gradient-based and black-box explanation methods. The developments which then followed quickly pushed beyond tabular datasets into higher dimensional data like computer vision and natural language, with abundant research investigating how to improve the speed and efficiency of Shapley values across these various high-dimensional domains ( Covert et al., 2021 ; Mosca et al., 2022 ; Jethani et al., 2022 ; Covert et al., 2023 ; Enouen et al., 2024 ) . In recent years, however, some lines of work have identified specific application scenarios where the Shapley value is provably guaranteed to fail, perhaps begging the question of whether such works improving on the Shapley value are instead done in vain ( Bilodeau et al., 2022 ; Huang & Marques-Silva, 2023 ) . Unfortunately, many of these critiques have been made piecemeal without an overall sense of their underlying causes. In contrast, this work takes the perspective that SHAP’s issues of explanation speed and explanation power can all be viewed under the same lens through the underlying connection with additive models and feature interactions. In this work, we find that all of the most recent development in the SHAP value, like the practical improvements of FastSHAP ( Jethani et al., 2022 ) and the theoretical advancements of FaithSHAP ( Tsai et al., 2023 ) , can be unified and more easily understood by using a functional perspective using additive models. In particular, the amortization scheme introduced by FastSHAP ( Jethani et al., 2022 ) builds on the least squares formulation of the Shapley value ( Charnes et al., 1988 ; Lundberg & Lee, 2017 ) by training a global approximator for the Shapley value, which can each be viewed as fitting a pointwise and a global additive model, respectively. Tsai et al. (2023) instead extends this least squares characterization to the bivariate and higher-order interactions to yield a richer understanding of the model to explain, drawing the same parallels with higher-order additive models. All of these extensions and more can be though of as special cases of training additive models when considered from the functional ANOVA perspective ( Sobol, 2001 ) , allowing not only for their simple combination but a greater understanding of the underlying mechanisms overall. We further find that there is a deep variational connection which underscores all such recent developments between the fundamentally interrelated SHAP explanation and GAM model, paralleling the algebraic case studied in Bordt & von Luxburg (2023) and building on various works in the GAM literature studying purification of additive models ( Hooker, 2007 ; Hart & Gremaud, 2018 ; Lengerich et al., 2020 ; Sun et al., 2022 ) . Overall, we set out to emphasize these fundamental connections between SHAP and GAM (as well as Faith-SHAP-k and GAM-k) across all possible correlated input distributions, where previous work only addressed the case of independent input variables ( Bordt & von Luxburg, 2023 ) . We use these theoretical advances in the variational equation to provide a simple check of whether SHAP is trustworthy by requiring a GAM model can be trained to the same accuracy (as depicted in Figure 1 .) This development allows for deeper insights and practical checks into SHAP’s application in important ML domains like CV and NLP where input features are heavily correlated. Further, by developing a new technique to automatically purify additive models to return the corresponding SHAP values, we simultaneously solve a longstanding problem from the GAM literature as well as demonstrate practical advantages of our method InstaSHAP over the existing FastSHAP. We envision our major contributions as follows: • Establishment of the variational formulation of Shapley additive models alongside the existing variational formulations of GAM and functional ANOVA, solving the case of dependent variables which was left open in Bordt & von Luxburg (2023) . • Introduction of a practical training method for GAM models via an alternative loss function with output masking, automatically solving the problem of GAM purification and allowing for ‘instant’ access to the Shapley values. • Theoretical insights into the real-world application of SHAP and many comparative experiments across synthetic and real-world domains of interest, helping to lay bare the question of whether Shapley values are trustworthy for ML in practical environments. Figure 1: The fundamental correspondence between SHAP and GAM is used practically to distinguish two unique scenarios. In scenario A, such as simpler tabular data, GAM models can achieve SOTA performance and their SHAP explanations align with SHAP explanations of blackbox models. In modern ML applications like computer vision, we have scenario B, where there is a gap between GAM and DNN performance in practice. This means that either: (#1) we cannot train GAMs as well as other deep neural networks; or (#2) there is an overcredulous trust of SHAP in these domains. 2 Background Let F:{\mathcal{X}}\to{\mathcal{Y}} be a function representing a machine learning model which maps from input space {\mathcal{X}}\subseteq{\mathbb{R}}^{d} to output space {\mathcal{Y}}\subseteq{\mathbb{R}}^{c} , where there are d input features and c output features. We will use [d]:=\{1,\dots,d\} to represent the set of input features and S\subseteq[d] to represent a subset of the input features. We also write the set of all such subsets, the powerset, as {\mathcal{P}}([d])\cong\{0,1\}^{d} . 2.1 Explaining by Removing A very important aspect of removal-based explanations like LIME or SHAP ( Ribeiro et al., 2016 ; Lundberg & Lee, 2017 ) is the method of feature removal ( Sundararajan & Najmi, 2020 ; Covert et al., 2021 ) . We review the three most popular removal approaches: replacing the feature with a reference value (baseline), integrating over the marginal distribution of the feature (marginal), or integrating over the conditional distribution of the feature (conditional). When applied to an explanation method like the Shapley value, these result in the corresponding: baseline Shapley, marginal Shapley, or conditional Shapley ( Sundararajan & Najmi, 2020 ; Janzing et al., 2020 ; Frye et al., 2021

Read the complete text