Causal SHAP: Feature Attribution with Dependency Awareness through Causal Discovery

Woon Yee Ng 1 , Li Rong Wang 1 , Siyuan Liu 1 , and Xiuyi Fan 2 1 · 2025

Read Causal SHAP: Feature Attribution with Dependency Awareness through Causal Discovery by Woon Yee Ng 1 , Li Rong Wang 1 , Siyuan Liu 1 , and Xiuyi Fan 2 1 (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-00846.txt.

Introduction

Woon Yee Ng, with three co-authors, proposes Causal SHAP for explaining model predictions. SHAP is a widely used method that scores each feature. It tells how much each feature counts for a prediction. But it cannot separate cause from mere correlation. It can thus give wrong credit when features move together.

Causal SHAP weaves causal links into the scores it gives. It keeps many good traits of the original SHAP. The method combines the Peter-Clark algorithm, which finds causal graphs. It also uses the IDA algorithm to measure causal strength. Tests use both synthetic and real-world data. Scores fall for features that are merely linked to the target. The gain is clearest in high-stakes fields such as healthcare.

Catalog record

CREATORWoon Yee Ng 1 , Li Rong Wang 1 , Siyuan Liu 1 , and Xiuyi Fan 2 1
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-00846

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Causal SHAP: Feature Attribution with Dependency Awareness through Causal Discovery Woon Yee Ng 1 , Li Rong Wang 1 , Siyuan Liu 1 , and Xiuyi Fan 2 1 Abstract Explaining machine learning (ML) predictions has become crucial as ML models are increasingly deployed in high-stakes domains such as healthcare. While SHapley Additive exPlanations (SHAP) is widely used for model interpretability, it fails to differentiate between causality and correlation, often misattributing feature importance when features are highly correlated. We propose Causal SHAP , a novel framework that integrates causal relationships into feature attribution while preserving many desirable properties of SHAP. By combining the Peter-Clark (PC) algorithm for causal discovery and the Intervention Calculus when the DAG is Absent (IDA) algorithm for causal strength quantification, our approach addresses the weakness of SHAP. Specifically, Causal SHAP reduces attribution scores for features that are merely correlated with the target, as validated through experiments on both synthetic and real-world datasets. This study contributes to the field of Explainable AI (XAI) by providing a practical framework for causal-aware model explanations. Our approach is particularly valuable in domains such as healthcare, where understanding true causal relationships is critical for informed decision-making. I Introduction As machine learning models become more sophisticated, their complexity creates a black-box conundrum [ 1 ] , where the lack of transparency undermines trust. As models are deployed in high-stakes decision-making tasks, such as autonomous driving and medical diagnosis, and face new regulatory requirements like the EU AI Act, the need for interpretable AI has become essential—not only for legal compliance but also for ensuring alignment with societal standards. One of the most widely used machine learning interpretability methods is SHapley Additive exPlanations (SHAP) [ 2 ] . SHAP is inspired by Shapley values [ 3 ] , a game theory concept that quantifies each player’s contribution in a cooperative setting. A key limitation of SHAP and its common variations is their inability to capture a fundamental aspect of real-world systems: causality [ 5 ] . While SHAP makes the correlations learned by predictive ML models transparent, it disregards causal relationships among model inputs. This limitation arises from its assumption of feature independence, which can lead to misattributed feature importance [ 12 ] and the generation of impossible feature combinations [ 26 ] . For example, in Figure 1 , SHAP (left) assigns importance based on correlations, suggesting that all features have direct edges to lung cancer, implying that they all directly contribute to the “lung cancer” prediction. However, domain knowledge (right) reveals that not all features have a direct path to lung cancer and that some features are dependent on others. As a result, SHAP misattributes importance and fails to account for causal relationships between features. This limitation is particularly problematic in healthcare, where incorrect feature attribution could lead to misguided therapeutic decisions. Fig. 1: On the left, we see the standard SHAP calculation of feature attribution. All three cancer risk factors, BMI, Genetic Variant, and Smoking are considered equally. However, studies have shown that Smoking and BMI both act as mediators in the causal graph [ 25 ] . Thus, to correctly quantify their importance, we must account for these causal relationships in feature attribution. Recent approaches have attempted to address this limitation by integrating causality into SHAP, including On-Manifold Shapley Values [ 19 ] , Asymmetric Shapley Values (ASV) [ 5 ] , Causal Shapley Values [ 8 ] , and Shapley Flow [ 10 ] . However, these methods still face challenges in efficiently handling feature dependencies and causality. They either require a complete causal graph for the algorithms to function or suffer from exponentially increasing computational complexity as the number of features grows. In this paper, we propose a novel Causal SHAP framework that explains how each feature in the dataset contributes to the model’s prediction while respecting the causal relationships within the data. Specifically, our approach integrates causal relationships into SHAP calculations by employing the Peter-Clark (PC) algorithm [ 6 ] for causal edge discovery and the Intervention Calculus when the DAG is Absent (IDA) algorithm [ 7 ] for causal strength quantification. The PC algorithm is a constraint-based method that uses statistical tests to uncover causal relationships in data [ 6 ] . IDA builds upon the directed acyclic graphs (DAGs) inferred by PC to estimate causal effects using intervention calculus [ 7 ] . This combination allows us to model how features influence one another through directed causal paths, rather than treating all correlations equally. Both PC and IDA are well-established and widely used techniques in causal discovery. To validate the effectiveness of our approach, we evaluated Causal SHAP on both synthetic data with known causal structures and real-world datasets. We demonstrate that our method not only provides more accurate feature attributions but also better reflects the causal structure of the underlying datasets. Extensive experiments were conducted to highlight the advantages of our method. In summary, the contributions of this paper are as follows: 1. A novel framework for integrating causality into SHAP using the PC algorithm for causal discovery between features and the IDA algorithm for quantifying causal strength. 2. Theoretical results showing that the proposed approach preserves the three key desired properties of SHAP: local accuracy, missingness, and consistency. 3. Experimental validation of Causal SHAP’s effectiveness through the insertion test and the RMSE between the computed SHAP scores and the ground truth. II Related Work Recent work has attempted to integrate causality into SHAP through methods such as On Manifold Shapley Values [ 19 ] , Asymmetric Shapley Values (ASV) [ 5 ] , Causal Shapley values [ 8 ] and Shapley Flow [ 10 ] . On Manifold Shapley Values focuses on local explanation and attempts to provide more accurate explanations when features are dependent on each other. It does this by modifying the Shapley value function to condition out-of-coalition features on in-coalition features. However, the computational time scales exponentially as the number of features increases. Causal Shapley Values [ 8 ] proposed a node-based approach that incorporates Pearl’s do calculus to split attribution between parents and children in the a priori causal graph, allowing the method to capture both direct and indirect effects, but requires the complete causal graph to implement. When only partial causal information is available, Asymmetric Shapley Values (ASV) [ 5 ] provided a theoretical framework that relaxes the Axiom of Symmetry to allow non-uniform weighting of feature importance to integrate causality into model explainability, therefore providing a more nuanced explanation that can prioritise causal ancestor and descendant. Shapley Flow [ 10 ] further advanced this by assigning attribution to edges instead of nodes, and unified Shapley value based methods including ASV. While these methods address the causal aspect, another key challenge is handling feature dependencies in practice. Popular implementations of SHAP variants (KernelSHAP [ 2 ] , Interventional TreeSHAP [ 13 ] , DeepSHAP [ 2 ] ) assume feature independence for computational efficiency. Although TreeSHAP offers a path-dependent variant that can handle dependencies, it is limited to tree-based models and produces biased estimates [ 14 ] . To address feature dependencies, several approximation methods have been proposed, including approaches using multivariate Gaussian distributions with Kernel Estimation

Read the complete text