RoSHAP: A Distributional Framework and Robust Metric for Stable Feature Attribution

Lanxin Xiang, Liang Shi, Youhui Ye, Boyu Jiang, Dawei Zhou, Feng Guo · 2026

Read RoSHAP: A Distributional Framework and Robust Metric for Stable Feature Attribution by Lanxin Xiang, Liang Shi, Youhui Ye, Boyu Jiang, Dawei Zhou, Feng Guo (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-15154.txt.

Introduction

Lanxin Xiang and five others offer RoSHAP, a robust metric for stable feature attribution in machine learning. Standard attribution scores swing with train-test splits, seeds, and fitting choices, changing rankings. Their framework models the spread of attribution scores via bootstrap resampling and kernel density estimation, showing the pooled score is asymptotically Gaussian. RoSHAP rewards features that are active, strong, and steady together, beating single-run measures at finding signal features in simulations and real data.

Catalog record

CREATORLanxin Xiang, Liang Shi, Youhui Ye, Boyu Jiang, Dawei Zhou, Feng Guo
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE44812
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.15154

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

RoSHAP: A Distributional Framework and Robust Metric for Stable Feature Attribution Thanks: Code is available at https://github.com/Lanxin-Xiang/RobustSHAP . Lanxin Xiang, Liang Shi, Youhui Ye, Boyu Jiang, Dawei Zhou, Feng Guo Abstract Feature attribution analysis is critical for interpreting machine learning models and supporting reliable data-driven decisions. However, feature attribution measures often exhibit stochastic variation: different train–test splits, random seeds, or model-fitting procedures can produce substantially different attribution values and feature rankings. This paper proposes a framework for incorporating stochastic nature of feature attribution and a robust attribution metric, RoSHAP , for stable feature ranking based on the SHAP metric. The proposed framework models the distribution of feature attribution scores and estimates it through bootstrap resampling and kernel density estimation. We show that, under mild regularity conditions, the aggregated feature attribution score is asymptotically Gaussian, which greatly reduces the computational cost of distribution estimation. The RoSHAP summarizes the distribution of SHAP into a robust feature-ranking criterion that simultaneously rewards features that are active, strong, and stable. Through simulations and real-data experiments, the proposed framework and RoSHAP outperform standard single-run attribution measures in identifying signal features. In addition, models built using RoSHAP-selected features achieve predictive performance comparable to full-feature models while using substantially fewer predictors. The proposed RoSHAP approach improves the stability and interpretability of machine learning models, enabling reliable and consistent insights for analysis. 1 Introduction Feature attribution provides a quantitative basis for interpreting machine learning (ML) models by assigning contribution scores to individual predictors. For many modern ML models, however, these scores cannot be directly derived from the model structure and must instead be estimated using post hoc attribution methods. This task becomes especially challenging when the data are high-dimensional, noisy, and correlated, or when the predictor–response relationship is complex. In such settings, attribution results may be difficult to interpret and may not provide a stable basis for scientific or practical conclusions. A large body of work has developed feature attribution methods for explaining model predictions, including SHapley Additive exPlanations (SHAP) [ 14 ] , Local Interpretable Model-agnostic Explanations (LIME) [ 18 ] , DeepLIFT [ 22 ] , and information-gain-based measures. These metrics capture different aspects of feature contribution, each with distinct theoretical properties and practical trade-offs. SHAP, for instance, produces additive instance-level attribution scores grounded in cooperative game theory and is the unique additive attribution method satisfying local accuracy, missingness, and consistency [ 14 ] . These guarantees have made SHAP a popular choice across diverse domains, including medicine [ 1 , 17 , 24 , 12 ] , natural language processing [ 16 ] , and spatial data analysis [ 11 ] . While existing feature attribution methods are valuable, challenges remain in how attribution scores are estimated and interpreted. A standard workflow splits the data into training and test sets, fits a model, and computes attribution values from the trained model. Each step can introduce stochastic variation, including random data partitioning, random initialization, and stochastic optimization. Consequently, attribution scores are not fixed quantities; different train–test splits or random seeds can yield substantially different feature rankings [ 6 ] . This uncertainty is especially pronounced in high-dimensional settings such as genomics, where the number of features far exceeds the number of samples. Figure 1 illustrates this issue: the top-three SHAP-ranked genes for cancer classification vary across train–test splits, and their attribution magnitudes also differ substantially. Such randomness provides an unreliable basis for costly downstream gene testing. (a) Round 1 (b) Round 2 (c) Round 3 Figure 1 : Top SHAP-ranked features in the Golub data across different train–test sets. Although all three runs achieve perfect macro F1, the selected top features differ substantially. We propose a bootstrap-based framework for estimating the distribution of feature attribution scores. Based on this framework, we introduce RoSHAP (Robust SHAP), a robust attribution metric for stable feature ranking. The framework repeatedly resamples the data and refits the model to capture variability in feature attribution scores. The resulting attribution scores are summarized through kernel density estimation, yielding an estimated distribution that reflects both attribution magnitude and variability. We further derive a Gaussian approximation for the aggregated feature-level attribution score under a mild regularity condition, substantially reducing the computational cost of distribution estimation. RoSHAP summarizes the estimated attribution distribution through three components: activity, strength, and stability. Activity measures the proportion of nonzero attribution values, strength measures the median magnitude of the nonzero attribution values, and stability measures the signal-to-noise ratio of the attribution distribution. By rewarding features that contribute frequently, have large attribution magnitudes, and remain stable across resampling runs, RoSHAP provides a robust basis for feature ranking and interpretation. Results on both simulated and real-world datasets show that RoSHAP yields stable interpretations across regression and classification tasks and across diverse data modalities. RoSHAP effectively identifies the most influential features, and models trained using only these selected features achieve performance comparable to that of models trained on the full feature set. The remainder of this paper is organized as follows. Section 2 reviews related work on SHAP and other feature contribution methods. Section 4 reports simulation studies under different settings. Section 5 presents three motivating examples and performance comparisons. Section 6 concludes with a discussion of the main findings and future directions. 2 Related Works Feature attribution and additive attribution. Feature attribution is widely used to interpret predictive models. For classical linear models, p -values, t -tests, and F -tests provide feature-level inference under parametric assumptions. For ML models, common importance measures include gain-, impurity-, and entropy-based scores, as well as post hoc methods such as SHAP [ 14 ] , LIME [ 18 ] , and DeepLIFT [ 22 ] . SHAP is grounded in cooperative game theory, treating predictors as players and the model prediction as the payoff; each feature is assigned its average marginal contribution over all coalitions. This additive formulation makes SHAP broadly applicable across model classes. TreeSHAP [ 13 ] enables efficient computation for tree ensembles such as random forests, XGBoost [ 4 ] , and LightGBM [ 9 ] , while KernelSHAP and DeepSHAP extend SHAP to general black-box and deep learning models. SHAP stability and prediction uncertainty. Growing literature examines how feature attributions vary under data and model randomness. 20 showed that predictive uncertainty can propagate to explanation uncertainty, producing unstable attribution scores, especially for out-of-distribution samples. Other studies use repeated resampling or nested cross-validation to summarize SHAP values across folds through averages, selection frequencies, or rank distributions [ 19 , 8 , 6 ] . Related work explains predictive uncertainty: 26 extended SHAP with information-theoretic value functions to attribute epistemic and aleatoric uncertainty. However, most approaches focus on averages or rankings rather than the full distributional structure of attribution scores. SHAP for feature selection. SHAP is also used for feature selection, typically by ranking variables by mean absolute SHAP values and retaining the top-ranked subset. This strategy has been adopted across application domains [ 15 , 5 , 21 ] . Comparative studies have evaluated SHAP-based feature selection against built-in model importance measures and other screening rules [ 25 ] . While often effective, these approaches remain largely magnitude-based, with limited attention to resampling instability, exact zeros, and strong predictor correlation. Overall, prior work has established

Read the complete text