Efficient KernelSHAP Explanations for Patch-based 3D Medical Image Segmentation
Ricardo Coimbra Brioso 1 , Giulio Sichili 1 , Damiano Dei 3 , Nicola Lambri 3 4 , Pietro Mancosu 2 3 , Marta Scorsetti 2 3 , and Daniele Loiacono 1 · 2026
Read Efficient KernelSHAP Explanations for Patch-based 3D Medical Image Segmentation by Ricardo Coimbra Brioso 1 , Giulio Sichili 1 , Damiano Dei 3 , Nicola Lambri 3 4 , Pietro Mancosu 2 3 , Marta Scorsetti 2 3 , and Daniele Loiacono 1 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-11775.txt.
Introduction
Brioso and six colleagues make KernelSHAP explanations usable for patch-based CT scans in three dimensions. They limit the work to a chosen region and cache patch results, so unchanged patches are not recomputed. They test whole-organ units, regular supervoxels, and hybrid organ-aware supervoxels, and report computing savings from 15 to 30 percent. Regular supervoxels lead on perturbation tests, while organ-aware units read more clearly and flag false positives better.
Catalog record
| CREATOR | Ricardo Coimbra Brioso 1 , Giulio Sichili 1 , Damiano Dei 3 , Nicola Lambri 3 4 , Pietro Mancosu 2 3 , Marta Scorsetti 2 3 , and Daniele Loiacono 1 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33687 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.11775
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Efficient KernelSHAP Explanations for Patch-based 3D Medical Image Segmentation Ricardo Coimbra Brioso 1 , Giulio Sichili 1 , Damiano Dei 3 , Nicola Lambri 3 4 , Pietro Mancosu 2 3 , Marta Scorsetti 2 3 , and Daniele Loiacono 1 Abstract Perturbation-based explainability methods such as KernelSHAP provide model-agnostic attributions but are typically impractical for patch-based 3D medical image segmentation due to the large number of coalition evaluations and the high cost of sliding-window inference. We present an efficient KernelSHAP framework for volumetric CT segmentation that restricts computation to a user-defined region of interest and its receptive-field support, and accelerates inference via patch logit caching, reusing baseline predictions for unaffected patches while preserving nnU-Net’s fusion scheme. To enable clinically meaningful attributions, we compare three automatically generated feature abstractions within the receptive-field crop: whole-organ units, regular FCC supervoxels, and hybrid organ-aware supervoxels, and we study multiple aggregation/value functions targeting stabilizing evidence (TP/Dice/Soft Dice) or false-positive behavior. Experiments on whole-body CT segmentations show that caching substantially reduces redundant computation (with computational savings ranging from 15% to 30%) and that faithfulness and interpretability exhibit clear trade-offs: regular supervoxels often maximize perturbation-based metrics but lack anatomical alignment, whereas organ-aware units yield more clinically interpretable explanations and are particularly effective for highlighting false-positive drivers under normalized metrics. I Introduction Deep learning models have become the de-facto standard for medical image segmentation, enabling robust delineation of anatomical structures and pathological targets across modalities and clinical workflows. In radiotherapy treatment planning, in particular, accurate segmentation of organs-at-risk and target volumes directly impacts dose optimization and safety. Despite their strong empirical performance, deep learning segmentation models remain difficult to audit: errors can be subtle, spatially localized, and strongly influenced by contextual anatomy, acquisition artifacts, or model’s biases. This motivates explainable AI (XAI) methods capable of providing faithful, clinically meaningful explanations of why a 3D segmentation model produced a given mask rather than another. Compared to classification, explainability for dense prediction is substantially less consolidated. Recent surveys highlight open challenges specific to segmentation, including (i) how to define interpretable regions of analysis in volumetric data, (ii) how to aggregate voxel-level evidence into robust scores, and (iii) how to preserve anatomical structure in explanations [ 10 ] . Gradient-based methods (e.g., segmentation-adapted Grad-CAM variants) are computationally efficient but may be layer-dependent and hard to interpret in multi-structure settings [ 23 , 11 , 22 ] . Perturbation-based approaches, on the other hand, offer model-agnostic explanations and can be aligned with clinically meaningful units, but they are often prohibitively expensive in 3D—especially for patch-based inference pipelines such as nnU-Net [ 14 ] . In particular, Shapley-value methods (e.g., KernelSHAP [ 17 ] ) require evaluating a value function over many feature coalitions, which naively entails thousands of forward passes over highly overlapping sliding-window patches. In this work, we propose an efficient perturbation-based explainability framework for patch-based 3D segmentation by adapting KernelSHAP to volumetric CT data under two key principles: (1) localize computation to a user-defined region of interest (ROI) and its receptive-field support, and (2) reuse baseline computations whenever perturbations do not affect a given sliding-window patch. We further investigate how the definition of interpretable units (organs vs. geometric vs. organ-aware supervoxels) and the choice of scalar aggregation function (logit-weighted true/false positive scores, Dice, and Soft Dice) impact the qualitative appearance and the perturbation-based faithfulness of the resulting explanations. II Related Works A recent survey by Gipiškis et al. [ 10 ] highlights two broad families that are most relevant to our setting: gradient-based methods and perturbation-/region-based methods. Compared to classification, segmentation explainability remains less explored and still lacks consolidated best practices, especially for (i) defining clinically meaningful regions of analysis, (ii) aggregating voxel-level evidence into robust scores, and (iii) ensuring explanations remain interpretable in a structured anatomical setting. II-A Gradient-based Attribution Gradient-based explanations extend saliency mechanisms to dense prediction. In segmentation, Grad-CAM-style methods have been adapted (e.g., Seg-Grad-CAM) to focus explanations on selected predicted regions rather than the full image [ 23 ] . Hasany et al. [ 11 ] show that the explanatory signal is highly layer-dependent (encoder bottleneck vs. decoder/output), motivating multi-layer inspection to capture how contextual anatomy shapes the final mask. More recently, FM-G-CAM [ 22 ] addresses the single-class limitation by integrating gradients from multiple classes, which is particularly relevant in multi-organ settings where inter-structure dependencies are clinically meaningful. II-B Perturbation- and Region-based Methods Perturbation-based methods explain model behavior through systematic input modifications and their impact on the segmentation output. Early approaches include occlusion/sensitivity analysis to measure segmentation stability under localized masking or transformations [ 2 ] . In cardiac MRI, feature ablation studies further suggest that predictions for a target structure may depend on surrounding anatomical context [ 3 ] , reinforcing the need for explanations that can disentangle target evidence from contextual cues. However, classic local surrogate approaches such as LIME [ 20 ] often struggle in segmentation due to instability and poor semantic alignment of perturbed regions. To mitigate this, Knab et al. [ 15 ] propose using anatomically meaningful superpixels derived from SAM to better match the perturbation units to realistic regions. SLICE [ 5 ] targets variance reduction via stabilized sampling and superpixel selection, improving consistency across runs. Other works explicitly model context: Grid Saliency [ 13 ] separates object evidence from contextual surroundings (at higher computational cost), while U-Noise-style approaches learn input-dependent noise masks and can be regularized for spatial smoothness [ 16 , 18 ] . Complementarily, MiSuRe [ 12 ] optimizes a minimally sufficient region that preserves segmentation quality (e.g., Dice) while shrinking the explanation, providing a fidelity-oriented notion of “necessary” evidence (in contrast to Grad-CAM/RISE [ 19 ] ). Overall, perturbation-based explanations are attractive because they are model-agnostic and can be aligned with clinically meaningful units, but their scalability and faithfulness remain open challenges. Chrabaszcz et al. [ 7 ] propose Agg 2 Exp, aggregating voxel-level gradient attributions in 3D, and empirically highlight that gradient aggregation can provide more scalable and faithful insights than computationally heavy perturbation schemes in complex multi-class volumes. III Adapting KernelSHAP for Efficient 3D Segmentation Explainability In this section, we present our explainability framework for interpreting predictions of patch-based 3D segmentation by adapting KernelSHAP [ 17 ] to volumetric CT data. Given the high dimensionality of voxel-level features, we estimate Shapley attributions over interpretable units (supervoxels or organs) and restrict the analysis to a region of interest (ROI). Our pipeline is defined by the following components: (i) ROI definition and corresponding receptive-field (RF) support for spatially localized computation; (ii) a partition of the volume into M interpretable units; (iii) a perturbation operator that removes selected units by masking; (iv) an ROI-restricted scalar value function used by KernelSHAP to score coalitions; (v) an efficient coalition-evaluation scheme for patch-based predictors based on sliding-window patch caching. III-A ROI Definition and Receptive-Field Support Our explanations are conditioned on a baseline segmentation that the user seeks to interpret. In practice, an expert selects a subset of the model prediction for the target class (e.g., a connected component or a clinically relevant sub-region), thus defining an ROI mask R(x)\in\{0,1\} . Then, we compute the minimal axis-aligned cubic bounding box B enclosing all voxels such that R(x)=1 . Since