Toward Faithful Segmentation Attribution via Benchmarking and Dual-Evidence Fusion

Abu Noman Md Sakib, OFM Riaz Rahman Aranya, Kevin Desai, Zijie Zhang · 2026

Read Toward Faithful Segmentation Attribution via Benchmarking and Dual-Evidence Fusion by Abu Noman Md Sakib, OFM Riaz Rahman Aranya, Kevin Desai, Zijie Zhang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-22624.txt.

Introduction

Sakib and co-authors ask whether image attribution maps for segmentation tell the truth. A map can look right yet fail to show the pixels that drove the model. The team builds a benchmark that tests faithfulness, off-target credit, stability, and speed. It runs on Pascal VOC and SBD with three pretrained backbones. They also propose Dual-Evidence Attribution, which blends gradient signals with region test results. Where both sources agree, the method gives more credit. It beats gradient-only methods on faithfulness tests, at extra compute cost.

Catalog record

CREATORAbu Noman Md Sakib, OFM Riaz Rahman Aranya, Kevin Desai, Zijie Zhang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE19134
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.22624

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Toward Faithful Segmentation Attribution via Benchmarking and Dual-Evidence Fusion Abu Noman Md Sakib, OFM Riaz Rahman Aranya, Kevin Desai, Zijie Zhang Abstract Attribution maps for semantic segmentation are almost always judged by visual plausibility. Yet looking convincing does not guarantee that the highlighted pixels actually drive the model’s prediction, nor that attribution credit stays within the target region. These questions require a dedicated evaluation protocol. We introduce a reproducible benchmark that tests intervention-based faithfulness, off-target leakage, perturbation robustness, and runtime on Pascal VOC and SBD across three pretrained backbones. To further demonstrate the benchmark, we propose Dual-Evidence Attribution (DEA), a lightweight correction that fuses gradient evidence with region-level intervention signals through agreement-weighted fusion. DEA increases emphasis where both sources agree and retains causal support when gradient responses are unstable. Across all completed runs, DEA consistently improves deletion-based faithfulness over gradient-only baselines and preserves strong robustness, at the cost of additional compute from intervention passes. The benchmark exposes a faithfulness–stability tradeoff among attribution families that is entirely hidden under visual evaluation, providing a foundation for principled method selection in segmentation explainability. Code is available at https://github.com/anmspro/DEA 1 Introduction Post-hoc attribution methods for deep neural networks identify which input regions are causally responsible for a given prediction. In image classification, gradient-based 49 ; 35 ; 5 ; 41 ; 30 ; 12 ; 37 and perturbation-based 45 ; 29 ; 16 ; 17 methods offer well-characterised trade-offs between spatial resolution, computational cost, and faithfulness. Semantic segmentation poses a distinct challenge: an attribution map must explain not only the presence of a target class but whether the model’s evidence is correctly localised within a predicted region without assigning importance to spatially disjoint areas. Despite this, segmentation attribution methods remain predominantly gradient-based CAM variants 49 ; 35 ; 39 ; 19 , evaluated almost exclusively by visual plausibility. This criterion does not test causal faithfulness. Two questions remain unexamined: does occluding the highest-attributed pixels within the target region reduce the model’s confidence in that region, and do attribution maps assign substantial importance to pixels outside the target mask? A method that fails either test may still produce convincing heatmaps, as gradient activations can reflect feature co-occurrence rather than causal evidence 1 . We introduce a reproducible benchmark for segmentation attribution faithfulness, formalising two evaluation axes absent from prior work: target deletion faithfulness , measuring the causal dependence of region-level confidence on highest-attributed pixels, and absolute off-target leakage , quantifying attribution credit outside the target mask. Together with perturbation robustness and runtime, these axes enable principled multi-criteria comparison of segmentation attribution methods. We demonstrate the benchmark with Dual-Evidence Attribution (DEA), showing that it surfaces faithfulness differences invisible to visual inspection. Our contributions are as follows: • A reproducible segmentation attribution benchmark comprising intervention-based faithfulness tests, off-target leakage, perturbation robustness, and runtime profiling across three backbones on Pascal VOC and SBD. • Dual-Evidence Attribution (DEA), a lightweight dual-evidence correction fusing gradient and intervention signals, improving deletion faithfulness over gradient baselines. • All per-sample outputs and aggregation scripts are released for independent verification. 2 Related Work Gradient-based attribution for dense prediction. CAM 49 and Grad-CAM 35 produce class-discriminative maps by weighting activations with globally pooled gradients, but discard spatial information through average pooling. Grad-CAM++ 5 , Score-CAM 41 , Ablation-CAM 30 , and HiResCAM 12 address different limitations of this pooling step. For segmentation, Vinogradova et al . 39 restricted the gradient signal to a masked target region (Seg-Grad-CAM), and Hasany et al . 19 further improved spatial specificity with elementwise weighting (Seg-XRes-CAM, our EGA baseline). Neither work evaluates causal faithfulness: both validate explanations by visual comparison rather than direct intervention tests. Perturbation and intervention-based attribution. Occlusion-based methods 45 estimate pixel importance by masking regions and measuring the change in model output, providing a direct causal signal at higher computational cost. RISE 29 , meaningful perturbations 16 , and extremal perturbations 17 extend this with randomised and optimised masking schemes. These methods are model-agnostic but their evaluation in segmentation remains limited to visual plausibility. Our RIA baseline and the intervention component of DEA adopt the same causal viewpoint within the segmentation evaluation loop. Broader attribution context. Beyond CAM-style heatmaps, integrated gradients 37 , concept-based testing 24 , and Shapley-value approximations 28 have shaped widely used desiderata for explanation quality, including sensitivity, implementation invariance, and completeness. As vision models expanded beyond standard CNNs 11 ; 43 ; 42 ; 22 ; 26 , dedicated attention-based and propagation-based explanation methods followed 7 ; 6 ; 14 ; 40 ; 38 ; 32 ; 4 , often revealing that attribution behaviour varies substantially across architectures. However, the majority of these methods and their evaluation protocols target image classification, leaving dense prediction tasks without comparable evaluation standards. These lines of work motivate the need for faithfulness evaluation that goes beyond visual plausibility and accounts for the spatial structure specific to segmentation. Faithfulness evaluation. Adebayo et al . 1 showed that many saliency methods produce outputs largely independent of learned weights. Hooker et al . 20 proposed ROAR, measuring faithfulness by accuracy degradation after retraining on data with top-attributed pixels removed. Yeh et al . 44 introduced infidelity and sensitivity criteria. These works establish that visual plausibility is insufficient 2 ; 31 ; 15 ; 3 ; 25 ; 23 ; 36 ; 8 ; 33 ; 34 ; 47 , but operate in the classification setting. ROAR requires retraining, and none address off-target leakage specific to dense prediction. Our benchmark instantiates inference-time deletion and leakage tests directly within the segmentation loop, requiring no retraining and explicitly accounting for the spatial structure of dense prediction targets. Figure 1 : Overview of DEA. Elementwise gradient evidence (EGA) and region intervention evidence (RIA) are combined through multiplicative agreement and residual intervention support. 3 Method We first define the region-level attribution objective for semantic segmentation, then introduce the dual-evidence correction used in DEA, and finally specify the evaluation metrics. Figure 1 illustrates the pipeline. 3.1 Problem Setup Given an input image x\in\mathbb{R}^{3\times H\times W} and a pretrained segmentation model f , we study explanations for a target class c and target mask M\in\{0,1\}^{H\times W} . Let z=f(x) be per-pixel logits and let p_{c}(x) denote the softmax probability map for class c . We evaluate evidence at the region level through s_{c}(x,M)=\frac{\sum_{u,v}M_{uv}\,p_{c}(x)_{uv}}{\sum_{u,v}M_{uv}+\epsilon}, (1) which is the masked mean class probability inside the target region. An attribution method outputs a heatmap A\in[0,1]^{H\times W} , and we test whether high-valued pixels in A are causally important for s_{c}(x,M) . 3.2 Dual-Evidence Attribution We compare three base attributions that expose complementary behavior. GPA uses gradient pooling at the selected feature layer, EGA uses elementwise gradient-activation products at the same layer, and RIA computes intervention deltas by masking fixed grid regions and measuring the corresponding drop in ( 1 ). All maps are min-max normalized to [0,1] . Let A_{g} be the EGA map and A_{r} the RIA map. Our corrected attribution is A_{f}=\alpha A_{g}\odot(1+\beta A_{r})+(1-\alpha)A_{r}, (2) where (\alpha,\beta) control the balance between fine gradient structure and intervention support, and \odot denotes elementwise multiplication. The multiplicative term increases weight on pixels where both sources agree, while the residual A_{r} term keeps coarse but causally supported evidence when gradient responses are

Read the complete text