Pixel-level Certified Explanations via Randomized Smoothing

Alaa Anani, Tobias Lorenz, Mario Fritz, Bernt Schiele · 2025

Read Pixel-level Certified Explanations via Randomized Smoothing by Alaa Anani, Tobias Lorenz, Mario Fritz, Bernt Schiele (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-15499.txt.

Introduction

Alaa Anani and co-authors present the first framework that certifies pixel-level explanations of image models against small attacks, in a 2025 paper. Explanation maps highlight the pixels that drove a model's call, but tiny, invisible changes to an image can redraw the map while the call stays the same. That fragility undermines trust in the maps.

Their method sparsifies and smooths the maps with random noise, then treats the task as segmentation. Each pixel's importance is then certified against bounded changes to the input. They also propose three metrics for certified robustness, placement, and faithfulness. Tests on twelve explanation methods and five image models show the certified maps hold up.

Catalog record

CREATORAlaa Anani, Tobias Lorenz, Mario Fritz, Bernt Schiele
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE56 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-15499

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Pixel-level Certified Explanations via Randomized Smoothing Alaa Anani, Tobias Lorenz, Mario Fritz, Bernt Schiele Abstract Post-hoc attribution methods aim to explain deep learning predictions by highlighting influential input pixels. However, these explanations are highly non-robust: small, imperceptible input perturbations can drastically alter the attribution map while maintaining the same prediction. This vulnerability undermines their trustworthiness and calls for rigorous robustness guarantees of pixel-level attribution scores. We introduce the first certification framework that guarantees pixel-level robustness for any black-box attribution method using randomized smoothing. By sparsifying and smoothing attribution maps, we reformulate the task as a segmentation problem and certify each pixel’s importance against ℓ 2 \ell_{2} -bounded perturbations. We further propose three evaluation metrics to assess certified robustness, localization, and faithfulness. An extensive evaluation of 12 attribution methods across 5 ImageNet models shows that our certified attributions are robust, interpretable, and faithful, enabling reliable use in downstream tasks. Our code is at https://github.com/AlaaAnani/certified-attributions . 1 Introduction Figure 1 : Pixel-level certified explanations via randomized smoothing. (a) The original attribution h(x) lacks robustness guarantees and changes under small input perturbations. (b) We sample noisy attributions h(x+\epsilon) , and (c) certify which pixels robustly remain in the top- K\% . Colored pixels show certifiably robust top K pixels across different attribution methods (LRP, RISE, Grad-CAM). Computer vision models are highly successful in high-stakes applications, such as autonomous driving ( Kaymak & Uçar 2019 ; Zhang et al. 2016 ) , medical imaging ( Kayalibay et al. 2017 ; Guo et al. 2019 ) , and the judicial system ( Nissan 2017 ) . In such domains, understanding the reasoning behind model predictions through explainability methods is paramount. Post-hoc attribution methods identify image pixels most influential for a model’s prediction. However, attribution methods are highly non-robust: even imperceptible input perturbations can significantly alter attribution maps while leaving predictions unchanged ( Ghorbani et al. 2019 ; Kindermans et al. 2019 ; Dombrowski et al. 2019 ; Subramanya et al. 2019 ; Kuppa & Le-Khac 2020 ; Zhang et al. 2020 ) . This vulnerability undermines trust in attribution methods, especially when explanations directly influence critical decisions ( Sheu & Pardeshi 2022 ; Xi et al. 2023 ) . Consequently, pixel-level certification methods that rigorously guarantee the robustness of each pixel’s importance value under input perturbations become crucial for trustworthy model explanations. Previous work addresses attribution robustness through certifying bounds for image-level metrics with respect to input perturbations — typically measuring the similarity of attributions between perturbed and clean inputs ( Wang & Kong 2023 ; Wang & Kong 2024 ; Dhurandhar et al. 2024 ; Levine et al. 2019 ; Liu et al. 2022 ; Chen et al. 2022 ) . However, image-level bounds are too coarse, as they (i) fail to capture pixel-level robustness, (ii) lack visual interpretability as they only produce a single number, and (iii) can be disproportionately affected by a small non-robust subset of pixels. We address this challenge and introduce the first certification method that guarantees pixel-level robustness for any black-box attribution method, producing fine-grained, interpretable certified attributions. Our key insight is to reframe attribution as a segmentation task by sparsifying the continuous attribution maps into binary pixel-importance classes: “1” for the top K % most important pixels and “0” for the rest. This defines a sparsified attribution function, whose output we certify using Randomized Smoothing ( Fischer et al. 2021 ; Anani et al. 2024 ) , a framework that certifies high-dimensional outputs of segmentation models against \ell_{2} -norm input perturbations. Each pixel is certified as either robustly important (“1”), robustly unimportant (“0”), or abstaining (“ \oslash ”) if no guarantee can be given. Figure 1 shows an example of certified attributions for three attribution methods at different sparsification levels K . Leveraging our certification framework, we comprehensively compare 12 different attribution methods spanning backpropagation-based, activation-based, and perturbation-based methods on 5 different ImageNet classifiers, including CNNs (e.g., ResNet-152) and transformer (ViT-B/16) architectures. Leveraging our pixel-wise certificates, we create the first certified attribution maps, highlighting image pixels that are robustly influential for predictions ( Figures 1 , 2 , 3 and 4 ). For quantitative evaluations, we propose three metrics that measure desirable properties of certified attributions: (i) the percentage of certified pixels (%certified), measuring the attribution method’s robustness, (ii) Certified Grid Pointing Game (Certified GridPG), an extension of GridPG ( Bohle et al. 2021 ) that measures robust localization by computing the percentage of correctly localized and certified attributions, and (iii) a deletion-based faithfulness score that measures the confidence drop when progressively removing the pixels with top K % certified attributions. Our experiments show significant differences between methods in all four dimensions, with LRP and RISE demonstrating the best trade-offs between certified robustness, localization, faithfulness, and meaningful visual attributions. Contributions To summarize, our contributions are: (i) We introduce the first pixel-level certification framework for any black-box attribution method, providing rigorous robustness guarantees under \ell_{2} -bounded perturbations (Section 4 ), (ii) We present three certified evaluation metrics: %certified to assess robustness, Certified GridPG for robust localization, and a deletion-based score for evaluating faithfulness (Section 5 ), (iii) We create the first certified attribution maps that can be used in downstream tasks (Sections 7.1 ), (iv) We analyze trade-offs across robustness, localization, and faithfulness of 12 attribution methods on 5 ImageNet models, including CNNs and transformers, showing that LRP and RISE strike the best balance, offering actionable insights into trustworhty and reliable attribution (Sections 7.2 , 7.3 , 7.4 , 7.5 ). 2 Related Work Machine learning explainability Post-hoc attribution methods produce maps that show which pixels in an input image are important to a classifier’s output. Attribution methods fall into three categories: (i) backpropagation-based , which typically use gradients with respect to the input ( Simonyan 2014 ; Springenberg et al. 2014 ; Sundararajan et al. 2017 ; Shrikumar et al. 2017 ) , (ii) activation-based , which weigh activation maps to determine the importance of pixels in relation to the network’s final layer ( Selvaraju et al. 2017 ; Chattopadhay et al. 2018 ; Ramaswamy et al. 2020 ; Jiang et al. 2021 ) , and (iii) perturbation-based , which perturb the input differently (e.g. via occlusions or masking) to observe changes in the network output ( Dabkowski & Gal 2017 ; Fong & Vedaldi 2017 ; Petsiuk et al. 2018b ; Ribeiro et al. 2016 ; Zeiler 2014 ) . Gradient (Grad) ( Simonyan 2014 ) , one of the earliest backpropagation-based methods, generates saliency maps by computing input gradients. Guided Backpropagation (GB) ( Springenberg et al. 2014 ) refines this by retaining only positive gradients, while Integrated Gradients (IntGrad) ( Sundararajan et al. 2017 ) accumulates gradients along a path from a reference baseline to reduce gradient noise. Input × Gradient (IxG) ( Shrikumar et al. 2017 ) multiplies the input with its gradient to highlight pixel importance. Layer-wise Relevance Propagation (LRP) ( Bach et al. 2015 ) , in contrast, redistributes the network’s output relevance backward through the layers using a set of propagation rules, ensuring conservation of relevance while highlighting features that contribute most to the model’s decision. Among activation-based methods, Class Activation Mapping (CAM) ( Zhou et al. 2016 ) projects class-specific weights

Read the complete text