Value bounds and Convergence Analysis for Averages of LRP attributions
Alexander Binder, Nastaran Takmil-Homayouni, Urun Dogan · 2025
Read Value bounds and Convergence Analysis for Averages of LRP attributions by Alexander Binder, Nastaran Takmil-Homayouni, Urun Dogan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-08963.txt.
Introduction
Alexander Binder and 2 co-authors analyze value bounds and convergence for averages of LRP attributions in a 2025 paper. LRP, layer-wise relevance propagation, explains a neural network prediction by assigning relevance scores. Users often average those scores over many augmented samples.
Attributions are written as products of modified gradient matrices, linking them to Jacobi matrices from calculus. Bounds on singular values and on each attribution value follow. Those bounds yield constants that govern how fast sample averages converge to expected values. For one LRP variant, constants do not depend on weight norms, unlike gradient methods. The results guide use of augmentation and smoothing explainers.
Catalog record
| CREATOR | Alexander Binder, Nastaran Takmil-Homayouni, Urun Dogan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 89 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-08963
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Value bounds and Convergence Analysis for Averages of LRP attributions [email protected] Alexander Binder, Nastaran Takmil-Homayouni, Urun Dogan Abstract We analyze numerical properties of Layer-wise relevance propagation (LRP)-type attribution methods by representing them as a product of modified gradient matrices. This representation creates an analogy to matrix multiplications of Jacobi-matrices which arise from the chain rule of differentiation. In order to shed light on the distribution of attribution values, we derive upper bounds for singular values. Furthermore we derive component-wise bounds for attribution map values. As a main result, we apply these component-wise bounds to obtain multiplicative constants. These constants govern the convergence of empirical means of attributions to expectations of attribution maps. This finding has important implications for scenarios where multiple non-geometric data augmentations are applied to individual test samples, as well as for Smoothgrad-type attribution methods. In particular, our analysis reveals that the constants for LRP- β \beta remain independent of weight norms, a significant distinction from both gradient-based methods and LRP- ϵ \epsilon . 1 Introduction In various domains such as healthcare or the sciences it is not only important to achieve high predictive accuracies but it also matters in some use cases to understand what part of an input sample contributed to the prediction. To this end the field of explainable deep learning has developed several algorithms to explain predictions. Early approaches in deep learning considered gradient-based attributions [ 1 ] . Several attribution methodologies for deep neural networks are based on the idea of using a modified gradient such as [ 2 , 3 , 4 ] in order to address shortcomings of gradients in deep neural networks such as high noise content [ 5 ] . As part of modified gradient approaches, attribution methods based on Layer-wise relevance propagation (LRP) [ 6 ] have consistently produced explanations with high faithfulness to network output scores across diverse deep neural architectures, including CNNs [ 7 , 8 ] , Transformers [ 9 ] , and Mamba-type networks [ 10 ] . However, the theoretical underpinnings of their properties and the mechanisms driving their high faithfulness remain insufficiently understood. • We derive upper and lower bounds for the value ranges of two LRP-type attributions. We establish a formal framework by analyzing transition matrices for LRP-type attributions analogously to Jacobian matrices for gradient-based methods. • We establish convergence properties for LRP-type attribution maps in settings involving predictions with augmentations of independently sampled data. Our analysis demonstrates that while the LRP attribution maps converge at the same asymptotic rate of \mathcal{O}(1/\sqrt{m}) with respect to the sample size m as gradient methods, the constant factors governing this convergence differ fundamentally. In particular, for the \beta -rule, these constants are decoupled from weight norms - a critical distinction that grants robustness against large model weights. This theoretical finding explains the empirically observed low sensitivity of LRP to top-down model parameter randomization tests [ 11 ] reported in prior work [ 8 ] . 2 Related Work A number of methods can be applied scalably to deep neural networks which modify the gradient such as Guided Backpropagation [ 2 ] and Grad-CAM [ 3 ] or which define attributions which share certain properties of the gradient [ 12 ] such as DeepLIFT [ 4 ] and LRP [ 6 ] . Other methods employ the gradient or gradient times input in input space and devise schemes to reduce the noise content of the gradient, such as Integrated Gradients [ 13 ] and SmoothGrad [ 14 ] . Smoothing by adding noise and averaging has been applied to LRP as well [ 15 ] . Gradient-free alternatives can be based, among others, on Shapley values [ 16 , 17 ] , occlusion approaches [ 18 ] or learned perturbations [ 19 ] . [ 20 ] advocates for generative inpainting. Due to the lack of ground truth, quality measures have been devised for attribution methods [ 21 , 12 , 22 , 11 , 23 , 24 , 25 , 26 , 27 , 28 , 29 , 30 , 31 , 32 ] covering various aspects. Importantly, satisfying them can often be achieved only with trade-offs [ 33 , 8 ] . The noise in gradients of deep neural nets has been quantified in [ 5 , 34 ] as increasing in depth. [ 35 ] derived an \mathcal{O}(m^{-1/2}) convergence result for SmoothGrad as a function of the maximal gradient norm which implicitly depends on the network weights. A number of works have analyzed the effects of SmoothGrad, KernelShap, and others, for example from the perspective of smoothing [ 33 , 36 ] . [ 37 ] uses Lipschitz-continuity valid with high probability and establishes a link between function and SmoothGrad attribution for this measure. 3 The problem setup: Convergence problems considered We investigate the convergence properties of attribution maps when averaged over m conditionally independent samples. Let A(f,x)\in\mathbb{R}^{d} be an attribution map for a classifier f:\mathbb{R}^{d}\rightarrow\mathbb{R}^{1} in sample x . Then the quantity of interest is given as \displaystyle\frac{1}{m}\sum_{i=1}^{m}A(f,x^{(i)}) (1) A canonical application of this framework arises when analyzing predictions across multiple variants x^{(i)} of a single input sample x , where these variants are generated through data augmentation procedures. • This procedure is known as Test-time data augmentation. Our study is motivated by the common use of Test-time data augmentation in medical imaging and sciences, see for example [ 38 , 39 , 40 , 41 , 42 , 43 , 44 , 45 , 46 , 47 , 48 ] . Specifically, we consider scenarios where a base sample x undergoes multiple transformations via independently and identically distributed (i.i.d.) random augmentations T_{c_{i}}(x) with parameters c_{i} sampled from a distribution \mathcal{Q} : \displaystyle x^{(i)}=T_{c_{i}}(x),\ c_{i}\sim\mathcal{Q} (2) These augmentations typically consist of photometric transformations that preserve the semantic content while altering superficial characteristics of the input. Notable examples include color-space transformations in histopathology imaging or spectral band mixing in hyperspectral remote sensing applications. In such cases, the stability of attribution maps across photometric variations provides insight into the model’s reliance on invariant structural features versus incidental color or intensity patterns. • Another use case for the above equation are Smoothgrad [ 14 ] and SmoothLRP [ 15 ] . These methods explicitly leverage statistical averaging of attribution maps computed over perturbed inputs, where each x^{(i)} is generated by adding independently sampled noise to the original test image. 3.1 Base quantities and Notation Let g\circ h denote the composition of functions. We consider a neural network of n layers. \displaystyle f_{k}(x) \displaystyle=g_{k}^{(n)}\circ\sigma^{(n-1)}\circ g^{(n-1)}\circ\sigma^{(n-2)}\circ g^{(n-2)}\circ\ldots\circ g^{(r)}\circ\ldots\circ g^{(1)}(x) (3) \displaystyle z^{(r)} \displaystyle:=\sigma^{(r)}\circ g^{(r-1)}\circ\ldots\circ g^{(1)}(x) (4) where \sigma^{(r)} is an activation function and g^{(r)} is a neural network layer, which is usually an affine transformation and which receives a feature map z^{(r-1)} as input. We assume that one layer is a mapping g:\mathbb{R}^{S}\longrightarrow\mathbb{R}^{R} . We consider here affine layers such as convolution layers or fully connected layers, where u\cdot v denotes here the usual Euclidean inner product \displaystyle g(z)=Wz+b=(g_{1}(z),\ldots,g_{R}(z))=(W_{1,:}\cdot z+b_{1},\ldots,W_{R,:}\cdot z+b_{R}) (5) 3.1.1 Gradient Using Jacobian matrices Jg^{(r)} , J\sigma^{(r)} for the corresponding layers, the gradient of the above network for output component f_{k} can be expressed as a series of matrix multiplications: \displaystyle Df_{k}(x) \displaystyle=\nabla^{\top}g_{k}^{(n)}J^{\top}\sigma^{(n-1)}\cdot