Relative Layer-Wise Relevance Propagation: a more Robust Neural Networks eXplaination

Nyiri [email protected], ier Gibaru [email protected] · 2025

Read Relative Layer-Wise Relevance Propagation: a more Robust Neural Networks eXplaination by Nyiri [email protected], ier Gibaru [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-14322.txt.

Introduction

Explaining a neural network's verdict means tracing how much each input pixel pushed the output, and one popular tracing method breaks when it divides by tiny values. Eric Nyiri and Olivier Gibaru offer a repair in this 2025 paper, called Relative Layer-Wise Relevance Propagation. Their version keeps the method's bookkeeping rule up to a scaling factor, while dodging the small divisions.

The method needs no tuning knobs, unlike its rivals, and it works on dense, convolutional, and residual networks alike. The authors compare it across datasets and four network designs, from simple models to deep residual ones, using image classification as the test bed. Pixel contribution maps from the method point analysts toward the regions that drove each prediction.

Catalog record

CREATORNyiri [email protected], ier Gibaru [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE55 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-14322

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Relative Layer-Wise Relevance Propagation: a more Robust Neural Networks eXplaination Nyiri [email protected], ier Gibaru [email protected] Abstract Machine learning methods are solving very successfully a plethora of tasks, but they have the disadvantage of not providing any information about their decision. Consequently, estimating the reasoning of the system provides additional information. For this, Layer-Wise Relevance Propagation (LRP) is one of the methods in eXplainable Machine Learning (XML). Its purpose is to provide contributions of any neural network’s output in the domain of its input. The main drawback of current methods is mainly due to division by small values. To overcome this problem, we provide a new definition called Relative LRP where the classical conservation law is satisfied up to a multiplicative factor but without divisions by small values except for Resnet skip connection. In this article, we will focus on image classification. This allows us to visualize the contributions of a pixel to the predictions of a multi-layer neural network. Pixel contributions provide a focus to further analysis on regions of potential interest. R-LRP can be applied for any dense, CNN or residual neural networks. Moreover, R-LRP doesn’t need any hyperparameters to tune contrary to other LRP methods. We then compare the R-LRP method on different datasets with simple CNN, VGG16, VGG19 and Resnet50 networks. E. Nyiri and O. Gibaru † † heading: xx 2024 1- 03/24; Revised xx/yy xx/yy 21-0000 † † shortheadings: R-LRP XML / E. Nyiri and O. Gibaru † † firstpage: 1 † † editor: xxx keywords Layer-Wise Relevance Propagation, eXplainable Machine Learning, interpretability, theory of neural networks, directed acyclic graph 1 LRP Introduction XML methods are especially useful in safety-critical domains like finance, vision control, robotics Guérin et al., 2018a Guérin et al., 2018 Simão et al., 2019 Simão et al., 2019b Guérin et al., 2021 or gesture assistance Simão et al., 2017 Simão et al., 2019a Simão et al., 2019c where engineers (resp. practitioners for medicine) must know exactly what the network is paying attention to. Other use-cases are the diagnosis of network behavior/misbehavior and improving the network architecture. The umbrella term eXplainable Machine Learning or explainable AI can be used for many different techniques Holzinger et al., 2022 . LIME Ribeiro et al., 2016 and RISE Petsiuk et al., 2018 methods consider networks as black-boxes. They produce relevant regions in saliency maps in order to explain the decision of a network. As explained in Covert et al., 2021 , these techniques estimate importance by probing the model with randomly masked versions of the input image. They then obtained the corresponding outputs, which are used to produce the map. The advantage is that they don’t need to know the structure of networks. The main drawback is that they cannot provide fine-grained pixel analysis in the decision-making process. This is mostly due to the fact that the masks cannot cover the area of influence of each input/pixel independently. To overcome this problem, interpretability is needed. Two closely related branches of interpretability methods are propagation-based and gradient-based approaches. They either propagate the algorithm’s decision back through the model or make use of the sensitivity information provided by gradients of the loss. Prominent representatives are Deconvolution Networks, Guided Backpropagation, Grad-CAM, Integrated Gradients, and Layer-Wise Relevance Propagation (LRP). In this article, we will mainly address LRP methodology Bach et al., 2015 , Montavon et al., 2017 , Montavon et al., 2019 , Lapuschkin et al., 2019 , Kohlbrenner et al., 2020 . Some methods are very closely related to LRP. In Zeiler & Fergus, 2014 , the authors visualized neuron activation with a deconvolutional network. In Simonyan & Zisserman, 2015 , saliency maps are computed based on Taylor decomposition. Springenberg et al., 2015 addressed Guided Backpropagation soon afterward. Zhang et al., 2018 introduced excitation backprop which casts the backpropagation as a probabilistic process. Selvaraju et al., 2017 defined Grad-Cam for CNNs and Sundararajan et al., 2017 presented the Integrated Gradient method. Gradient-based approaches are problematic because activation functions such as Rectified Linear Units (ReLUs) have a gradient of zero when they are not firing, and yet a ReLU that does not fire can still carry information. Similarly, sigmoid or tanh activations are popular choices for the activation functions of gates in memory units of recurrent neural networks such as GRUs Chung et al., 2014 and LSTMs Hochreiter & Schmidhuber, 1997 . These activations have a near-zero gradient at high or low inputs, even though such inputs can be very significant. Intuitively, LRP uses the network weights and the neural activations created by the forward-pass to propagate the output back through the network up until the input layer. There, pixels that really contributed to the output can be visualized. The magnitude of each pixel’s contribution or intermediate neuron are called “relevance” values. Lapuschkin et al., 2017 have used the LRP-method to investigate networks predicting gender and age from image data. Thomas et al., 2019 have applied the technique to a large set of MRI neuroimaging data, explaining brain states from 3D data. Arras et al., 2017 have applied LRP to text, to investigate how a neural network classifies text as belonging to one topic or another. Horst et al., 2019 analyzed human gait patterns with LRP. Srinivasan et al., 2017 used LRP to find out exactly what parts of a video are used by a classifier for human action recognition. Montavon et al., 2019 have applied LRP to Atari games and image classification. In this article, we define a new LRP method called R-LRP which is more robust and gives better pixels’ contributions than other current LRP methods. To visualize pixels’ contributions, authors usually use heatmaps, but these representations are subject to interpretation and depend on heatmaps settings. We prefer to visualize contributions in terms of percentage of most relevant inputs issued from each RGB channel separately or pixels in images. R-LRP source code is available at https://gitlab.ensam.eu/NYIRI/r-lrp 1.1 DAGs for feed-forward networks The typical setting for supervised learning is to find an approximation of an unknown function f , given a training data set of its point values: \{x^{(i)},f(x^{(i)})\}_{i=1,...,m} where x^{(i)}\in\mathbb{R}^{d} and f(x^{(i)})\in\mathbb{R}^{p} . For example, in classification problems for images, d is the number of pixels \times the number of channels in the images, typically somewhere in the range of 10^{3} to 10^{6} , and for videos it is even higher. The learning problem is then to numerically produce from this data a function \hat{f} that is in some sense a good predictor of f on new unseen draws x\in\mathbb{R}^{d} . The data fitting task is formulated in a stochastic setting, where one assumes that the data comes from random draws of the data sites x^{(i)} with respect to a probability distribution, and the values f(x^{(i)}) are noisy observations of some unknown function f . In the following, we will consider "good predictor" based on feed-forward neural network. They can be associated to a directed acyclic graph (or DAG) called the architecture of the neural network DeVore et al., 2021 . Definition 1 (Feed-forward neural network) . A feed-forward neural network \mathcal{N} is defined by a directed acyclic graph \mathcal{G}=(\mathcal{V},\mathcal{E}) where 1. \mathcal{V} is a finite set of vertices and \mathcal{E} is a finite set of directed edges

Read the complete text