Graph-based Integrated Gradients for Explaining Graph Neural Networks

Lachlan Simpson, Kyle Millar, Adriel Cheng, Cheng-Chew Lim, Hong Gunn Chew · 2025

Read Graph-based Integrated Gradients for Explaining Graph Neural Networks by Lachlan Simpson, Kyle Millar, Adriel Cheng, Cheng-Chew Lim, Hong Gunn Chew (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-07648.txt.

Introduction

Lachlan Simpson leads a 5-author team in 2025 adapting Integrated Gradients to explain graph neural networks. Integrated Gradients is a method that credits a network's output to its inputs. It fights the black-box problem of neural networks. It assumes continuous data, though. Graphs are discrete structures of nodes and edges. That makes the standard method a poor fit for graph models.

Their extension is called graph-based Integrated Gradients. On four synthetic datasets, it picks out the structural parts the classifier truly used. On three widely used real-world graph datasets, it beats standard Integrated Gradients. It highlights the key features for node classification tasks more sharply. Better explanations matter where graph models screen molecules, transactions, or networks. In such fields, users must be able to trust or contest the answer.

Catalog record

CREATORLachlan Simpson, Kyle Millar, Adriel Cheng, Cheng-Chew Lim, Hong Gunn Chew
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-07648

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Graph-based Integrated Gradients for Explaining Graph Neural Networks Lachlan Simpson, Kyle Millar, Adriel Cheng, Cheng-Chew Lim, Hong Gunn Chew Abstract 1 Introduction Modelling how entities in data are related to one another is a primary focus in biology, computer science, and the social sciences [ 16 ] . Protein interactions [ 11 ] , malicious activity on a computer network [ 15 ] and recommending products [ 9 ] are examples. Such relationships within data are aptly described by graphs [ 16 ] . The efficacy of graph neural networks in graph learning tasks comes with the trade-off of explainability [ 30 ] . The limited explainability of neural networks results in a lack of trust in predictions [ 10 ] . The increasing distrust in neural networks in safety critical systems, along with the EU AI safety act and Australian AI safety guardrails, necessitate the development of graph explainability models [ 5 , 7 ] . Classical explainable AI (XAI) on continuous array-based data provides an explanation of a prediction in terms of the input features. Graph explainability is fundamentally different as an explanation requires both features and structure. Geometric deep learning (GDL) introduced by Bronstein et al. [ 3 ] demonstrates that incorporating the geometry (structure) of data is crucial in developing robust machine learning techniques. The application of GDL to XAI has proven effective in developing adversarial and user-friendly XAI techniques [ 21 , 22 ] . Integrated gradients [ 24 ] is a prevalent XAI technique deployed ubiquitously to explain the predictions of machine learning models. Recent work has focused on extending IG to datasets with continuous non-Euclidean geometry [ 4 , 20 , 22 , 29 ] . There is yet to be an extension of IG to discrete data such as graphs. In this work using the principals of GDL, we propose graph-based integrated gradients(GB-IG); a novel extension of IG to graphs. We demonstrate that GB-IG yields explanations that successfully highlight important nodes and geometric structures in classification problems which classical IG fails to. The contributions of this work are twofold: 1. We introduce graph-based integrated gradients (GB-IG), a novel extension of IG which outperforms IG in identifying important nodes and substructures in node classification tasks. 2. We demonstrate that GB-IG satisfies several theoretical axioms of IG. We introduce a new axiom, path-based completeness. Path-based completeness reduces to regular completeness in \mathbb{R}^{n} . The axioms ensure an implementation of GB-IG may be rigorously validated. The remainder of this work is structured as follows: Section 2 discuses related work, Section 3 provides a background on graph machine learning and integrated gradients, Section 4 introduces GB-IG, Section 5 compares GB-IG with variants of IG across four synthetic and three real-world graph datasets. We conclude in Section 6 with a discussion of future works. 2 Related Work Incorporating the geometry of the data into integrated gradients is done within the context of the manifold hypothesis. The manifold hypothesis stipulates that datasets lie on a low-dimensional Riemannian manifold [ 8 , 26 ] . We note that work on incorporating geometry into XAI models utilise image classification datasets, not graphs. Extending IG to incorporate geometry is undertaken within a Riemannian framework. Zaher et al. [ 29 ] propose manifold integrated gradients (MIG). The shortest path between two points in Euclidean space is a straight line. On a Riemannian manifold the shortest path is a length minimising geodesic. MIG replaces the straight line equation in IG with a geodesic on the manifold. The geodesic ensures the explanations remain within the distribution of the data. In [ 22 ] the authors leverage the tangent space of the Riemannian manifold to construct a base-point such that the explanations align with the tangent space. Tangentially aligned integrated gradients ensures the explanations are meaningful to the user and highlight the object to be classified [ 2 ] . In the domain of word embeddings Sanyal et al. [ 20 ] propose discretising IG along non-linear paths in the embedding space. Discretised IG (DIG) corresponds to the discrete nature of word embeddings. Costanza et al. [ 4 ] introduce Riemannian IG (RIG). RIG abstracts integrated gradients to a general compact connected Riemannian manifold, not necessarily embedded in Euclidean space. The extension of IG to a smooth manifold is the central theme in the aforementioned techniques. Whilst DIG discretises IG to non-linear paths, the points are embedded in a continuous space, namely the embedding manifold. In this work, we extend both MIG and DIG to undirected and unweighted graphs. MIG demonstrates that in non-Euclidean geometry, the shortest paths between two points is not necessarily a straight line. For a graph equipped with a distance metric the shortest path is not a straight line as there is no notion of a straight line in a graph nor is the shortest path unique [ 16 ] . DIG provides the methodology to construct IG along non-linear paths. Graphs may be considered as discretised manifolds [ 17 ] . GB-IG is then a discretised extension of MIG and DIG, a central contribution of this work. 3 Graph Machine Learning and Integrated Gradients Graphs consist of a set of nodes \mathcal{N} and edges \mathcal{E} . The set of edges \mathcal{E} defines the connections between nodes and may be represented by the adjacency matrix \mathbf{A} . The adjacency matrix is an |\mathcal{N}|\times|\mathcal{N}| binary matrix where \mathbf{A}_{ij}=1 if (i,j)\in\mathcal{E} and 0 otherwise. Nodes may be equipped with d -dimensional feature vectors. The set of feature vectors is an |\mathcal{N}|\times d matrix denoted by \mathbf{X} . We will denote a graph as the pair \mathcal{G}=(\mathbf{X},\mathbf{A}) . Graph neural networks operate on the assumption that a node is characterised by its relationship to neighbouring nodes. Given a target node, the feature vectors of neighbouring nodes are aggregated together to form a representation of the target node. Given a graph (\mathbf{X},\mathbf{A}) , the l -th graph convolutional network (GCN) layer first proposed by Kipf and Welling [ 13 ] is defined as: \mathbf{H}^{(l+1)}=\sigma(\tilde{\mathbf{D}}^{-\frac{1}{2}}\tilde{\mathbf{A}}\tilde{\mathbf{D}}\mathbf{H}^{(l)}\mathbf{W}^{(l)}), (1) where, \mathbf{H}^{(0)}=\mathbf{X} , \tilde{\mathbf{A}}=\mathbf{A}+\mathbf{I} , \tilde{\mathbf{D}} is the diagonal degree matrix of \tilde{\mathbf{A}} , \mathbf{W}^{(l)} is a learnable weight matrix, and \sigma is a non-linear activation function. Equation 1 demonstrates that the structure and features of a graph are coupled together in graph neural networks. Integrated gradients (IG) is a popular gradient explainability technique. IG is defined below. Definition 1 [ 24 ] Given a base-point b\in\mathbb{R}^{d} and a point to explain x\in\mathbb{R}^{d} , we define IG as \IG(x,b)=(x-b)\odot\int_{0}^{1}\nabla f(tx+(1-t)b)\differential t, (2) where \odot is the Hadamard product. IG assumes data is continuous and the shortest path between two points is a straight line. The base-point is chosen a-priori and fundamentally alters the explanations [ 12 ] . Below we provide three commen base-point choices for IG in literature [ 23 ] : 1. Zero . Here the base-point for all points is a constant zero vector b^{\text{zero}}=0. (3) 2. Uniform . We sample uniformly over a valid range of \mathbf{X} b^{\text{uniform}}_{i}\sim U(\min_{i},\max_{i}). (4) 3. Gaussian . A Gaussian filter is applied to the input x . b^{\text{Gaussian}}=\sigma\cdot v+x, (5) where, v_{i}\sim\mathcal{N}(0,1) and \sigma\in\mathbb{R} . For a discussion of the impact of each base-point choice we refer the reader to

Read the complete text