BetaExplainer: A Probabilistic Method to Explain Graph Neural Networks
Whitney Sloneker, Shalin Patel, Michael Wang, Lorin Crawford, Ritambhara Singh · 2024
Read BetaExplainer: A Probabilistic Method to Explain Graph Neural Networks by Whitney Sloneker, Shalin Patel, Michael Wang, Lorin Crawford, Ritambhara Singh (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-11964.txt.
Introduction
Whitney Sloneker and co-authors present a way to explain graph neural networks in a 2024 paper. Such networks predict from data shaped as linked points, but users cannot see which links drove a result. Many explainers exist, yet they cannot state how sure they are about each link's weight.
Their method, called BetaExplainer, adds a prior that favours sparse link sets during training. Unneeded links get masked away, and the rest carry a measure of doubt. On test sets built to mimic hard real cases, the method gave clearer accounts of each result. It also beat leading explainers on scores for the toughest sets.
Catalog record
| CREATOR | Whitney Sloneker, Shalin Patel, Michael Wang, Lorin Crawford, Ritambhara Singh |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 40 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-11964
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
BetaExplainer: A Probabilistic Method to Explain Graph Neural Networks Whitney Sloneker, Shalin Patel, Michael Wang, Lorin Crawford, Ritambhara Singh Abstract Graph neural networks (GNNs) are powerful tools for conducting inference on graph data but are often seen as ”black boxes” due to difficulty in extracting meaningful subnetworks driving predictive performance. Many interpretable GNN methods exist, but they cannot quantify uncertainty in edge weights and suffer in predictive accuracy when applied to challenging graph structures. In this work, we proposed BetaExplainer which addresses these issues by using a sparsity-inducing prior to mask unimportant edges during model training. To evaluate our approach, we examine various simulated data sets with diverse real-world characteristics. Not only does this implementation provide a notion of edge importance uncertainty, it also improves upon evaluation metrics for challenging datasets compared to state-of-the art explainer methods. Keywords: Deep learning, graph neural networks, probabilistic models, explainability, variational inference 1 Introduction Relational data occur in a variety of domains, such as social graphs [ 25 ] , chemical structures [ 17 ] , physical systems [ 25 ] , gene-gene interactions [ 25 ] , and epidemiological modeling [ 8 ] . These data are best represented by graphs that effectively model their relationships, such as chemical bonds in drug molecules that affect toxicity or treatment efficacy [ 25 ] or personal interactions in social networks indicating contact [ 17 ] . Although graph information represents these datasets more accurately by incorporating node features (i.e., chemical weight for molecules) and node interactions through edges (i.e., chemical bonds) [ 25 ] , large-scale modeling to learn their patterns can be challenging if the graphs are complex [ 6 , 22 ] . Embedding methods such as Graphlets [ 12 ] and DeepWalk [ 10 ] have been developed to address these challenges. However, they may oversimplify complex graphical features by summarizing the graph and ignoring node features [ 18 ] . As a result, graph neural networks (GNNs) have been widely adopted in the machine learning community to model graph-based datasets because they incorporate edge structure and node features directly [ 26 , 16 ] . GNN models have broad applications, such as capturing the complexity of traffic dynamics, approximating NP-hard graph combinatorial analysis, and learning real-world graphs such as molecule structures [ 25 ] . However, like other deep learning models, they can be hard to explain [ 23 ] . It is challenging to extract important edges from which the GNN is learning to make accurate predictions [ 23 ] . Determining these important edges is needed for hypothesis development [ 23 ] , such as answering ”what chemical bonds might determine the prediction of toxicity in a molecule?”. As a result, it is critical to develop GNN explanation methods to understand the model predictions that highlight the graph’s important edges. Many methods have been created to explain GNNs, that is, highlight the important edges for predictions, but their performances vary widely depending on the underlying properties of the data or the GNN model. For example, gradient-based explainability methods struggle to produce accurate edge explanations when deep learning models experience gradient saturation [ 20 ] . Data properties can also influence the explainer’s performance. A recent benchmark study [ 1 ] found that many methods (Grad [ 13 ] , GradCAM [ 11 ] , GuidedBP [ 2 ] , Integrated Gradients [ 14 ] , GNNExplainer [ 19 ] , PGExplainer [ 9 ] , SubgraphX [ 21 ] , and PGMExplainer [ 15 ] ) struggle against challenging data properties. For example, if the underlying graph of the data is heterophilic 1 1 1 When a graph is highly heterophilic, it means edges tend to connect nodes of different classes. Its opposite, a homophilic graph, means edges tend to connect nodes of the same class. or a low proportion of node features are critical for classification, the existing explainer methods struggle to produce accurate edge explanations from the GNN model. The study shows that out of all the existing methods, only GNNExplainer, PGExplainer, and SubgraphX function as effective edge explainers for GNN models [ 1 ] . However, PGExplainer often underperforms most methods in generating accurate edge explanations for the simulated datasets [ 1 ] . On the other hand, SubgraphX has a robust performance [ 1 ] . However, it cannot rank the edge importance as each highlighted edge is only denoted as 0 (as unimportant) or 1 (as important) [ 20 ] . This ranking is essential to hypothesis generation as it allows researchers to focus on the most highly ranked edges, thus easing downstream analysis. For instance, in the case of exploring edges representing gene-gene interactions for biological datasets, edges ranked based on their importance allow us to focus on experimentally confirming only the most likely interactions, saving the time and monetary cost required for wet lab experiments [ 3 ] . Finally, GNNExplainer performs relatively well on the proposed synthetic datasets [ 1 ] while also returning importance scores that can be used to rank the relevant edges of the GNN model [ 20 ] . As a result, GNNExplainer best represents state-of-the-art edge explainers for GNNs. Even so, its struggle to produce accurate edge explanations suggests a knowledge gap for explainer methods on the tested challenging datasets. We explored another challenging setting for GNN explainer methods – explaining a GNN model for graph datasets constructed with sparse node features. A dataset with sparse node features is one where many node features are zeros. Sparse node feature datasets are common in various real-world domains, especially in the now-emerging single-cell gene expression data (or scRNA-seq). These datasets are notoriously sparse, and any gene-gene correlation or interaction graphs created from them will result in graphs with low informative node features [ 4 ] [ 3 ] . We hypothesize that existing explainers will also struggle to accurately return edge explanations for the sparse node feature dataset. However, due to their commonality, thus, ensuring explainability methods succeed on sparse node datasets is necessary. We propose a new method, BetaExplainer, that uses a probabilistic distribution to determine the important edges from a GNN model. BetaExplainer learns a probabilistic edge mask to maximize the similarity of the output of the trained GNN on a masked graph to its original output through statistical inference to approximate which edges are most important (Fig. 1 ). This probabilistic approach allows us to produce edge importance scores with uncertainty quantification and rank edges by the order of score confidence. have evaluated BetaExplainer on seven simulated datasets with various challenging underlying data properties that explainers struggle to adapt to, including a heterophilic graph and a sparse node feature dataset. The results demonstrate that BetaExplainer significantly outperforms existing methods in being faithful to the underlying graph importance on five out of seven simulated datasets and improves accuracy compared to state-of-the-art methods on graph datasets with sparse features. It also conveys a notion of uncertainty in edge importance for its explanations, which provides guidance to downstream analysis. Figure 1 : BetaExplainer returns a mask for the important edges of a graph for a GNN’s classification. As it learns a probabilistic model to represent these important edges,