A Self-Explainable Heterogeneous GNN for Relational Deep Learning
Francesco Ferrini [email protected], Antonio Longa [email protected], Andrea Passerini [email protected], Manfred Jaeger [email protected] · 2024
Read A Self-Explainable Heterogeneous GNN for Relational Deep Learning by Francesco Ferrini [email protected], Antonio Longa [email protected], Andrea Passerini [email protected], Manfred Jaeger [email protected] (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-00521.txt.
Introduction
Francesco Ferrini, Antonio Longa, Andrea Passerini, and Manfred Jaeger build a graph neural network for relational databases that can explain itself, in a 2024 paper. Turning a database into a graph lets neural networks predict from linked tables, but real databases spawn far too many connection patterns to try them all. Earlier methods either needed experts to pick the useful patterns or assumed one occurrence was enough.
Their network learns which multi-step patterns matter and weighs evidence from many occurrences, not just one. On synthetic and real data it beat existing methods and surfaced patterns that match how its predictions are actually made. The explanations come built in rather than added afterward.
Catalog record
| CREATOR | Francesco Ferrini [email protected], Antonio Longa [email protected], Andrea Passerini [email protected], Manfred Jaeger [email protected] |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 75 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-00521
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Self-Explainable Heterogeneous GNN for Relational Deep Learning Francesco Ferrini [email protected], Antonio Longa [email protected], Andrea Passerini [email protected], Manfred Jaeger [email protected] Abstract Recently, significant attention has been given to the idea of viewing relational databases as heterogeneous graphs, enabling the application of graph neural network (GNN) technology for predictive tasks. However, existing GNN methods struggle with the complexity of the heterogeneous graphs induced by databases with numerous tables and relations. Traditional approaches either consider all possible relational meta-paths, thus failing to scale with the number of relations, or rely on domain experts to identify relevant meta-paths. A recent solution does manage to learn informative meta-paths without expert supervision, but assumes that a node’s class depends solely on the existence of a meta-path occurrence. In this work, we present a self-explainable heterogeneous GNN for relational data, that supports models in which class membership depends on aggregate information obtained from multiple occurrences of a meta-path. Experimental results show that in the context of relational databases, our approach effectively identifies informative meta-paths that faithfully capture the model’s reasoning mechanisms. It significantly outperforms existing methods in both synthetic and real-world scenarios. 1 Introduction Graph Neural Networks (GNNs) have increasingly become the de-facto standard for many predictive tasks involving networked data, such as physical systems ( Sanchez-Gonzalez et al. 2018 ; Battaglia et al. 2016 ) , Knowledge Graphs ( Hamaguchi et al. 2017 ) and social networks ( Wu et al. 2020 ) . By learning effective node embeddings, GNNs offer a unified framework for addressing various graph-based tasks, including node classification, graph classification, and link prediction. However, similar to other representation learning paradigms, GNNs often exhibit a black-box nature in their predictions. Numerous solutions have been proposed for post-hoc explainability of GNN predictions, primarily at the instance-based level ( Ying et al. 2019 ; Vu & Thai 2020 ; Miao et al. 2022 ; Yuan et al. 2021 ) . Yet, as with other deep learning architectures, the ability of these approaches to genuinely reflect the underlying reasoning of the predictor has been called into question ( Longa et al. 2024 ) . To tackle this challenge, self-explainable GNNs ( Kakkad et al. 2023 ; Christiansen et al. 2023 ; Seo et al. 2023 ) have recently emerged, aiming to ensure that GNN predictions are grounded in interpretable elements, such as subgraphs ( Wu et al. 2022 ; Yu et al. 2020 ) or prototypes ( Zhang et al. 2022 ; Ragno et al. 2022 ) . Despite the widespread adoption of GNNs, most approaches are tailored for homogeneous graphs, where edge types are indistinguishable. While encoding edge types as features is a common workaround, the standard solution simply consists in concatenating the one-hot encoded edge type to node features, which eventually boils down to learning an edge-type specific bias. This limitation is particularly problematic in knowledge graphs, which typically feature numerous relations (corresponding to edge types), with only a few being pertinent to a specific predictive task—forming the so-called meta-paths. Existing approaches for heterogeneous GNNs either rely on domain experts to provide relevant meta-paths a priori ( Chang et al. 2022 ; Fu et al. 2020 ; Li et al. 2021 ; Wang et al. 2019 ) , or attempt to learn them from data by assigning different weights to various relations ( Hu et al. 2020 ; Lv et al. 2021b ; Mitra et al. 2022 ; Schlichtkrull et al. 2018 ; Yu et al. 2022 ; Yun et al. 2019b ; Yun et al. 2022a ; Zhu et al. 2019 ) , a solution that fails to scale with the number of candidate relations. Recently, MP-GNN ( Ferrini et al. 2024 ) has been proposed as a solution for learning meta-paths without requiring user supervision. This approach employs a scoring function to predict the potential informativeness of partial meta-paths, enabling efficient exploration of the combinatorial space of candidate meta-paths. However, a key limitation of MP-GNN is the existential quantification assumption which states that a node’s class is primarily dependent on the existence of a meta-path instance, meaning just one instance is sufficient for accurate prediction. its assumption that a node’s class is primarily dependent on the existence of a meta-path instance, meaning just one instance is sufficient for accurate prediction. While this assumption may be reasonable for knowledge graphs, it is unrealistic when dealing with relational databases, where entities are characterized by numerous categorical and numerical attributes. On the other hand, this same complexity makes relational databases particularly well-suited for GNN technology, as evidenced by the growing interest in what is now being termed relational deep learning ( Fey et al. 2023 ) . Figure 1 : Left : Relational database schema for a medical domain. Right : Heterogeneous graph representation of (part of) the database. The highlighted subgraph shows a prototypical counts-of-counts pattern characterising positive patients, namely having at least two exempt prescriptions (represented by node feature T), each containing at least two medications. Existing heterogeneous GNNs struggle with these patterns as they need to learn a separate weight matrix for each edge type in the graph, while MPS-GNN is capable of learning the relevant meta path without any direct user supervision. In this paper, we extend the concept behind MP-GNN beyond the simple existential quantification of meta-paths. We introduce Meta-Path Statistics GNN ( MPS-GNN ), an approach that automatically identifies relevant meta-paths, where the informative content is determined by learnable statistics computed on their realizations. These include counts-of-counts statistics such as having at least two exempt prescriptions with at least two medications each to characterize patients with severe illness, as shown in Figure 1 . Note that MP-GNN would fail to discriminate between the two patient nodes in the figure, as they both have at least one occurrence of the correct meta-path. An experimental evaluation on both synthetic and real-world relational database tasks demonstrate the significant advantages of the proposed solution over existing alternatives. Additionally, results show how the meta-path learning strategy behind MPS-GNN renders it inherently and genuinely self-explainable, in contrast to many existing self-explainable GNN architectures whose explanations often lack fidelity ( Christiansen et al. 2023 ) . 2 Related Work Relational deep learning ( Fey et al. 2023 ) has recently emerged as a paradigm advocating the application of deep learning technology, and GNNs in particular, to relational databases. The rationale behind this research direction is the popularity of relational databases as a mean to store relational information in a variety of application domains, combined with the fact that relational databases can be seen as heterogeneous graphs, with tables converted into sets of nodes and relations into (typed) edges between table entries ( Robinson et al. 2024 ) . This transformation allows the application of heterogeneous Graph Neural Networks (GNNs) to this kind of data. A common characteristics of most heterogeneous graphs, including those deriving from knowledge graphs and relational databases, is that only few relations convey relevant information when targeting a specific predictive task. For this reason, plain GNNs, that do not distinguish between edge types, struggle with these type of graphs. The most popular line of research for heterogeneous GNNs identifies meta-paths, i.e., sequences of relations, as primary sources of information. Existing approaches to