Fragment-Wise Interpretability in Graph Neural Networks via Molecule Decomposition and Contribution Analysis

Sebastian Musiał, Bartosz Zieliński, Tomasz Danel · 2025

Read Fragment-Wise Interpretability in Graph Neural Networks via Molecule Decomposition and Contribution Analysis by Sebastian Musiał, Bartosz Zieliński, Tomasz Danel (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-15015.txt.

Introduction

Sebastian Musiał, Bartosz Zieliński, and Tomasz Danel make graph neural networks explain themselves one molecule fragment at a time, in this 2025 paper. Such networks predict molecular properties well, but their inner reasoning is a black box, which limits trust in drug discovery and materials design. Earlier explanation tools struggle to pin credit on single atoms or parts because the network's messages tangle everything together.

Their model, SEAL, splits each molecule into chemically meaningful fragments and estimates how much each fragment causes the final prediction. The design deliberately throttles message passing between fragments, so each part's contribution stays readable. On synthetic benchmarks and real molecular data sets, SEAL beat rival explanation methods on attribution scores and on how well explanations matched human judgment. A user study with domain experts found its explanations more intuitive and trustworthy.

Catalog record

CREATORSebastian Musiał, Bartosz Zieliński, Tomasz Danel
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE74 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2508-15015

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Fragment-Wise Interpretability in Graph Neural Networks via Molecule Decomposition and Contribution Analysis Sebastian Musiał, Bartosz Zieliński, Tomasz Danel Abstract Graph neural networks have demonstrated remarkable success in predicting molecular properties by leveraging the rich structural information encoded in molecular graphs. However, their black-box nature reduces interpretability, which limits trust in their predictions for important applications such as drug discovery and materials design. Furthermore, existing explanation techniques often fail to reliably quantify the contribution of individual atoms or substructures due to the entangled message-passing dynamics. We introduce SEAL (Substructure Explanation via Attribution Learning), a new interpretable graph neural network that attributes model predictions to meaningful molecular subgraphs. SEAL decomposes input graphs into chemically relevant fragments and estimates their causal influence on the output. The strong alignment between fragment contributions and model predictions is achieved by explicitly reducing inter-fragment message passing in our proposed model architecture. Extensive evaluations on synthetic benchmarks and real-world molecular datasets demonstrate that SEAL outperforms other explainability methods in both quantitative attribution metrics and human-aligned interpretability. A user study further confirms that SEAL provides more intuitive and trustworthy explanations to domain experts. By bridging the gap between predictive performance and interpretability, SEAL offers a promising direction for more transparent and actionable molecular modeling. Introduction Predicting molecular properties is a cornerstone task in computational chemistry, with applications spanning drug discovery, materials science, and chemical synthesis ( Elton et al. 2019 ) . Graph Neural Networks (GNNs) have emerged as state-of-the-art models for this task, thanks to their ability to naturally represent molecular structures as graphs of atoms and bonds ( Wieder et al. 2020 ) . However, despite their impressive predictive performance, GNNs suffer from a critical limitation: their decision-making processes are largely opaque. Moreover, explaining the predictions of GNNs through external methods is challenging, primarily due to the message aggregation mechanism, which is invariant to node permutation. This results in a disorganized exchange of information among nodes, making explanations increasingly difficult with each graph layer. This often leads to the well-known issue of oversmoothing, where the atomic representation becomes independent of its localization within the graph ( Zhang et al. 2023 ) . This challenge creates a significant problem when applying GNNs in domains where interpretability is crucial for advancing scientific discovery. We hypothesize that GNNs operating on molecular graphs decomposed into fragments are more interpretable while preserving sufficient expressivity. Many chemical prediction tasks inherently depend more on the presence and identity of specific fragments than on complex interactions between them. Functional groups and other substructures often dominate the behavior of molecules with respect to properties such as solubility, toxicity, and reactivity ( von Korff and Sander 2006 ; Tanaka, Okamoto, and Bersohn 2010 ; Tuttle et al. 2023 ) . For instance, in drug discovery, the binding affinity of a molecule to a target protein is frequently the cumulative result of individual fragment-level interactions, such as hydrogen bonds, hydrophobic interactions, or \pi - \pi stacking from aromatic rings, each contributing additively to the overall binding energy ( Murcko 1995 ) . Similarly, properties like lipophilicity or metabolic stability are often strongly associated with the presence of particular chemical motifs, irrespective of subtle global dependencies. While GNNs are capable of modeling complex dependencies between atoms, in many real-world tasks, fragment-level contributions offer sufficient explanatory power for guiding chemical reasoning and decision-making. By focusing on these contributions, the fragment-based model can produce explanations that are chemically intuitive and well-suited for application in molecular design. Figure 1: Overview of SEAL comprising a message passing stage (a) , in which a molecular graph is divided into fragments and different weights are applied within and between fragments, and a fragment aggregation stage (b) , in which fragment representations are computed and used to produce fragment contributions; the model prediction is a sum of all fragment contributions. Recent efforts have sought to interpret GNN predictions by attributing importance to individual nodes, edges, or subgraphs ( Ponzoni, Páez Prosper, and Campillo 2023 ) . While these methods provide some insight, they often fail to produce explanations that align with the way chemists conceptualize molecular behavior. Chemists typically reason about molecules not as collections of individual atoms or bonds but in terms of fragments, such as functional groups, aromatic rings, or side chains, that are strongly associated with specific properties or behaviors ( Talanquer 2022 ) . Existing explainability methods fail to capture this crucial level of abstraction, limiting their practical relevance for molecular modeling. In this paper, we introduce SEAL ( S ubstructure E xplanation via A ttribution L earning), a novel interpretable GNN that generates fragment-wise explanations of model predictions for molecular property prediction (Figure 1 ). SEAL decomposes molecular graphs into chemically meaningful fragments and quantifies the individual contribution of each fragment to the model output. By aligning interpretability with chemical intuition, our approach enables domain experts to leverage machine learning predictions for better hypothesis generation and experimental design. Our contributions are threefold: 1. We propose a novel approach for fragment-based interpretability in GNNs for molecular property prediction. 2. We define a new graph convolutional layer and regularization terms that facilitate information retention in the fragments, resulting in more intuitive explanations. 3. We conduct extensive experiments that demonstrate that our model produces more coherent and actionable explanations compared to existing methods while maintaining competitive predictive performance. The code is available at https://github.com/gmum/SEAL . Related Work Graph neural networks. GNNs have become a standard method for analyzing molecular data, often using either a message-passing mechanism ( Gilmer et al. 2020 ) or a transformer-based architecture ( Rong et al. 2020 ; Maziarka et al. 2024 ) . Some of these networks work on fragment graphs where atom groups serve as nodes instead of individual atoms. For example, Cao et al. 2024 proposed a GNN that uses fragment-level message passing for better explainability but still relies on external explainers to determine fragment contributions. Wang et al. 2025 recently introduced FragFormer, a transformer that operates on fragments and employs a variant of the CAM method ( Zhou et al. 2016 ) to explain its predictions. In both models, fragments can contain significant signals coming from other parts of the molecule, potentially reducing local interpretability. Graph-based explainers. Many explainable AI (XAI) techniques have been proposed to elucidate the predictions of GNNs. Some identify important subgraphs by perturbing the input graph ( Ying et al. 2019 ; Vu and Thai 2020 ; Yuan et al. 2021 ) , while other methods analyze the message-passing mechanism in each layer ( Feng et al. 2022 ; Gui et al. 2023 ) . Often, explaining GNNs is difficult due to the large number of subgraphs and the complex message-passing process. Therefore, Henderson, Clevert, and Montanari 2021 proposed regularization techniques that disentangle node representations, aiding in generating better explanations. Another approach involves presenting explanations at the fragment level. For instance, Wu et al. 2023 employed BRICS ( Degen et al. 2008 ) to break down molecules into chemically plausible segments and elucidate predictions by masking entire molecular fragments. Inherently interpretable methods are also being developed, including prototype-based graph neural networks ( Zhang et al. 2022 ; Rymarczyk, Dobrowolski, and Danel 2023 ) and attention-based models ( Xiong et al. 2019 ;

Read the complete text