What Molecular Structure Cannot Tell Us: A Taxonomy of Explainability Gaps in GNN-Based Drug Toxicity Prediction

Juergen Dietrich · 2026

Read What Molecular Structure Cannot Tell Us: A Taxonomy of Explainability Gaps in GNN-Based Drug Toxicity Prediction by Juergen Dietrich (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-26183.txt.

Introduction

Dietrich argues that not every clinically relevant adverse effect can be inferred from molecular structure, whatever the model. Graph neural networks predict harm straight from atomic links, avoiding fingerprint loss, yet the share of a drug's known profile that structure alone can reveal stays unmapped. The paper builds a working taxonomy of structure limits, regardless of learning method. A case study of acetylsalicylic acid, aspirin, one of pharmacology's best known drugs, maps which effects structure can and cannot foresee. A companion removal study on drug-drug interactions confirms the gaps.

Catalog record

CREATORJuergen Dietrich
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE30305
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.26183

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

What Molecular Structure Cannot Tell Us: A Taxonomy of Explainability Gaps in GNN-Based Drug Toxicity Prediction Juergen Dietrich Abstract Not all clinically relevant adverse effects are structurally inferable from molecular graphs — regardless of model quality or architectural complexity. This study introduces an operational taxonomy of the structural information limits that prevent structure-based toxicity prediction, independent of the learning algorithm employed. Graph Neural Networks (GNNs) have emerged as a natural approach for molecular toxicity prediction, operating directly on atomic connectivity without the information loss inherent to fixed-length fingerprints. However, the fraction of a drug’s known pharmacological profile that is actually inferable from molecular structure remains systematically underexplored. A systematic case study using acetylsalicylic acid (ASA, Aspirin) — one of the most comprehensively characterized drugs in pharmacology — serves as model compound. A Message Passing Neural Network (MPNN) is trained on the Tox21 benchmark and GNNExplainer is applied to characterize atom-level attribution. Results indicate that molecular structure explains approximately 45% (5/11) of known ASA adverse effects. A four-category Gap Taxonomy (GAP-1 through GAP-4) is introduced distinguishing between principally non-encodable effects, data gaps arising from Missing Not At Random (MNAR) mechanisms, assay panel mismatches, and representation errors. The MNAR gap is empirically quantified via a systematic ChEMBL query (42 documented assays, 0 retrievable bioactivity entries). An attention pooling experiment localizes the representation error to the MPNN message passing layers rather than the aggregation step. The Gap Taxonomy has direct implications for drug safety signal detection and regulatory frameworks including Good Pharmacovigilance Practice (GVP) guidelines and New Approach Methodologies (NAMs). Structural limits identified are confirmed in a companion DDI ablation study. Keywords: Graph Neural Networks, Drug Toxicity, GNNExplainer, Missing Not At Random, Pharmacovigilance, Tox21, Attention Pooling, New Approach Methodologies, Gap Taxonomy This work is licensed under CC BY 4.0 . 1 Introduction Throughout this paper, abbreviations are expanded at first occurrence; a complete glossary is provided in Table 4 . 1.1 Motivation The prediction of adverse drug reactions (ADR) and drug toxicity from molecular structure alone represents one of the central challenges in computational pharmacology. Early identification of toxic compounds reduces attrition in drug development, lowers costs, and — most critically — protects patients from preventable harm. Graph Neural Networks (GNNs) have emerged as a structurally natural approach: molecules are inherently graphs, and GNNs operate directly on atomic connectivity without the information loss inherent to fixed-length fingerprints or text-based molecular encodings [ 1 , 3 ] . Despite rapid methodological progress, a fundamental question remains underexplored: what fraction of a drug’s known pharmacological profile is actually encodable in its molecular structure? This question is not merely academic. As pharmacovigilance workflows increasingly incorporate machine learning components, regulatory frameworks are adapting accordingly. Good Pharmacovigilance Practice (GVP) guidelines — the primary regulatory framework governing drug safety monitoring in the European Union (EU) — are being extended to address transparency and mechanistic coverage requirements for AI-based safety systems (European Medicines Agency (EMA) AI Workplan 2023–2028). New Approach Methodologies (NAMs) — the regulatory umbrella term for modern alternatives to animal testing including in-silico, in-vitro, and systems biology approaches — are increasingly used for safety assessment. A key unresolved question for both GVP and NAMs is whether their assay panels provide sufficient mechanistic coverage for specific drug classes. Acetylsalicylic acid (ASA, commonly known as Aspirin) is selected as the model compound for five methodologically motivated reasons. First, 125 years of clinical use have produced one of the most complete adverse effect profiles in pharmacology, enabling ground-truth validation at a level rarely achievable for newer compounds. Second, both on-target toxicity (cyclooxygenase (COX)-1 inhibition causing gastrointestinal (GI) bleeding and platelet dysfunction) and off-target toxicity (mitochondrial uncoupling, hepatotoxicity) are characterized at mechanistic resolution, providing a stringent test for structure-based prediction. Third, the adverse effect profile spans all four Gap categories (defined in Section 2.2 ) — making ASA uniquely suited to demonstrate the full taxonomy. Fourth, mechanisms are understood at atomic resolution, enabling pharmacophore-level GNNExplainer validation. Fifth, with only 13 heavy atoms, atomic attribution remains directly interpretable — a property lost in larger molecules where GNNExplainer outputs become difficult to map onto discrete pharmacophores. 1.2 Related Work Graph-based molecular representations for toxicity prediction have been advanced by Message Passing Neural Networks (MPNNs) [ 4 ] and their application to the Tox21 benchmark (Toxicology in the 21st Century, a public high-throughput screening dataset with 12 toxicological assay endpoints [ 7 ] ). Multi-task learning across Tox21’s 12 endpoints exploits shared structural motifs and has become standard practice [ 14 ] . Post-hoc explainability via GNNExplainer [ 15 ] reveals which atoms drive classification decisions, enabling comparison against known pharmacophores. The Missing Not At Random (MNAR) problem [ 10 ] — where data absence correlates with the missing value itself — has been recognized in cheminformatics [ 11 , 12 ] but rarely quantified empirically for specific endpoints. Attention pooling [ 6 ] offers a potential remedy for atom-weighting biases in mean pooling, but its effect on pharmacophore attribution has not been studied against GNNExplainer ground truth. 1.3 Contributions This study makes four contributions: 1. A four-category Gap Taxonomy (GAP-1 through GAP-4) classifying failure modes of structure-based toxicity prediction by root cause. 2. Empirical GNNExplainer-based localization of a representation error (GAP-4) in ASA: the model focuses on the aromatic ring rather than the pharmacologically relevant carboxyl group for mitochondrial uncoupling endpoints (SR-MMP pharmacophore ratio: 0.646 under mean pooling). 3. Empirical quantification of the MNAR gap (GAP-2) via a systematic ChEMBL query [ 8 ] : 42 documented SR-MMP assays, 0 retrievable bioactivity entries for carboxylic acid structures — confirming that the data necessary to resolve GAP-4 resides in proprietary repositories. 4. An attention pooling experiment demonstrating that GAP-4 originates in the MPNN message passing layers, not in the aggregation step: the gate network correctly upweights carboxyl atoms ( \alpha=0.62 ), but atom embeddings remain ring-dominated from the confounded training distribution. 2 Methods 2.1 Molecular Graph Construction ASA (SMILES: CC(=O)Oc1ccccc1C(=O)O — a text-based notation where atoms are letters, bonds are implicit, and rings are denoted by numbers) is converted to a molecular graph using RDKit [ 5 ] . The graph has 13 nodes (heavy atoms) and 26 directed edges (13 bonds, each represented in both directions for bidirectional message passing). Each atom is described by a 31-dimensional feature vector: atom type (11 binary flags), hybridization state (6 flags), formal charge (1), hydrogen count (5 flags), ring membership (1), aromaticity (1), chirality (4 flags), and normalized atomic mass (1). Each bond is described by 12 features: bond type (5 flags), conjugation (1), ring membership (1), and stereo configuration (5 flags). Numbers in square brackets throughout refer to the numbered references. 2.2 The Four Gap Categories Gap Taxonomy Overview GAP-1 Principally non-encodable: the adverse effect requires patient-level information (age, genetics, co-infection, dose history) absent from the molecular graph. No amount of additional training data or better architecture can resolve this gap. GAP-2 Data gap (MNAR): the effect is structurally predictable in principle, but training data is systematically absent from public databases — not by random chance, but because assays were never performed or results remain proprietary. GAP-3 Assay panel mismatch: no assay in the training panel (Tox21) measures the relevant biological mechanism. The model cannot learn

Read the complete text