From Detection to Mechanism: Cross-Attention Graph Neural Networks Enable Drug-Drug Interaction Type Prediction An Ablation Study with Acetylsalicylic Acid Validation

Juergen Dietrich · 2026

Read From Detection to Mechanism: Cross-Attention Graph Neural Networks Enable Drug-Drug Interaction Type Prediction An Ablation Study with Acetylsalicylic Acid Validation by Juergen Dietrich (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-27861.txt.

Introduction

Juergen Dietrich compares three graph neural networks at predicting not just whether two drugs interact but what kind of interaction occurs. A dual network with cross-attention between molecules beat simple concatenation on mechanism-type accuracy by a wide margin, while barely improving simple yes-or-no detection. On ten held-out aspirin drug pairs it named every interaction type correctly, unlike the ternary rival, which named none.

Catalog record

CREATORJuergen Dietrich
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23261
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.27861

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

From Detection to Mechanism: Cross-Attention Graph Neural Networks Enable Drug-Drug Interaction Type Prediction An Ablation Study with Acetylsalicylic Acid Validation Juergen Dietrich Abstract Predicting whether two drugs interact (binary detection) is a substantially different task from predicting the mechanism type of that interaction (multi-class classification). This study presents a systematic ablation study of three Graph Neural Network (GNN) architectures for drug-drug interaction (DDI) prediction on a publicly available benchmark dataset comprising 38,337 positive pairs across 86 interaction types. Three architectures are compared under identical training conditions (n = 61,339 pairs): a siamese dual Message Passing Neural Network (MPNN) with concatenation (Concat), a dual MPNN with four-head cross-attention (CrossAtt), and a ternary MPNN incorporating an interaction graph (Ternary). CrossAtt improves multi-class F1-macro by + 0.186 +0.186 absolute ( + 45 % +45\% ) over Concat, while improving binary AUC by only + 0.012 +0.012 ( + 1.3 % +1.3\% ) — confirming that atom-level inter-molecular communication specifically enables mechanism-type classification. The ternary architecture underperforms despite equivalent training data, with its failure consistent with a training instability hypothesis. Validation on ten acetylsalicylic acid (ASA) drug pairs, held out prior to training, demonstrates 10/10 correct DDI-type predictions for CrossAtt versus 0/10 for Ternary. Two consistent failure cases are identified across all architectures, linking to structural limits established in a companion toxicity study. Keywords: Drug-Drug Interaction, Graph Neural Networks, Cross-Attention, Message Passing, Ablation Study, Pharmacovigilance, Mechanism Classification, Acetylsalicylic Acid This work is licensed under CC BY 4.0 . 1 Introduction Throughout this paper, abbreviations are expanded at first occurrence; a complete glossary is provided in Table Glossary of Abbreviations . 1.1 Motivation Drug-drug interactions (DDI) represent a major source of preventable adverse drug reactions (ADR), contributing to an estimated 6.5% of hospital admissions in developed countries [ 10 ] . Automated DDI prediction from molecular structure has attracted substantial research interest, with Graph Neural Networks (GNNs) emerging as a natural approach due to their ability to operate directly on molecular graphs without information loss [ 1 , 5 ] . Most existing approaches frame DDI prediction as a binary task — interaction present or absent [ 4 , 2 , 8 ] . For clinical decision support, however, the interaction mechanism type is equally important: the interaction between ASA and warfarin (pharmacokinetic, protein binding displacement plus cyclooxygenase (COX) inhibition) requires different clinical management than the interaction between ASA and ibuprofen (pharmacodynamic, competitive COX-1 inhibition). This study investigates whether atom-level cross-attention between interacting molecules improves mechanism-type classification more than binary detection — a question with direct implications for pharmacovigilance signal detection under Good Pharmacovigilance Practice (GVP) Module IX. 1.2 Choice of Validation Compound ASA is selected as the pharmacological validation compound for five reasons. First, 125 years of clinical use have produced one of the most complete DDI profiles in pharmacology. Second, both interacting mechanisms and relevant pharmacophores are characterized at atomic resolution, enabling direct interpretation of cross-attention outputs. Third, with 83 pairs across 15 DDI types in the benchmark dataset, ASA provides a statistically meaningful held-out validation set. Fourth, ASA’s 13 heavy atoms make atom-level attention patterns directly interpretable. Fifth, the companion toxicity study [ 3 ] identified two structurally non-encodable DDI mechanisms for ASA that serve as negative controls for structural-limit testing here. To the author’s knowledge, ASA has not previously been used as a pharmacologically characterized held-out validation compound for GNN-based DDI type prediction. 1.3 Related Work GNN-based DDI prediction has advanced since Nyamabo et al. [ 9 ] introduced the SSI-DDI benchmark (Substructure-Substructure Interaction DDI) and its substructure-interaction framework. Subsequent work has explored attention mechanisms [ 4 ] , graph transformers [ 2 ] , and multimodal approaches [ 8 ] . Binary DDI prediction on SSI-DDI has reached AUC values above 0.95 with state-of-the-art models; multi-class mechanism-type prediction remains more challenging (F1-macro 0.50–0.70). Systematic ablation studies isolating the contribution of cross-attention to mechanism-type classification have not been reported on this benchmark. 1.4 Contributions This study makes three contributions: 1. A three-way ablation study (Concat vs. CrossAtt vs. Ternary) on identical training data (n = 61,339 pairs), isolating the effect of cross-attention and interaction graphs on binary and multi-class DDI prediction. 2. Empirical demonstration that cross-attention specifically enables mechanism-type classification ( +45\% F1-macro) while providing minimal benefit for binary detection ( +1.3\% AUC). 3. Pharmacologically grounded failure analysis: two consistent failure cases (sertraline, probenecid) across all architectures are linked to structural limits (GAP-1/GAP-3) from the companion study [ 3 ] . 2 Methods 2.1 Dataset and Data Splits The SSI-DDI benchmark [ 9 ] is a publicly available curated dataset of drug-drug interactions derived from DrugBank [ 12 ] . It comprises 38,337 positive DDI pairs involving 1,597 unique drugs, annotated with 86 interaction types (numerical codes 0–85, covering pharmacological mechanisms such as serum concentration alteration, excretion rate change, and metabolism modification). Negative pairs are generated by uniform random sampling from all drug SMILES (Simplified Molecular Input Line Entry System), without structural similarity filtering (1:1 ratio, n = 38,337 negatives), consistent with the original SSI-DDI benchmark [ 9 ] . This standard approximation introduces a Missing Not At Random (MNAR) bias [ 11 ] : some randomly sampled pairs may have undocumented interactions. The combined dataset (76,674 pairs) is split 80/20 by random shuffling (SEED = 42): n {}_{\text{train}} = 61,339, n {}_{\text{test}} = 15,335. This pair-level split is consistent with the original benchmark; a drug may appear in both training and test pairs, though not in the same pair combination. The ASA held-out set constitutes a true cold-drug evaluation: no ASA pair appears in training or test. ASA (DrugBank ID: DB00945) has 83 positive pairs across 15 DDI types in the dataset, extracted prior to the train/test split and held out as a separate pharmacological validation set. A molecular graph cache is precomputed from all unique SMILES required for training, testing, ASA validation, and reference compounds (n = 1,605 unique graphs; \approx 1.1 GB RAM). Graph construction uses RDKit [ 7 ] with 31-dimensional atom features and 12-dimensional bond features, identical to the companion toxicity study [ 3 ] . 2.2 Architecture Overview All three architectures share a common siamese (shared-weight) encoder: both molecules in a pair are processed by the same MPNN, exploiting the chemical symmetry of the DDI prediction task. The encoder uses three Neural Network Convolution (NNConv) layers with 64-dimensional hidden states, BatchNorm, Rectified Linear Unit (ReLU) activation, and Dropout ( p = 0.2). The architectures differ only in how the two molecular representations are combined before the final Multi-Layer Perceptron (MLP) classifier. Architecture Comparison Concat (Baseline): After MPNN encoding, global mean pooling produces one vector per molecule. The two 64-dimensional vectors are concatenated (128d) and passed to the MLP. No inter-molecular atom-level information exchange. 434,871 parameters. CrossAtt: After MPNN encoding, four-head cross-attention is applied: each atom in molecule A attends to all atoms in molecule B and vice versa, producing interaction-enriched atom embeddings before pooling. 468,407 parameters ( +7.7\% over Concat; cross-attention adds 33,536 parameters). Ternary: Extends CrossAtt with an explicit interaction graph: Top-3 cosine-similarity inter-molecular atom pairs receive edges; a third MPNN processes this combined graph. 477,239 parameters ( +9.7\% over Concat). 2.3 Training Protocol All architectures use identical training: Adam optimizer [ 6 ]

Read the complete text