Knowledge-aware contrastive heterogeneous molecular graph learning
Mukun Chen · 2025
Read Knowledge-aware contrastive heterogeneous molecular graph learning by Mukun Chen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-11711.txt.
Introduction
Mukun Chen leads a team proposing a knowledge aware way to represent molecules in a 2025 paper, though the byline lists the team with him first. Predicting molecular properties guides drug design, and graph models are the standard tool. Older methods encode only the molecule's own structure, missing outside knowledge and different levels of detail. Their framework rebuilds each molecule as a mixed type graph.
Three views are combined: the molecule itself, its elements, and its pharmacological traits. A dual message passing scheme moves information within and across those views. Contrastive learning then enriches the representation with embedded external knowledge. Benchmarks showed the method beating leading property prediction models. It also serves downstream jobs such as predicting drug interactions. The authors argue that layered, knowledge fed graphs capture fine molecular features better.
Catalog record
| CREATOR | Mukun Chen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-11711
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Knowledge-aware contrastive heterogeneous molecular graph learning Mukun Chen Abstract Abstract Molecular representation learning is pivotal in predicting molecular properties and advancing drug design. Traditional methodologies, which predominantly rely on homogeneous graph encoding, are limited by their inability to integrate external knowledge and represent molecular structures across different levels of granularity. To address these limitations, we propose a paradigm shift by encoding molecular graphs into heterogeneous structures, introducing a novel framework: Knowledge-aware Contrastive Heterogeneous Molecular Graph Learning. This approach leverages contrastive learning to enrich molecular representations with embedded external knowledge. KCHML conceptualizes molecules through three distinct graph views—molecular, elemental, and pharmacological—enhanced by heterogeneous molecular graphs and a dual message-passing mechanism. This design offers a comprehensive representation for property prediction, as well as for downstream tasks such as drug-drug interaction prediction. Extensive benchmarking demonstrates KCHML’s superiority over state-of-the-art molecular property prediction models, underscoring its ability to capture intricate molecular features. Author summary In the field of drug discovery, predicting molecular properties and drug interactions is crucial for developing new medications and ensuring patient safety. Traditional methods for representing molecular structures often fail to incorporate external knowledge and struggle to capture complex interactions at different levels of detail. To address these limitations, we developed a new framework called Knowledge-aware Contrastive Heterogeneous Molecular Graph Learning (KCHML). Our approach integrates information from three perspectives—molecular structure, elemental relationships, and pharmacological data—using advanced machine learning techniques. This combination allows for a more detailed and accurate representation of molecules, leading to better predictions of molecular properties and drug interactions. By improving how we model and understand molecules, our work has the potential to streamline drug development and reduce the risk of harmful drug interactions, contributing to safer and more effective treatments. Introduction At the core of computational drug discovery lies Molecular Representation Learning (MRL), a field that integrates state-of-the-art machine learning techniques with biomedical applications. MRL not only enhances our understanding of molecular interactions but also refines predictive models that are critical for both drug property and drug-drug interaction (DDI) prediction, two key tasks in biological research. By transforming extensive molecular datasets into actionable insights, MRL empowers researchers to explore novel therapeutic avenues and tailor treatments to specific biological markers, while also predicting potential drug interactions that could affect treatment outcomes. The accuracy of these predictions is crucial for the evaluation and selection of molecules across a wide range of applications, from therapeutic interventions to industrial chemicals. This precision facilitates the early identification of promising candidates, streamlining the drug development process, mitigating the risk of costly late-stage failures, and ensuring the safe combination of drugs. MRL involves the rigorous study of molecular structures and encoding strategies, with advanced models adept at capturing the complexities of molecular geometries, bond types, and functional groups—key factors in both the precise prediction of chemical properties and the prediction of drug interactions [ 1 , 2 ] . Various graph neural network architectures, such as GCN [ 3 ] , GIN [ 4 ] , GAT [ 5 ] , GGNN [ 6 ] , and GraphSage [ 7 ] , offer distinct approaches to molecular structure learning. Increasingly, MRL has been aligned with the Message Passing Neural Network (MPNN) framework, as established by Gilmer et al. [ 8 ] , which has emerged as a fundamental paradigm in the field. These models emphasize the graph-based topologies of molecular structures, with advanced variants such as DMPNN [ 9 ] , CMPNN [ 10 ] , and CoMPT [ 11 ] leveraging both node and edge attributes to enhance message-passing efficiency and accuracy for tasks such as molecular property prediction and DDI prediction. Recent advancements in self-supervised learning, exemplified by context prediction and attribute masking in PreGNN [ 12 ] and GROVER [ 13 ] , have shown remarkable potential in both molecular property and DDI prediction. These approaches introduce advanced methodologies for learning molecular representations but remain primarily focused on local structural properties, often neglecting the integration of external knowledge such as drug-target interactions or therapeutic outcomes. To address this gap, knowledge graph (KG)-based methods, including KGNN [ 14 ] , MDNN [ 15 ] and MKG-FENN [ 16 ] , have emerged, framing molecules as interconnected nodes to incorporate external pharmacological insights. These models provide a more comprehensive perspective, blending molecular and therapeutic views. However, a critical limitation of current KG-based frameworks lies in their inability to seamlessly integrate the detailed microscopic features of drug molecules with their broader biological roles, particularly when predicting interactions between drugs. Despite significant strides, molecular representation learning continues to face profound challenges. The inherent complexity and heterogeneity of molecular structures frequently hinder the formation of robust embedded representations. Furthermore, traditional methods relying on homogeneous graph encoding are constrained by their limited capacity to incorporate external knowledge and often fail to capture the multi-granular intricacies of molecular structures. Consequently, integrating structural and pharmacological data into a cohesive model remains a complex yet essential task. As the field progresses, contrastive learning has emerged as a powerful technique, enhancing the generalizability and resilience of graph encoders. However, significant challenges persist, as illustrated in Fig. 1 . Graph augmentation strategies—such as node dropping, edge perturbation, attribute masking, and subgraph generation [ 17 ] —can unintentionally compromise the fidelity of molecular structures, particularly when external knowledge is integrated [ 18 ] . While these augmentations offer new views of molecular configurations, they often overlook the profound impact of minor structural perturbations on pharmacological properties and drug interactions. For example, perturbing edges within a benzene ring, a fundamental structural motif known for its stability and distinctive chemical reactivity, can misrepresent the molecule’s aromatic characteristics, potentially misleading the model. Similarly, removing specific nodes, such as a chlorine atom, risks eliminating crucial information regarding the molecule’s reactivity and solubility, given chlorine’s critical role in the biological activity of many pharmaceutical compounds. Most models fall short in accounting for these subtleties during contrastive learning sample generation, especially when predicting drug interactions. Fig 1: Homogeneous graphs struggle to capture the nuanced granularity of molecules and hinder the integration of external knowledge. Introducing external knowledge through heterogeneous graphs mainly involves two challenges: (1) heterogeneous graph encoding and (2) imbalanced knowledge sampling. Meanwhile, sample sizes vary across different knowledge levels; elemental knowledge applies universally to molecules, whereas drug knowledge pertains only to pharmacologically active molecules that have been identified as drugs. Drug knowledge encompasses comprehensive data on drug efficacy, mechanisms of action, metabolic pathways, and potential side effects—details not relevant to non-drug molecules. This creates a challenge in sample distribution, as non-drug molecules vastly outnumber drug molecules, leading to potential imbalances in training. Such imbalances can cause the model to overemphasize elemental data while underutilizing the detailed pharmaceutical insights that are critical for predicting complex drug properties and interactions. To address these challenges, we introduce the cross-view Knowledge-aware Contrastive Heterogeneous Molecular Graph Learning (KCHML) methodology. KCHML seeks to surpass existing methods by integrating structural, functional, and pharmacological perspectives of molecules. It employs a tripartite view framework: the molecular view, the element view, and the drug view. This framework integrates molecular structure, elemental knowledge, and pharmacological data, which are processed through a dual message-passing mechanism. By leveraging contrastive learning, KCHML constructs both positive and negative examples across views, enhancing