GRAM-DTI: Adaptive Multimodal Representation Learning for Drug–Target Interaction Prediction

Feng Jiang, Amina Mollaysa, Hehuan Ma, Tommaso Mansi, Junzhou Huang, Mangal Prakash, Rui Liao, University of Texas, Johnson & Johnson Innovative Medicine · 2025

Read GRAM-DTI: Adaptive Multimodal Representation Learning for Drug–Target Interaction Prediction by Feng Jiang, Amina Mollaysa, Hehuan Ma, Tommaso Mansi, Junzhou Huang, Mangal Prakash, Rui Liao, University of Texas, Johnson & Johnson Innovative Medicine (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-21971.txt.

Introduction

Predicting whether a drug will bind to its target protein is a basic step in computer-aided drug discovery. Feng Jiang and six co-authors present GRAM-DTI in this 2025 paper. Earlier deep learning methods mostly read two inputs: a text form of the molecule and the protein sequence. That leaves out rich extra information available for both molecules and proteins.

GRAM-DTI pre-trains on four kinds of input at once, aligning them in a shared representation. Its contrastive method works with volumes rather than pairs, catching alignment across all inputs together. An adaptive dropout scheme turns each input stream up or down based on how informative it is during training. Where lab measurements of binding strength exist, they serve as weak guidance to ground the representations. On four public data sets, the framework beat the best existing baselines throughout.

Catalog record

CREATORFeng Jiang, Amina Mollaysa, Hehuan Ma, Tommaso Mansi, Junzhou Huang, Mangal Prakash, Rui Liao, University of Texas, Johnson & Johnson Innovative Medicine
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-21971

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

GRAM-DTI: Adaptive Multimodal Representation Learning for Drug–Target Interaction Prediction Feng Jiang, Amina Mollaysa, Hehuan Ma, Tommaso Mansi, Junzhou Huang, Mangal Prakash, Rui Liao, University of Texas, Johnson & Johnson Innovative Medicine Abstract Drug target interaction (DTI) prediction is a cornerstone of computational drug discovery, enabling rational design, repurposing, and mechanistic insights. While deep learning has advanced DTI modeling, existing approaches primarily rely on SMILES–protein pairs and fail to exploit the rich multimodal information available for small molecules and proteins. We introduce GRAM-DTI, a pre-training framework that integrates multimodal molecular and protein inputs into unified representations. GRAM-DTI extends volume-based contrastive learning to four modalities, capturing higher-order semantic alignment beyond conventional pairwise approaches. To handle modality informativeness, we propose adaptive modality dropout, dynamically regulating each modality’s contribution during pre-training. Additionally, IC50 activity measurements, when available, are incorporated as weak supervision to ground representations in biologically meaningful interaction strengths. Experiments on four publicly available datasets demonstrate that GRAM-DTI consistently outperforms state-of-the-art baselines. Our results highlight the benefits of higher-order multimodal alignment, adaptive modality utilization, and auxiliary supervision for robust and generalizable DTI prediction. 1 Introduction Drug target interaction (DTI) prediction is a central challenge in computational drug discovery, underpinning applications in rational drug design, repurposing of approved drugs, and elucidation of mechanisms of action ( Vefghi et al. 2025 ) . Traditional experimental screening, though reliable, is prohibitively expensive and cannot feasibly cover the vast chemical and proteomic search space. Computational methods therefore play an increasingly critical role in prioritizing candidate drug–protein pairs for experimental validation, accelerating discovery pipelines and reducing cost ( Panahandeh & Mansouri 2025 ; Liao et al. 2025 ) . DTI prediction methods have evolved from similarity-based and network-based heuristics to machine learning and, more recently, deep learning approaches ( Shi et al. 2024 ; Panahandeh & Mansouri 2025 ) . Early methods relied on molecular similarity or interaction propagation but struggled with generalization. Modern neural models, including graph neural networks and sequence-based architectures now dominate, learning directly from raw SMILES and amino acid sequences ( Peng et al. 2024 ; Zhao et al. 2025 ; Liu et al. 2025 ; Xia et al. 2023 ) . However, these approaches remain largely restricted to SMILES–protein pairs, overlooking the richer multimodal information available for molecules and proteins that could yield more robust and generalizable interaction predictions. While multimodal pre-training has been recently explored by few works for DTI prediction ( Lu et al. 2025 ; Ye et al. 2021 ; Chen et al. 2020 ) , existing approaches suffer from three limitations. Firstly, they rely on pairwise contrastive learning anchored to a single modality. Such schemes cannot capture higher-order interdependencies as the number of modalities increases ( Cicchetti et al. 2024 ) . Secondly, they assume all modalities are equally informative, ignoring that data sources often differ in quality, completeness, and relevance across samples and training stages. Static fusion can therefore lead to suboptimal representations when dominant but less informative modalities overshadow complementary signals. Finally, valuable supervision signals such as IC50 activity measurements are publicly available for a subset of drug–protein pairs, yet they remain unutilized during pre-training despite their direct biological relevance for DTI prediction task. Figure 1: Overview of GRAM-DTI architecture. Left: pretraining phase with volume-based multimodal alignment across four modalities (SMILES, text, HTA, protein sequences). The framework uses gradient-informed adaptive modality selection to dynamically regulate modality contributions during training. Right: downstream task prediction. To address these gaps, we propose GRAM-DTI, a novel multimodal pre-training framework specifically tailored for downstream DTI prediction task (see Fig. 1 ). To this end, we curate a high quality multimodal dataset consisting of diverse protein and small molecule modalities and adapt the recent volume-based contrastive learning strategies from other domains ( Cicchetti et al. 2024 ; Jiang et al. 2025a ) for geometric alignment of these modalities. Unlike traditional contrastive learning techniques, this offers a theoretically principled and scalable approach for aligning multiple modalities. Beyond volume based contrastive learning, our framework is novel in its flexibility to learn to dynamically weight each modality based on its informativeness during pre-training while also supporting activity-based labels as auxiliary supervisory signals, when available. Our main contributions are as follows. • We introduce GRAM-DTI, a pre-training framework for DTI that integrates multimodal small molecule protein modalities into a unified representation with volume-based contrastive learning. • We introduce adaptive modality dropout, dynamically regulating modality contributions during pre-training to prevent dominant but less informative modalities from overwhelming complementary signals. • We leverage IC50 activity measurements as additional weak auxiliary supervision, grounding learned representations in biologically meaningful drug–target interactions. • We demonstrate state-of-the-art performance across four public datasets and multiple evaluation settings relevant for real-world drug discovery applications. 2 Related Works Multimodal Molecular Representation Learning Recent advancements in molecular representation learning have shifted towards integrating multiple data modalities to enhance predictive performance. For instance, frameworks like TRIDENT ( Jiang et al. 2025a ) combine SMILES strings, hierarchical taxonomic annotations, and functional text of small molecules to capture richer molecular semantics. These approaches leverage contrastive learning pretraining to align diverse data sources, which improvs generalization across various molecular downstream tasks even in the absence of fully paired datasets. Beyond TRIDENT, several molecular foundation models have been introduced, including MolFM ( Luo et al. 2023 ) and MolCA ( Liu et al. 2023 ) , which integrate molecular graphs, textual descriptions, and domain-specific annotations into unified representations. These works highlight the broader trend of leveraging multimodal pre-training to construct general-purpose molecular representations. Drug–Target Interaction (DTI) Prediction DTI prediction has traditionally relied on unimodal representations, such as SMILES strings for drugs and amino acid sequences for proteins. Early deep learning models such as DeepDTA ( Öztürk et al. 2018 ) , MT-DTI ( Shin et al. 2019 ) , and TransformerCPI ( Chen et al. 2020 ) demonstrated the effectiveness of sequence-based architectures for interaction prediction. Beyond sequence-based methods, more recent work has explored graph neural networks and SE(3)-equivariant geometric deep learning models, such as GraphDTA ( Nguyen et al. 2021 ) and EquiBind ( Stärk et al. 2022 ) , which leverage spatial and structural information of drugs and proteins to enhance binding affinity prediction. In parallel, knowledge graph–based methods such as NeoDTI ( Wan et al. 2019 ) and Hetionet-based repurposing frameworks ( Himmelstein et al. 2017 ) exploit biomedical networks to capture higher-order relations among drugs, targets, and diseases. More recently, multimodal approaches have been proposed to better capture the complexity of drug–target interactions. For example, MDTips ( Xia et al. 2023 ) integrates knowledge graphs, gene expression profiles, and structural information, while MGNDTI ( Peng et al. 2024 ) employs a multimodal graph neural network to improve robustness and generalization. Another emerging direction is pre-training with large-scale unlabeled data to mitigate the scarcity of labeled DTI pairs. For instance, DTIAM ( Lu et al. 2025 ) introduces separate pretraining for drug and target modalities before merging the learned representations for DTI prediction. Modality Dropout Modality dropout techniques have been proposed to enhance the robustness of multimodal models by preventing over-reliance on any single modality. For instance, the Learnable Irrelevant Modality Dropout (IMD) method ( Alfasly et al. 2022 ) selectively drops irrelevant modalities during training, improving performance in

Read the complete text