Learning to Align Molecules and Proteins: A Geometry-Aware Approach to Binding Affinity

Mohammadsaleh Refahi, Bahrad A. Sokhansanj, James R. Brown, Gail Rosen · 2025

Read Learning to Align Molecules and Proteins: A Geometry-Aware Approach to Binding Affinity by Mohammadsaleh Refahi, Bahrad A. Sokhansanj, James R. Brown, Gail Rosen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-20693.txt.

Introduction

Picking which drug candidates to test in the lab is slow and expensive. Mohammadsaleh Refahi and three co-authors present FIRM-DTI, a model that predicts how strongly a drug binds its target protein, in a 2025 paper. Better early predictions can focus lab work on the most promising compounds.

Most deep learning models simply join molecule and protein features together. FIRM-DTI instead lets the protein features reshape the molecule features through a modulation layer. A triplet loss keeps the learned space well structured, and a smooth regression head turns distances into affinity scores. The authors report top results on a Therapeutics Data Commons benchmark designed to test generalization across chemical space and time.

Catalog record

CREATORMohammadsaleh Refahi, Bahrad A. Sokhansanj, James R. Brown, Gail Rosen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2509-20693

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Learning to Align Molecules and Proteins: A Geometry-Aware Approach to Binding Affinity Mohammadsaleh Refahi, Bahrad A. Sokhansanj, James R. Brown, Gail Rosen Abstract Accurate prediction of drug–target binding affinity can accelerate drug discovery by prioritizing promising compounds before costly wet-lab screening. While deep learning has advanced this task, most models fuse ligand and protein representations via simple concatenation and lack explicit geometric regularization, resulting in poor generalization across chemical space and time. We introduce FIRM-DTI , a lightweight framework that conditions molecular embeddings on protein embeddings through a feature-wise linear modulation (FiLM) layer and enforces metric structure with a triplet loss. An RBF regression head operating on embedding distances yields smooth, interpretable affinity predictions. Despite its modest size, FIRM-DTI achieves state-of-the-art performance on the Therapeutics Data Commons DTI-DG benchmark, as demonstrated by an extensive ablation study and out-of-domain evaluation. Our results underscore the value of conditioning and metric learning for robust drug–target affinity prediction.(Code available at https://github.com/EESI/Firm-DTI ) 1 Introduction The process of discovering a new therapeutic agent hinges on understanding how strongly a candidate molecule binds to a protein target. Binding affinity determines pharmacological potency and selectivity, but measuring it experimentally is laborious and expensive. Computational predictions of binding affinity therefore play an important role in virtual screening and lead optimization. Traditional quantitative structure–activity relationship models rely on handcrafted descriptors and are often restricted to narrow chemical series. Deep neural networks promise to learn richer representations from raw sequences and graphs, yet many state - of - the - art methods treat the two modalities independently and use ad - hoc interaction layers without explicit regularization. Furthermore, high - quality affinity data are scarce relative to the vast chemical and proteomic space, making generalization to novel drugs and targets challenging. This work proposes a simple and effective architecture that addresses these limitations. Instead of concatenating ligand and protein features, we employ a FiLM conditioning layer to modulate molecular embeddings by protein embeddings, allowing the model to learn target - specific transformations. We additionally incorporate a triplet metric - learning objective that pulls interacting pairs together and pushes non - interacting pairs apart in the embedding space. A radial basis function (RBF) regression head then maps distances to continuous affinity values. As we show on a temporally split benchmark, this combination yields competitive performance with far fewer parameters than recent large models. 2 Background Deep learning has become a cornerstone of drug–target interaction (DTI) and binding affinity prediction. Early sequence-based methods typically embedded drug SMILES strings and protein sequences with recurrent or convolutional networks, then combined the embeddings with a feed-forward layer. More recent representation learning approaches have introduced graph neural networks for molecular structures and large protein language models for amino acid sequences. For instance, MolE employs a disentangled attention transformer to produce atom-level graph embeddings Méndez-Lucio et al. 2024 , while ESM leverages masked language modeling over massive protein corpora to yield residue-aware embeddings Lin et al. 2023 . ChemBERTa Chithrananda et al. 2020 and rxnfp Schwaller et al. 2021 have further demonstrated the utility of pretrained transformers directly on SMILES strings for chemical property prediction. Hybrid architectures often concatenate drug and protein embeddings and pass them through a multilayer perceptron, but this strategy ignores conditional dependencies between ligands and targets Thafar et al. 2022 . Knowledge-based models attempt to mitigate this by integrating curated interaction networks or graph-derived embeddings (e.g., node2vec over protein–protein interaction graphs), yet such external information is costly to maintain and may not generalize across chemical space Lam et al. 2023 ; Fattahi et al. 2019 . Recent studies show that residue-level protein language model embeddings contain rich contextual signals for drug–target interaction tasks, especially when combined with transfer learning strategies such as contrastive or task-specific pretraining NaderiAlizadeh and Singh 2025 ; Singh et al. 2023 ; Sledzieski et al. 2022 . However, most sequence-based DTI models still rely on simple concatenation of drug and protein representations, which limits their ability to capture robust geometric relationships in the latent space. Explicit geometry-aware designs remain underexplored: while protein PLMs enable similarity learning at the residue level, few models have incorporated metric-based objectives to enforce clustering of interacting pairs. 3 Methods Our framework consists of three stages: featurization of molecules and proteins, conditioning via a FiLM layer, and distance - based affinity regression. Figure 1 summarizes the architecture. Figure 1 : FIRM-DTI architecture. Drug embeddings (from MolE) and protein embeddings (from ESM2) are projected into a shared latent space via a FiLM conditioning layer. The model is trained with a triplet loss to enforce geometric alignment between interacting pairs, and an RBF-based prediction head is used to regress binding affinity values. 3.1 Feature extraction We obtain latent representations for ligands and proteins from pretrained experts. The MolE model treats a molecule as a graph where nodes represent atoms and edges represent bonds. Atom features include Daylight atomic invariants and the Morgan fingerprint, and positional information is encoded through relative bond distances. A disentangled attention transformer then produces an embedding z_{d}\in\mathbb{R}^{d} for each molecule Méndez-Lucio et al. 2024 . For the target protein, we use the ESM2 language model which processes amino acid sequences and outputs a per - sequence embedding z_{t}\in\mathbb{R}^{d} by averaging residue representations Lin et al. 2023 . 3.2 FiLM conditioning To incorporate target context, we apply a FiLM layer Perez et al. 2018 . Given drug embedding z_{d} and protein embedding z_{t} , the conditioned embedding is \mathrm{FiLM}(z_{d}\mid z_{t})=\gamma(z_{t})\odot z_{d}+\beta(z_{t}), where \gamma and \beta are learned linear functions of z_{t} and \odot denotes element - wise multiplication. This transformation allows the model to scale and shift molecular features based on the target, capturing conditional interactions more flexibly than concatenation. 3.3 Distance - based prediction head After conditioning, we normalize the drug and protein embeddings and compute their cosine distance: \mathrm{dist}(\tilde{z}_{d},\tilde{z}_{t})=1-\frac{\tilde{z}_{d}\cdot\tilde{z}_{t}}{\|\tilde{z}_{d}\|\,\|\tilde{z}_{t}\|}. This distance is passed through a set of radial basis functions with k centers \mu_{j} evenly spaced in [0,2] : \phi_{j}=\exp\bigl(-((\mathrm{dist}(\tilde{z}_{d},\tilde{z}_{t})-\mu_{j})^{2})/(2\sigma^{2})\bigr),\quad j=1,\dots,k. The final affinity prediction is computed via a linear layer y_{\mathrm{pred}}=W\phi+b . This head enforces that similar embeddings yield similar predictions and provides a smooth mapping from distances to continuous affinities. 3.4 Training objective Training requires both positive and negative drug–protein pairs. Positive examples are experimentally validated interactions with known binding affinities, while negative examples are randomly paired molecules and targets with no reported interaction. During training, we minimize a combination of a triplet loss and a Huber regression loss: \mathcal{L}_{\text{total}}=\mathcal{L}_{\text{triplet}}+\mathcal{L}_{\text{Huber}}^{\text{affinity}}, where \mathcal{L}_{\text{triplet}}=\max\bigl(0,d(f(x_{a}),f(x_{p}))-d(f(x_{a}),f(x_{n}))+\alpha\bigr) encourages the distance between an anchor x_{a} and a positive x_{p} to be smaller than the distance to a negative x_{n} by margin \alpha , and the Huber loss with threshold \delta stabilizes regression: \mathcal{L}_{\text{Huber}}^{\text{affinity}}=\begin{cases}\tfrac{1}{2}(y-\hat{y})^{2},&\text{if }|y-\hat{y}|\leq\delta,\\ \delta\,|y-\hat{y}|-\tfrac{1}{2}\delta^{2},&\text{otherwise}.\end{cases} 3.5 Dataset and evaluation protocol We evaluate on the Drug–Target Interaction Domain Generalization (DTI - DG) benchmark introduced by the Therapeutics Data Commons Huang et al. 2021a . The benchmark partitions binding affinity data derived from BindingDB by patent year, training models on interactions from 2013–2018 and testing on interactions from 2019–2021. This temporal split mimics the challenge of predicting affinities for newly patented drugs and targets. All models are trained for 25 epochs with identical hyperparameters, and performance is measured by Pearson correlation coefficient (PCC) between predicted and true affinities.

Read the complete text