ModuLM: Enabling Modular and Multimodal Molecular Relational Learning with Large Language Models

Zhuo Chen, Yizhen Zheng, Huan Yee Koh, Hongxin Xiang, Linjiang Chen, Wenjie Du, Yang Wang · 2025

Read ModuLM: Enabling Modular and Multimodal Molecular Relational Learning with Large Language Models by Zhuo Chen, Yizhen Zheng, Huan Yee Koh, Hongxin Xiang, Linjiang Chen, Wenjie Du, Yang Wang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00880.txt.

Introduction

Zhuo Chen and co-authors build a shared frame for studying how pairs of molecules interact, with help from large language models, in a paper from 2025. Such pair studies matter for drug work and basic chemistry. Many model types and input forms now exist, which makes fair tests hard to set up.

Their frame, called ModuLM, lets users swap parts in and out with ease. It offers many encoders for flat and three-dimensional molecule shapes, several layers for pair interaction, and a range of language model cores. Those parts can form tens of thousands of distinct models. The team gives broad test results to show the frame works for its target tasks. It should cut repeat coding across labs.

Catalog record

CREATORZhuo Chen, Yizhen Zheng, Huan Yee Koh, Hongxin Xiang, Linjiang Chen, Wenjie Du, Yang Wang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE58 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-00880

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ModuLM: Enabling Modular and Multimodal Molecular Relational Learning with Large Language Models Zhuo Chen, Yizhen Zheng, Huan Yee Koh, Hongxin Xiang, Linjiang Chen, Wenjie Du, Yang Wang Abstract Molecular Relational Learning (MRL) aims to understand interactions between molecular pairs, playing a critical role in advancing biochemical research. With the recent development of large language models (LLMs), a growing number of studies have explored the integration of MRL with LLMs and achieved promising results. However, the increasing availability of diverse LLMs and molecular structure encoders has significantly expanded the model space, presenting major challenges for benchmarking. Currently, there is no LLM framework that supports both flexible molecular input formats and dynamic architectural switching. To address these challenges, reduce redundant coding, and ensure fair model comparison, we propose ModuLM, a framework designed to support flexible LLM-based model construction and diverse molecular representations. ModuLM provides a rich suite of modular components, including 8 types of 2D molecular graph encoders, 11 types of 3D molecular conformation encoders, 7 types of interaction layers, and 7 mainstream LLM backbones. Owing to its highly flexible model assembly mechanism, ModuLM enables the dynamic construction of over 50,000 distinct model configurations. In addition, we provide comprehensive results to demonstrate the effectiveness of ModuLM in supporting LLM-based MRL tasks. ModuLM is available at https://anonymous.4open.science/r/ModuLM . 1 Introduction Molecular Relational Learning (MRL) ( CGIB ) , which aims to understand the interactions between molecular pairs, has garnered growing attention due to its wide-ranging applications across various scientific domains drug_drug_3 . For example, drug-drug interactions (DDIs) are vital for understanding the effects of concurrent drug use, which can inform strategies to prevent adverse drug reactions and ensure patient safety drug_drug_1 , while solute-solvent interactions (SSIs) are fundamental to solution chemistry and are pivotal in the design and optimization of chemical processes SSI_1 ; SSI_2 . However, the exhaustive experimental validation of these interactions is notoriously time-consuming and costly. In recent years, large language models (LLMs) have emerged as a promising new paradigm in MRL research due to their powerful capabilities in knowledge integration and reasoning. Compared with traditional methods, LLMs can more efficiently process and understand complex interactions between molecules, significantly improving modeling performance and generalizability. A growing body of research has focused on LLM-based MRL frameworks LLM4MI1 ; LLM4MI2 ; fang2024moltc , leveraging the strengths of LLMs to achieve strong results on MRL tasks. For instance, ReactionT5 LLM4MI4 proposed a text-based pretrained LLM tailored for MRL tasks, while MolTC fang2024moltc further advanced this line of research by integrating multimodal data and incorporating 2D molecular graphs for improved performance. These developments highlight the research value and application potential of LLMs in MRL. However, with the emergence of an increasing number of encoding methods and backbone models Nguyen_Le_Quinn_Nguyen_Le_Venkatesh_2020 ; Huang_Xiao_Glass_Sun_2020 ; Voitsitskyi__2023 ; Zhu_Zhao_Wen_Wang_Wang_2023 ; Yazdani-Jahromi_2022b ; taylor2022galactica ; touvron2023llama ; guo2025deepseek , it is now possible to adopt more flexible strategies to recombine components and build more novel model architectures. However, this flexibility introduces new challenges for the benchmarking and evaluation of LLM-based MRL models. Lack of diverse input support: Molecular structures can typically be represented in various forms, such as 1D SMILES strings, 2D molecular graphs, and 3D molecular conformations; however, most existing models support only a single representation modality, commonly 1D SMILES kipf2016semi ; gilmer2017neural ; xu2018representation or 2D graphs gasteiger2021gemnet ; schutt2021equivariant ; du2022se ; du2023new , which limits their ability to fully capture the complexity of molecular interactions and may result in the loss of critical structural information. In the field of LLMs, MRL models that accept 3D molecular structure inputs remain extremely rare, despite the fact that specific 3D conformations are often essential for accurately modeling chemical phenomena, for instance, in small-molecule binding to target proteins wu2022pre . These issues highlight the importance of a unified framework that can accommodate 1D, 2D, and 3D molecular inputs to enable more comprehensive, flexible, and accurate molecular relational learning across a wide range of task scenarios. Lack of Flexible Architectures: Current LLM-based MRL models often adopt relatively rigid architectures. For example, ReactionT5 LLM4MI4 uses a unified model to encode both SMILES sequences and molecular property descriptions, while MolTC fang2024moltc employs graph neural networks (GNNs) to encode molecular graphs. Although these methods achieve performance improvements, they are still somewhat limited by their encoding strategies. In the non-LLM MRL domain, many more effective encoding strategies have been developed, such as MMGNN du2024mmgnn , which employs interpretable GNNs to extract key subgraphs for solvation free energy prediction, and Uni-Mol Uni-mol , which introduces pre-trained SE(3) Transformer models specifically designed for molecular data. However, integrating these encoding methods into existing LLM frameworks remains a challenge. Furthermore, most current LLM-based models overlook the modeling of molecular interaction features. These challenges highlight the importance of developing a model framework that can seamlessly combine diverse encoding modules while effectively incorporating molecular interaction information. To this end, we propose ModuLM , a unified and extensible framework designed to overcome the limitations of existing LLM-based MRL approaches. ModuLM provides a highly flexible model construction mechanism that supports a wide range of molecular input formats, multimodal integration strategies, and diverse prompt designs. The framework accepts molecular representations in the form of 1D SMILES, 2D molecular graphs and 3D conformations. It includes 8 types of 2D molecular graph encoders, 11 types of molecular conformation encoders, 7 types of interaction feature encoders, and 7 mainstream LLM backbones, along with specially designed prompt templates for integrating different types of molecular features. To enhance usability and extensibility, ModuLM adopts a modular interface design that allows users to flexibly assemble and extend models, supports incremental pretraining, and is capable of handling complex molecular interaction modeling tasks. ModuLM can generate over 50,000 distinct model configurations. We conduct comprehensive benchmark experiments on tasks such as DDI, SSI and CSI. The results demonstrate that ModuLM performs remarkably well in constructing, evaluating, and comparing LLM-based MRL models. These findings highlight ModuLM’s strong potential to advance the development of MRL models and provide valuable insights into molecular interaction mechanisms. 2 Related Work Molecular Relational Learning: MRL is critical for drug research, with machine learning offering a scalable alternative to costly experimental validation lee2023conditional . Early methods focused on GNNs kipf2016semi ; zhong2019graph ; RN460 ; fu2020core , such as Nyamabo et al.’s substructure-level interaction model using GAT and co-attention Co-attention , and Lee et al.’s CGIB CGIB , which applies the information bottleneck to extract key substructures. LLM-based methods have gained momentum. For instance, ReactionT5 LLM4MI7 enhances molecular understanding by integrating chemical structures with natural language. MolTC fang2024moltc further advances this direction by combining 2D molecular graph features with chain-of-thought reasoning to support complex molecular inference. LLMs in the Molecular Domain: LLMs have been widely applied in 1D, 2D, and 3D molecular pattern learning. For 1D, methods like MolT5 MolT5 and KV-PLM KV-PLM tokenize SMILES strings for representation learning. In 2D, approaches such as Text2Mol Text2Mol , MolCA MolCA , and DrugChat DrguChat integrate molecular graphs with text encoders or LLMs. For 3D, MolLM MolLM and 3D-MoLM 3D-MoLM incorporate spatial relationships via attention mechanisms and 3D encoders. In addition, LLMs have also found applications in MRL, such as ReactionT5 LLM4MI4 and MolTC fang2024moltc , which utilize multimodal data, including molecular

Read the complete text