Large Language Models for Controllable Multi-property Multi-objective Molecule Optimization

Vishal Dey, Xiao Hu, Xia Ning · 2025

Read Large Language Models for Controllable Multi-property Multi-objective Molecule Optimization by Vishal Dey, Xiao Hu, Xia Ning (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-23987.txt.

Introduction

Vishal Dey, Xiao Hu, and Xia Ning teach language models to improve drug molecules one property at a time. Real drug design rarely wants everything changed at once. Some traits must rise to a useful level while others, already fine, must stay put. Older tools and chat-tuned models miss that nuance.

The team built the first instruction data set built around property-specific goals. Each task states which traits to lift and which to leave alone. Tuned on it, their model family follows such orders far better than strong baselines. Success rates rose by over double on the hardest comparisons. The models even handled new tasks and new wordings with no extra training. The authors offer the data and code openly as a step toward practical design assistants.

Catalog record

CREATORVishal Dey, Xiao Hu, Xia Ning
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE114 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-23987

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Large Language Models for Controllable Multi-property Multi-objective Molecule Optimization Vishal Dey, Xiao Hu, Xia Ning Abstract In real-world drug design, molecule optimization requires selectively improving multiple molecular properties up to pharmaceutically relevant levels, while maintaining others that already meet such criteria. However, existing computational approaches and instruction-tuned LLMs fail to capture such nuanced property-specific objectives, limiting their practical applicability. To address this, we introduce 𝙲 ​ - ​ 𝙼𝚞𝙼𝙾𝙸𝚗𝚜𝚝𝚛𝚞𝚌𝚝 \mathop{\mathtt{C\text{-}MuMOInstruct}}\limits , the first instruction-tuning dataset focused on multi-property optimization with explicit, property-specific objectives. Leveraging 𝙲 ​ - ​ 𝙼𝚞𝙼𝙾𝙸𝚗𝚜𝚝𝚛𝚞𝚌𝚝 \mathop{\mathtt{C\text{-}MuMOInstruct}}\limits , we develop 𝙶𝚎𝙻𝙻𝙼 𝟺 ​ 𝙾 ​ - ​ 𝙲 \mathop{\mathtt{GeLLM^{4}O\text{-}C}}\limits s, a series of instruction-tuned LLMs that can perform targeted property-specific optimization. Our experiments across 5 in-distribution and 5 out-of-distribution tasks show that 𝙶𝚎𝙻𝙻𝙼 𝟺 ​ 𝙾 ​ - ​ 𝙲 \mathop{\mathtt{GeLLM^{4}O\text{-}C}}\limits s consistently outperform strong baselines, achieving up to 126% higher success rate. Notably, 𝙶𝚎𝙻𝙻𝙼 𝟺 ​ 𝙾 ​ - ​ 𝙲 \mathop{\mathtt{GeLLM^{4}O\text{-}C}}\limits s exhibit impressive 0-shot generalization to novel optimization tasks and unseen instructions. This offers a step toward a foundational LLM to support realistic, diverse optimizations with property-specific objectives. 𝙲 ​ - ​ 𝙼𝚞𝙼𝙾𝙸𝚗𝚜𝚝𝚛𝚞𝚌𝚝 \mathop{\mathtt{C\text{-}MuMOInstruct}}\limits and code are accessible through https://github.com/ninglab/GeLLMO-C . 1 Introduction Developing a new drug is a time-consuming and expensive process, requiring over a decade and $2 billions Sertkaya et al. (2024) . A key stage in this process is lead optimization Nicolaou and Brown (2013) , where “hit" molecules – exhibiting promising early-stage bioactivity against drug targets – are optimized for multiple molecular properties Nicolotti et al. (2011) critical for pharmaceutical success. In practice, this stage often requires improving specific properties up to a pharmaceutically significant level, while maintaining already desirable ones within acceptable bounds. We refer to this setting as controllable multi-property, multi-objective optimization (C-MuMO), allowing for property-specific objectives, and thus greater control over the optimization. Such controllable optimization requires navigating complex trade-offs among multiple properties that are often competing or even conflicting Niu et al. (2024) . For instance, optimizing an oral antipsychotic drug requires sufficiently high blood-brain barrier permeability (BBBP) Pollak et al. (2018) and dopamine receptor D2 (DRD2) inhibition Seeman (2001) to access the central nervous system (CNS) and block dopamine receptors in the CNS Seeman et al. (1976) . Meanwhile, properties related to toxicity, such as Potassium (K + ) channel inhibition must be lowered, since excessive inhibition of K + channels in the brain Shepard et al. (2007) can cause fatal cardiac arrythmias Sanguinetti and Tristani-Firouzi (2006) . Additionally, properties supporting oral bioavailability, such as intestinal absorption, must be maintained if they already meet desirable levels. These trade-offs highlight the need for property-specific objectives to mimic realistic optimization tasks. Most existing computational approaches Gao et al. (2022) ; Jensen (2019) ; You et al. (2018) ; Blaschke et al. (2020) cannot handle tasks with multiple objectives. Furthermore, existing approaches for multi-objective optimization Sun et al. (2022) ; Kim et al. (2024) ; Wu et al. (2024) rely on manually curated reward functions and careful task-specific tuning – limiting their scalability and applicability to diverse tasks in practice. We refer readers to Appendix A for a detailed review of existing approaches. Recently, instruction-tuned LLMs Dey et al. (2025) , demonstrated strong performance on diverse multi-property optimization tasks. However, they only tackle tasks where all properties should be improved simultaneously. This setting fails to capture the nuanced property-specific objectives prevalent in realistic lead optimization. Figure 1: Overview of \mathop{\mathtt{C\text{-}MuMOInstruct}}\limits and \mathop{\mathtt{GeLLM^{4}O\text{-}C}}\limits To address these critical limitations, we introduce \mathop{\mathtt{C\text{-}MuMOInstruct}}\limits , the first high-quality instruction-tuning dataset designed for C-MuMO tasks involving up to 10 molecular properties. Unlike prior datasets that require all properties to improve, \mathop{\mathtt{C\text{-}MuMOInstruct}}\limits explicitly incorporates controllable property-specific objectives – specifying which properties must be improved up to a user-defined property-specific threshold, and which must be maintained within acceptable bounds. This design better reflects real-world lead optimization, where some properties reach pharmaceutically significant levels in early stages, while others require multiple iterations for further improvement. Built on \mathop{\mathtt{C\text{-}MuMOInstruct}}\limits , we introduce a family of Ge neralizable L arge L anguage M odels for M ulti-property, M ulti- O bjective C ontrollable optimization, \mathop{\mathtt{GeLLM^{4}O\text{-}C}}\limits , by instruction-tuning general-purpose LLMs. \mathop{\mathtt{GeLLM^{4}O\text{-}C}}\limits is trained to handle tasks requiring selective improvement of specific properties while maintaining already desirable ones. We develop both specialist and generalist variants. Each specialist \mathop{\mathtt{GeLLM^{4}O\text{-}C}}\limits is trained on a single property combination with multiple controllable multi-objective tasks. Generalist \mathop{\mathtt{GeLLM^{4}O\text{-}C}}\limits is trained across diverse multi-property combinations and multiple controllable objectives within each combination, enabling cross-task knowledge transfer. This enables a single foundational model to handle novel and diverse C-MuMO tasks without task-specific fine-tuning. We evaluate our \mathop{\mathtt{GeLLM^{4}O\text{-}C}}\limits models with strong general-purpose LLMs and foundational LLMs for chemistry across 5 in-distribution (IND) and 5 out-of-distribution (OOD) tasks. Our results reveal several key findings: (1) All \mathop{\mathtt{GeLLM^{4}O\text{-}C}}\limits s substantially outperform state-of-the-art baselines on all IND and OOD tasks, with gains of up to 126% over the best baselines. (2) Generalist \mathop{\mathtt{GeLLM^{4}O\text{-}C}}\limits s outperform specialist ones on 4 out of 5 IND tasks, with impressive gains of up to 26% on challenging tasks. (3) Generalist \mathop{\mathtt{GeLLM^{4}O\text{-}C}}\limits s demonstrate remarkable 0-shot generalization to OOD tasks, outperforming strong baselines by 27% on average. To the best of our knowledge, \mathop{\mathtt{C\text{-}MuMOInstruct}}\limits is the first large scale, high-quality instruction-tuning dataset specifically focused on controllable, multi-objective optimization with up to 10 properties. Generalist \mathop{\mathtt{GeLLM^{4}O\text{-}C}}\limits s tuned on \mathop{\mathtt{C\text{-}MuMOInstruct}}\limits demonstrate strong generalization abilities, which highlights their strong potential to tackle unseen, diverse C-MuMO tasks prevalent in realistic drug design scenarios. Figure 1 presents the overall framework of \mathop{\mathtt{GeLLM^{4}O\text{-}C}}\limits . Dataset, models, and code are accessible through https://github.com/ninglab/GeLLMO-C . Table 1: Comparison among instruction-tuning datasets Comparison \mathop{\mathtt{MolOpt\text{-}Instructions}}\limits \mathop{\mathtt{MuMOInstruct}}\limits \mathop{\mathtt{C\text{-}MuMOInstruct}}\limits Ye et al. (2025) Dey et al. (2025) (ours) Multi-objective ✗ ✗ ✓ Threshold-based ✓ ✗ ✓ Realistic ✗ ✓ ✓ #properties 5 6 10 #molecules 1,595,839 331,586 433,166 #pairs 1,029,949 255,174 256,185 #Total tasks 8 63 28,266 #Tasks \geq 3 prop 0 42 27,401 #Eval \geq 3 prop 0 10 119 #IND 8 5 51 #OOD 0 5 68 2 \mathop{\mathtt{C\text{-}MuMOInstruct}}\limits In this paper, we introduce \mathop{\mathtt{C\text{-}MuMOInstruct}}\limits , which provides control over each property objective in multi-property optimization tasks, unlike existing datasets such as \mathop{\mathtt{MuMOInstruct}}\limits . This enables models tuned on \mathop{\mathtt{C\text{-}MuMOInstruct}}\limits to improve specific properties up to a user-defined level, while maintaining others at already desirable levels – a crucial capability that distinguishes \mathop{\mathtt{C\text{-}MuMOInstruct}}\limits from existing datasets. These key differences are highlighted in Table 1 . Problem Definition: A C-MuMO task is to modify a hit molecule M_{x} into an improved lead molecule M_{y} , via structural modifications on M_{x} , guided by property-specific objectives – controlling which properties to be improved and the extent of such improvement. Given \mathcal{P} molecular properties, we define a pharmaceutically relevant level, \Theta_{p} , for each property p\in\mathcal{P} , Accordingly, p is considered near-optimal if its score in M_{x} – denoted as p(M_{x}) – is more desirable than \Theta_{p} (represented as p(M_{x})\prec\Theta_{p} ), and sub-optimal, otherwise (represented as p(M_{x})\succeq\Theta_{p} ). The desirability of each property is determined by the intended pharmaceutical goal, where either higher or lower property scores increase the molecule’s likelihood to be a successful drug candidate. For example, a higher BBBP is desired for drugs targeting the

Read the complete text