A Multi-task Large Reasoning Model for Molecular Science

Pengfei Liu, Shuang Ge, Jun Tao, Zhixiang Ren · 2026

Read A Multi-task Large Reasoning Model for Molecular Science by Pengfei Liu, Shuang Ge, Jun Tao, Zhixiang Ren (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-12808.txt.

Introduction

Pengfei Liu and co-authors build a large reasoning model that handles many molecular tasks at once. The model routes each task to a fitting specialist for prediction or inference. It learns from chain-of-thought traces and from rewards tied to molecule facts. Tasks span description, generation, naming, property checks, and reaction calls, 10 in all. It beat more than 20 rival models, both general and task-specific. One case study drafts and screens a brain drug lead end to end.

Catalog record

CREATORPengfei Liu, Shuang Ge, Jun Tao, Zhixiang Ren
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42940
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.12808

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Multi-task Large Reasoning Model for Molecular Science Pengfei Liu, Shuang Ge, Jun Tao, Zhixiang Ren Abstract Advancements in artificial intelligence for molecular science are necessitating a paradigm shift from purely data-driven predictions to knowledge-guided computational reasoning. Existing molecular models are predominantly proprietary, lacking general molecular intelligence and generalizability. This underscores the necessity for computational methods that can effectively integrate scientific logic with deep learning architectures. Here we introduce a multi-task large reasoning model designed to emulate the cognitive processes of molecular scientists through structured reasoning and reflection. Our approach incorporates multi-specialist modules to provide versatile molecular expertise and a chain-of-thought (CoT) framework enhanced by reinforcement learning infused with molecular knowledge, enabling structured and reflective reasoning. Systematic evaluations across 10 molecular tasks and 47 metrics demonstrate that our model achieves an average 50.3% improvement over the base architecture, outperforming over 20 state-of-the-art baselines—including ultra-large-parameter foundation models—despite using significantly fewer training data and computational resources. This validates that embedding explicit reasoning mechanisms enables high-efficiency learning, allowing smaller-scale models to surpass massive counterparts in both efficacy and interpretability. The practical utility of this computational framework was validated through a case study on the design of central nervous system (CNS) drug candidates, illustrating its capacity to bridge data-driven and knowledge-integrated approaches for intelligent molecular design. K eywords Reasoning Model \cdot Molecular Science \cdot Multi-task Learning Figure 1: Overview of the reasoning framework. (a) Current LLMs in multi-task molecular science tasks, showcasing their core capabilities and inherent challenges. (b) Molecular multi-task reasoning framework, detailing the process from user query to inference, featuring tokenization and embedding, specialist selection via a router, and a multi-specialist layer within a pre-trained LLM. This framework unifies diverse molecular tasks through data synergy and embeds chemical logic into CoT reasoning for science-grounded outputs, with an example showcasing a text-based molecular generation task. Artificial intelligence (AI) has rapidly become a driving force in molecular science, with significant applications in drug discovery [ 12 ] , materials design [ 10 ] , and chemical synthesis planning [ 40 ] . Traditional experimental methods and quantum chemical calculations, while foundational, are often time-consuming, expensive, and limited by their inability to handle large-scale molecular datasets efficiently. Conventional machine learning approaches have improved prediction accuracy for small datasets but struggle with scalability, feature engineering complexity, and capturing intricate molecular interactions [ 35 ] . In particular, deep learning techniques, such as graph neural networks (GNNs), have been widely applied to model molecular structures as graphs, enabling tasks like property prediction and reaction forecasting [ 14 ] . These methods excel in capturing local structural features but often suffer from high computational costs, limited scalability to large datasets, and challenges in modeling long-range dependencies within complex molecular sequences. In contrast, the Transformer architecture [ 31 ] addresses these limitations through its self-attention mechanism, which efficiently processes sequential data like SMILES [ 34 ] strings, facilitating better generalization and interpretability in molecular representations. The advent of Transformer-based models [ 4 ] [ 25 ] [ 26 ] has strengthened the understanding and generation capabilities of sequential data. The emergence of ChatGPT [ 27 ] has sparked a surge in LLMs, inspiring their adaptation in molecular science. For instance, MolT5 [ 6 ] enables translation between molecules and natural language, which supports tasks such as molecule captioning and property description. BioT5+ [ 24 ] extends this paradigm to biological contexts by integrating IUPAC [ 20 ] names for enhanced understanding in drug discovery. GIT-Mol [ 16 ] and MoleculeSTM [ 19 ] further incorporate multi-modal inputs for comprehensive molecular analysis. Those methods have demonstrated strong predictive power across diverse molecular tasks, enabling advances in property prediction [ 41 ] , de novo molecular design, reaction prediction [ 18 ] , and molecule captioning. Nevertheless, the majority of existing approaches are still primarily data-driven, focusing on statistical correlations [ 13 ] rather than capturing the underlying scientific principles [ 17 ] . They are typically designed for single tasks , limiting their generalizability to diverse multi-task scenarios. Moreover, they often lack explicit reasoning mechanisms , which necessitate logical inference and seamless integration of domain-specific knowledge. Recent advances in multi-task molecular LLMs have begun to address these gaps by scaling foundation models for broader applicability. For example, LLaSMol [ 38 ] , ChemLLM [ 39 ] , and InstructBioMol [ 42 ] have achieved excellent performance in multi-task and multi-modal molecular learning, highlighting the potential of scaling molecular foundation models. However, these models primarily serve as high-performing predictors, lacking robust interpretability and explicit reasoning capabilities, which limits their application in scientific discovery scenarios that require transparent decision-making. While models such as o1 [ 11 ] and DeepSeek-R1 [ 8 ] , among other advanced large-scale reasoning models, have introduced advanced reasoning frameworks, they also adapt to Mixture-of-Experts (MoE) [ 28 ] architectures, enabling flexibility across diverse tasks. However, these models encounter challenges with domain-specific accuracy and scalability when applied to molecular contexts. DeepMind’s TxGemma model [ 32 ] combines conversational capabilities with molecular multi-task learning, though this integration results in decreased task performance. These limitations highlight a critical need for a multi-task molecular reasoning model that achieves high predictive accuracy and possesses robust reasoning capabilities. Since molecular science relies on established chemical rules, structured knowledge, and logical reasoning, there is a growing need for models that integrate such knowledge to deliver accurate predictions and science-based reasoning. To tackle these challenges, we introduce a synergistic multi-specialist knowledge reasoning model that embeds molecular logic into a task-adaptive framework, as illustrated in Figure 1 . Unlike prediction-focused models, our approach incorporates chemical knowledge via CoT reasoning [ 33 ] . We construct an instruction dataset comprising 93K instances to train prediction specialists, focusing on molecular knowledge representation, and a dataset with chemical CoT reasoning, embedding molecular science constraints to align AI decisions with scientific principles, consisting of 3.5K high-quality instances for inference specialists. In contrast to MoE architectures, we leverage data synergy (joint training of data with similar knowledge while isolating disparate knowledge) and specialist synergy (collaboration between prediction specialists excelling in molecular representation and inference specialists proficient in structured reasoning) to enhance molecular knowledge representation and reasoning. Enhanced by molecule-informed reinforcement learning, this approach aligns reasoning and answers with chemical accuracy through sparse CoT data, boosting data efficiency and performance. Crucially, this logic-embedded framework facilitates high-efficiency learning , enabling our model to surpass ultra-large parameter baselines while incurring only a fraction of the training costs associated with massive foundation models. Our model outperforms over 20 multi-task LLMs across 10 molecular tasks, achieving improvements of up to 10% compared to the state-of-the-art baseline (LLaSMol). To illustrate its practical utility, we present a case study on CNS drug candidate design, where the model streamlines the workflow from text-based molecule generation to retrosynthetic planning, enabling rapid analysis of blood-brain barrier penetration and toxicity profiles. It can accelerate molecular design cycles, reducing the time from conceptual sketches to viable candidates from weeks to hours while embedding interpretable chemical reasoning throughout. This capability fosters reliable scientific exploration by bridging empirical data and science-driven insights, supporting innovations in drug discovery and materials design. Results This section presents the key outcomes of our model, which is designed to advance

Read the complete text