SciCore-Mol: Augmenting Large Language Models with Pluggable Molecular Cognition Modules

Yuxuan Chen 1, Changwei Lv 2, Yunduo Xiao 2, Zhongjing Du 1, Daquan Zhou 1, Yukun Yan 2, Zheni Zeng 3,* and Zhiyuan Liu 2,* · 2026

Read SciCore-Mol: Augmenting Large Language Models with Pluggable Molecular Cognition Modules by Yuxuan Chen 1, Changwei Lv 2, Yunduo Xiao 2, Zhongjing Du 1, Daquan Zhou 1, Yukun Yan 2, Zheni Zeng 3,* and Zhiyuan Liu 2,* (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22287.txt.

Introduction

Chen and colleagues present SciCore-Mol, a framework that plugs molecular cognition modules into a large language model. Text-only reasoning loses information when it meets molecular topology and reaction data. Three modules bridge the gap. One reads molecular topology, one generates molecules by latent diffusion, and one reasons about reactions. Each links to the language model backbone through learned interfaces. An 8B-parameter open system built this way rivals proprietary large models on chemical tasks and points toward drug design and synthesis uses.

Catalog record

CREATORYuxuan Chen 1, Changwei Lv 2, Yunduo Xiao 2, Zhongjing Du 1, Daquan Zhou 1, Yukun Yan 2, Zheni Zeng 3,* and Zhiyuan Liu 2,*
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60292
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.22287

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SciCore-Mol: Augmenting Large Language Models with Pluggable Molecular Cognition Modules Yuxuan Chen 1, Changwei Lv 2, Yunduo Xiao 2, Zhongjing Du 1, Daquan Zhou 1, Yukun Yan 2, Zheni Zeng 3,* and Zhiyuan Liu 2,* Abstract Large Language Models (LLMs) are central to the one-for-all intelligent paradigm, but they face a fundamental challenge when dealing with heterogeneous scientific data such as molecules: the inherent gap between discrete linguistic symbols and topological molecular or continuous reaction data leads to significant information loss and semantic noise in text-based reasoning. We propose SciCore-Mol , a modular framework that bridges this gap through three deeply integrated pluggable cognitive modules: a topology-aware perception module, a latent diffusion-based molecular generation module, and a reaction-aware reasoning module. Each module is coupled to the LLM backbone through learned representation interfaces, enabling richer information exchange than is possible with text-only tool feedback. Our experiments on diverse chemical tasks demonstrate that SciCore-Mol achieves strong comprehensive performance across molecular understanding, generation, reaction prediction, and general chemistry knowledge, with an 8B-parameter open-source system that is competitive with and in several dimensions surpasses proprietary large models. This work provides a systematic blueprint for equipping LLMs with scientific expertise through decoupled, pluggable, and flexibly orchestrated modules, with direct implications for drug design, chemical synthesis, and broader scientific discovery. † † affiliation: 1 School of Electronic and Computer Engineering, Peking University, Shenzhen, China 2 Tsinghua University, Beijing, China 3 School of Intelligence Science and Technology, Nanjing University, Suzhou, China † † corresponding: Zheni Zeng, Zhiyuan Liu 1 Introduction Large language models (LLMs) have demonstrated remarkable reasoning and knowledge storage capabilities, leading to their widespread application in fields such as biochemistry. However, applying LLMs to scientific data exposes a fundamental mismatch: models designed for discrete symbolic sequences must often process heterogeneous objects such as molecular structures, protein conformations, and continuous physical fields, which are inherently topological, geometric, or continuous. Several works have attempted to convert such data into text strings, such as using SMILES [ 44 , 1 , 15 ] or SELFIES [ 22 ] strings to represent molecular entities in molecular language models [ 8 , 52 ] . This approach strikes a balance between linguistic reasoning and scientific insight to some extent. Nevertheless, linearizing molecular graphs into one-dimensional token sequences cannot explicitly expose the topological and geometric invariances central to chemical reasoning [ 24 , 56 ] , resulting in insufficiently refined molecular cognition and semantic noise that interferes with normal LLM reasoning. Figure 1: Overview of SciCore-Mol. The GVP encoder, diffusion decoder, and reaction transformer correspond to the Topological Perception Module, Molecular Generation Module, and Reaction Sensing Module, respectively. SciCore-Mol integrates these modules with an LLM backbone to support molecular property prediction, molecule generation, synthesis prediction, retrosynthesis, yield prediction, and captioning. Despite their strong general reasoning ability, LLMs remain unreliable as universal scientific solvers in structure-sensitive domains such as chemistry. Molecular properties depend on atomic connectivity, stereochemistry, conformational geometry, and inter-molecular interactions. A text-only LLM must infer these structural features indirectly from token co-occurrence, making its predictions vulnerable to spurious correlations. Recent chemistry benchmarks show that even strong frontier LLMs can fail on basic chemical reasoning tasks and produce overconfident predictions [ 30 ] . These limitations motivate augmenting scientific LLMs with modules that explicitly encode molecular topology, geometry, and reaction-level numerical structure, rather than relying on text-based molecular representations alone. A parallel line of work augments LLMs with specialized scientific tools including molecular graph encoders, diffusion generators, reaction predictors, and laboratory automation platforms [ 5 , 4 , 27 , 6 ] . These systems have substantially improved LLM usability in chemistry. However, in most existing systems the LLM functions primarily as a language interface while core scientific computation is carried out by external task-specific modules. Intermediate molecular, geometric, or numerical information must be compressed back into textual descriptions before being used by the LLM. This text-level interface introduces information loss and reasoning bottlenecks, especially for tasks that require structure-grounded perception, continuous molecular generation, or numerically sensitive reaction reasoning. This motivates a tighter integration paradigm for scientific LLMs. Instead of treating scientific models as external black-box tools, we argue that heterogeneous scientific modules should become pluggable cognitive components of the LLM itself. In such a framework, the LLM remains responsible for natural-language interaction, task understanding, reasoning, and module coordination, while topology-aware, generation-aware, and reaction-aware modules provide specialized capabilities through learned hidden-state interfaces. This design preserves the flexibility and generality of LLM-centered reasoning while eliminating the information bottleneck of text-only tool feedback, and allows different scientific capabilities to be selectively activated and jointly optimized within a unified system. We propose SciCore-Mol, which consists of a LLM backbone and three pluggable external modules: a Topological Perception Module built on a GVP (Geometric Vector Perceptron) network [ 18 ] for spatial structure encoding, a Molecular Generation Module based on Diffusion Transformers (DiT) [ 33 ] , and a Reaction Sensing Module built on a numerical-sensitive Transformer for inter-molecular reasoning. The LLM is responsible for language interaction, reasoning, and task coordination, determining when to invoke which module to enhance itself. The pluggable modules are integrated with the LLM backbone at the hidden embedding level, jointly performing information perception and decision-making, thereby alleviating the fundamental contradiction between linguistic reasoning and continuous scientific manifolds. To achieve effective module integration, we introduce a progressive training strategy: we first pre-train each module independently, then jointly align and optimize all modules together with the LLM on a high-quality domain corpus, and optionally fine-tune the integrated system for specific downstream tasks. We evaluate SciCore-Mol on molecular property prediction, conformation generation, chemical reaction product and yield prediction, and general chemistry knowledge benchmarks. Results show that SciCore-Mol achieves superior performance on most tasks compared to baselines of similar scale, with an 8B-parameter system competitive with and in several dimensions surpassing much larger closed-source models. A recently released drug optimization dataset—collected after our pre-training cutoff—further confirms strong out-of-distribution generalization. We believe this framework can be extended to other scientific fields requiring heterogeneous data integration, advancing the development of scientific foundation models. 2 Results Figure 2: (a) Inference pipeline of SciCore-Mol. The GVP encoder, Reaction Transformer, and DiT decoder implement the Topological Perception Module, Reaction Sensing Module, and Molecular Generation Module, respectively. These pluggable modules exchange information with the LLM backbone through hidden-state interfaces. (b) Progressive training pipeline, including independent component pre-training, cross-modal alignment, and task-specific fine-tuning. 2.1 Overview of SciCore-Mol We propose SciCore-Mol, a molecular language model enhanced by three pluggable modules (Fig. 2 ): 1. Topological Perception Module which uses a rotation-aware GVP network to encode 3D molecular geometry and injects the resulting structural embedding into the LLM hidden-state sequence as a Virtual Structural Token. 2. Molecular Generation Module that generates molecules via latent diffusion conditioned on LLM hidden states, where the iterative denoising process (implemented by a DiT) is better suited than autoregressive token decoding for modeling globally coherent molecular structures. 3. Reaction Sensing Module , a Transformer-based module that processes molecular reaction data hierarchically using GVP-derived molecular embeddings for reaction prediction and yield estimation. During inference, the LLM backbone processes all inputs as natural language and selectively activates external modules based on task context: when a molecular entity is detected in

Read the complete text