Large Language Models to Accelerate Organic Chemistry Synthesis

Yu Zhang, Yang Han, Shuai Chen, Ruijie Yu, Xin Zhao, Xianbin Liu, Kaipeng Zeng, Mengdi Yu, Jidong Tian, Feng Zhu, Xiaokang Yang, Yaohui Jin, Yanyan Xu · 2025

Read Large Language Models to Accelerate Organic Chemistry Synthesis by Yu Zhang, Yang Han, Shuai Chen, Ruijie Yu, Xin Zhao, Xianbin Liu, Kaipeng Zeng, Mengdi Yu, Jidong Tian, Feng Zhu, Xiaokang Yang, Yaohui Jin, Yanyan Xu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-18340.txt.

Introduction

Yu Zhang and co-authors fine-tune a chat model into a chem bench mate, in a study from 2025. Bench chem runs on trial and miss, slow and dear. A mate that knows a vast stock of past cooks could call the next step, the yield, and the best path in a blink.

Their mate, Chemma, learned from more than a million ask-answer pairs on cooks. It beat known bests at back-plan of a cook and at yield calls. Fed to a search tool, its yield calls widen the hunt in a big way. In a live learn loop it then steered fresh cooks in open space, and met a new bond case the head names. Bench craft, they pitch, can now be chat-led.

Catalog record

CREATORYu Zhang, Yang Han, Shuai Chen, Ruijie Yu, Xin Zhao, Xianbin Liu, Kaipeng Zeng, Mengdi Yu, Jidong Tian, Feng Zhu, Xiaokang Yang, Yaohui Jin, Yanyan Xu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-18340

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Large Language Models to Accelerate Organic Chemistry Synthesis Yu Zhang, Yang Han, Shuai Chen, Ruijie Yu, Xin Zhao, Xianbin Liu, Kaipeng Zeng, Mengdi Yu, Jidong Tian, Feng Zhu, Xiaokang Yang, Yaohui Jin, Yanyan Xu Abstract Chemical synthesis, as a foundational methodology in the creation of transformative molecules, exerts substantial influence across diverse sectors from life sciences to materials and energy. Current chemical synthesis practices emphasize laborious and costly trial-and-error workflows, underscoring the urgent needs for advanced AI assistants. Nowadays, large language models (LLMs), typified by GPT-4, have been introduced as an efficient tool to facilitate scientific research. Here, we present Chemma , a fully fine-tuned LLM with 1.28 million pairs of Q&A about reactions, as an assistant to accelerate organic chemistry synthesis. Chemma surpasses the best-known results in multiple chemical tasks, e.g., single-step retrosynthesis and yield prediction, which highlights the potential of general AI for organic chemistry. Via predicting yields across the experimental reaction space, Chemma significantly improves the reaction exploration capability of Bayesian optimization. More importantly, integrated in an active learning framework, Chemma exhibits advanced potentials of autonomously experimental exploration and optimization in open reaction spaces. For an unreported Suzuki-Miyaura cross-coupling reaction of cyclic aminoboronates and aryl halides for the synthesis of \alpha -Aryl N-heterocycles, the human-AI collaboration successfully explored suitable ligand (PAd 3 ) and solvent (1,4-dioxane) within only 15 runs, achieving an isolated yield of 67%. These results reveal that, without quantum-chemical calculations, Chemma can comprehend and extract chemical insights from reaction data, in a manner akin to human experts. This work opens avenues for accelerating organic chemistry synthesis with adapted large language models. Chemical synthesis stands as the cornerstone of the discipline of chemistry, enabling the creation, exploration, and understanding of new substances [ 1 , 2 , 3 , 4 , 5 , 6 ] . Chemical synthesis stands as the cornerstone of the discipline of chemistry, enabling the creation, exploration, and understanding of new substances [ 1 , 2 , 3 , 5 ] . In numerous cutting-edge scientific domains, chemical synthesis also plays a crucial role. For instance, in drug discovery, synthesis of complex molecules enables the creation of diverse candidates of small molecules with therapeutic potential [ 7 , 8 ] ; in the realm of renewable energy, the design and synthesis of catalysts are essential for enhancing the efficiency of processes like hydrogen production, fuel cells, and carbon capture [ 9 , 10 ] . Despite significant advancements in chemical instrumentation over the past few decades, the process of chemical synthesis continues to be laborious and time-consuming due to the vast reaction space and complexity of molecular structures [ 11 , 12 , 13 , 14 ] . This iterative process typically involves reviewing the literature, designing reaction steps, and conducting wet lab experiments, which necessitates repeated trial and error [ 15 , 11 ] . Even with the aid of literature retrieval tools, for novel molecules, none of them has presented a valuable synthetic path toward integration of computer-aided synthesis planning (CASP) and expert effort [ 16 , 17 ] . In summary, to realize efficient and highly selective chemical synthesis, there is an urgent need to reform the research paradigm of organic chemistry synthesis [ 18 , 19 ] . Nowadays, the emergency of generative pre-trained transformer-based large language models (LLMs), typified by GPT-4, has triggered keen interest in leveraging such techniques to tackle scientific challenges [ 20 , 21 , 22 , 23 ] . Those include—but are not limited to—literature mining [ 24 ] , data annotation [ 25 ] , experimental planning [ 26 , 27 , 28 , 29 ] , scientific tools scheduling [ 30 , 31 ] , etc. Particularly in chemistry, Zheng et al. leveraged prompt engineering to instruct ChatGPT in the automation of text mining [ 32 ] , experimental design [ 26 ] , and multi-agents collaboration [ 30 ] for the discovery of metal-organic frameworks. Antunes et al. proposed CrystaLLM based on GPT-2 architecture to focus on modeling crystal structures through their textual descriptions [ 33 ] . Jablonka et al. fine-tuned GPT-3 for inverse design and reaction classification tasks in organic chemistry [ 6 ] . Further, other approaches have focused on designing chemical agents driven by LLMs to plan and conduct experiments [ 27 , 31 , 34 , 35 ] . Nevertheless, the chemical capabilities of GPT-4 remain limited to tasks such as molecular captioning, and translation, making it challenging to autonomously explore and optimize unreported reactions within an open reaction space. In the field of organic synthesis, advanced AI techniques have made noteworthy progress. For seeking feasible routes, Coley et al. developed a preliminary platform that integrates retrosynthesis models and robotic apparatus [ 36 , 37 ] to seek feasible routes; Shield et al. reported a framework of Bayesian optimization to identify high-yield experimental conditions within largely distinct parameter spaces [ 38 ] for reaction condition exploration; Angello et al. reported a streamlined closed-loop workflow that leveraged machine learning algorithms to guide robotic experimentation for the discovery of general reaction conditions [ 12 ] ; Tang et al. leveraged statistical modeling techniques to model the mechanism of the oxidative addition process [ 39 ] . Wang et al. applied reinforcement learning bandit optimization to identify generally applicable conditions by examining experimental feedback [ 40 ] . Nevertheless, these methods rely heavily on density functional theory (DFT) calculations to parameterize molecules, and manually feature selection by experts’ knowledge, which leads to molecular screening and prediction continues to be a trial-and-error process. Besides, these methods need a HTE platform to collect experimental data, which shows less generalization capabilities new reactions [ 41 , 42 ] . More importantly, existing methods for reaction exploration aim at finding suitable conditions within experts’ predefined reaction condition pools, a.k.a. closed reaction space. However, potential conditions variables from open reaction space with higher performance might be ignored. Towards these points, in view that molecules can be expressed in sequence, and the reaction is described as a natural language in literature, LLMs can be a potential solution owing to the following advances: (i) by learning molecular representations from SMILES, LLMs can capture the atomic arrangement of molecules and understand their chemical structures; (ii) pre-trained with extensive reaction data, LLMs have the capability to learn relationships among reactants, products, and conditions in reactions, thereby acquiring chemical knowledge akin to the learning process of chemists; (iii) the generative capability of LLMs enables the design of novel molecules, for example, in the ligand recommendation task, thereby facilitating the discovery of new chemical reactions. To this end, we present Chemma, a fully fine-tuned LLM based on LLaMA-2-7b, as a generative assistant to accelerate organic synthesis chemistry. Chemma is trained to answer questions of chemists, functionalized as human-AI interactions and experiment assistant. Chemma tackles several primary tasks with simple chemistry prompts, including forward reaction prediction, retrosynthesis, reaction performance prediction, condition generation, and reaction exploration&optimization. These abilities have been assessed with open benchmark data and wet experiments. Particularly, for an unreported Suzuki-Miyaura cross-coupling reaction of cyclic aminoboronates and aryl halides for the synthesis of \alpha -Aryl N-heterocycles, with the assistance of Chemma, we explored suitable conditions only within 15

Read the complete text