ChemHTS: Hierarchical Tool Stacking for Enhancing Chemical Agents
Zhucong Li, Jin Xiao, Bowei Zhang, Zhijian Zhou, Qianyu He, Fenglei Cao, Jiaqing Liang, Yuan Qi · 2025
Read ChemHTS: Hierarchical Tool Stacking for Enhancing Chemical Agents by Zhucong Li, Jin Xiao, Bowei Zhang, Zhijian Zhou, Qianyu He, Fenglei Cao, Jiaqing Liang, Yuan Qi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-14327.txt.
Introduction
Zhucong Li and co-authors improve AI chemistry agents by teaching them to stack their tools in layers. Their 2025 paper starts from a known weakness: language models armed with chemistry tools often call the wrong tool or fail to combine several well. That limits their help with tasks like molecule design, reaction prediction, and property estimation.
Their method, ChemHTS, warms the agent up by letting it stack its own tool calls, then optimizes choices across layers so the model refines tool use as it learns. Tests span four classic chemistry tasks. The stacked agent beat strong general and chemistry-specific rivals, which the authors credit to cleaner tool pathways rather than a bigger model.
Catalog record
| CREATOR | Zhucong Li, Jin Xiao, Bowei Zhang, Zhijian Zhou, Qianyu He, Fenglei Cao, Jiaqing Liang, Yuan Qi |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 61 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-14327
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
ChemHTS: Hierarchical Tool Stacking for Enhancing Chemical Agents Zhucong Li, Jin Xiao, Bowei Zhang, Zhijian Zhou, Qianyu He, Fenglei Cao, Jiaqing Liang, Yuan Qi Abstract Large Language Models (LLMs) have demonstrated remarkable potential in scientific research, particularly in chemistry-related tasks such as molecular design, reaction prediction, and property estimation. While tool-augmented LLMs have been introduced to enhance reasoning and computation in these domains, existing approaches suffer from tool invocation errors and lack effective collaboration among diverse tools, limiting their overall performance. To address these challenges, we propose ChemHTS (Chemical Hierarchical Tool Stacking), a novel method that optimizes tool invocation pathways through a hierarchical stacking strategy. ChemHTS consists of two key stages: tool self-stacking warmup and multi-layer decision optimization, enabling LLMs to refine tool usage dynamically. We evaluate ChemHTS across four classical chemistry tasks and demonstrate its superiority over strong baselines, including GPT-4o, DeepSeek-R1, and chemistry-specific models, including ChemDFM. Furthermore, we define four distinct tool-stacking behaviors to enhance interpretability, providing insights into the effectiveness of tool collaboration. Our dataset and code are publicly available at https://github.com/Chang-pw/ChemHTS . 1 Introduction Figure 1: Using the text-based molecule design task as an example, this analysis examines the issues in model tool usage under Name2SMILES and ChemDFM tools. Figure 2: Our ChemHTS method framework diagram. For each chemical task, we identify the optimal tool-stacking pathway through the ChemHTS method for subsequent task inference execution. In recent years, large language models (LLMs) Touvron et al. (2023) ; Achiam et al. (2023) ; DeepSeek-AI et al. (2025) have made groundbreaking advancements in fields such as natural language processing (NLP) and knowledge reasoning, and are gradually being applied to scientific research, particularly demonstrating immense potential in the domain of chemistry Guo et al. (2023) ; Ouyang et al. (2024) . LLMs leverage their robust capabilities for knowledge integration and reasoning computation to offer novel solutions for tasks such as molecular design Noutahi et al. (2023) , reaction prediction Shi et al. (2023) , and property prediction Srinivas and Runkana (2024) . This progress significantly enhances the level of automation and intelligence in chemical research. Despite the promising prospects of LLMs in the field of chemistry, current research faces challenges. Existing models exhibit limitations in their ability to generalize across diverse tasks, and they lack access to external knowledge sources, which constrains their practical utility in scientific applications Zhao et al. (2024) ; Liao et al. (2024) ; Han et al. (2024) . Consequently, studies have integrated expert-designed tools to enhance the performance of LLMs in chemical tasks Bran et al. (2023) ; Boiko et al. (2023) ; Song et al. (2024) . However, chemical tool-augmented LLMs still exhibit numerous challenges when confronted with complex and diverse toolsets Bran et al. (2023) . Firstly, due to the limited capabilities of tools or the susceptibility of LLMs to tool calling errors, relying on a single tool invocation may result in biased outcomes Ye et al. (2024) . As illustrated in Fig. 1 , if the result of invoking an agent tool once is biased, the model is unable to self-correct and may produce incorrect answers. Secondly, LLMs struggle to collaborate across different types of tools, limiting their capacity to maximize information gain Cheng and Amiri (2025) . During reasoning, they often depend on a single category of tools, overlooking the synergistic benefits of integrating multiple tool types. As a result, errors can propagate through the reasoning chain, ultimately impairing overall task performance. Despite the emergence of numerous studies in recent years focused on optimizing tool usage, these efforts have not yet adequately addressed the aforementioned issues. Current research primarily concentrates on optimal tool selection for individual tasks, while overlooking the collaborative interactions between tools and their impact on task inference capabilities. Some studies have attempted to leverage the context learning capabilities of LLMs by employing strategic prompting to optimize tool selection. For instance, frameworks such as Chain of Thought (CoT) Wei et al. (2023) and ReACT Yao et al. (2023) ; Yang et al. (2023) aim to guide model in effectively utilizing tools during the reasoning process. Another category of methods involves fine-tuning LLMs on tool calling datasets to enhance their tool usage capabilities. For instance, approaches such as ToolBench Qin et al. (2023) utilizes supervised fine-tuning Shen (2024) to improve the model’s understanding and calling of tools. However, these approaches can only enhance the selection of individual tools to a limited extent and have not succeeded in achieving collaborative optimization among multiple tools. To address the aforementioned issues, we propose a novel tool calling optimization method termed ChemHTS ( Chem ical H ierarchical T ool S tacking), which aims to enhance the tool invocation process of LLMs in chemistry-related tasks. The core idea of C he m is to explore the optimal tool invocation pathways through a hierarchical stacking strategy under the constraints of a given chemical task and multiple tools, thereby improving the reasoning and computational capabilities of LLMs in chemical applications. This method encompasses two key stages: tool self-stacking and tool multi-layer decision optimization. In addition, we apply the ChemHTS method to four classic chemistry tasks: text-based molecular design, molecular description, molecular property prediction, and reaction prediction. We systematically explore the optimal tool invocation pathways for each task and conduct extensive experiments on the test sets. The results demonstrate that the tool invocation paths optimized by ChemHTS outperform several baseline models, such as GPT4o OpenAI et al. (2024) and DeepSeek-R1 DeepSeek-AI et al. (2025) , as well as chemistry-specific models, including UniMol Ji et al. (2024) and ChemDFM Zhao et al. (2024) , across all tasks. Furthermore, we define four distinct tool stacking behavioral patterns— Correct, Modify, Judge, and Reserve -and provide case studies to elucidate the reasons behind the improvements in task performance due to tool stacking. To summarize, our contributions are mainly three-fold: • We are the first to highlight the advantages of agent tool collaboration and propose the ChemHTS method to optimize the optimal tool stacking path for agents across various chemical tasks, addressing the issue of low efficiency in the utilization of agent tools. • Through extensive experiments, we have demonstrated that the optimal tool stacking paths derived from our method outperform numerous baseline models and chemistry-specific models across four classical chemical tasks, thereby validating the effectiveness and generalizability of our approach. • We define four behavioural patterns of models during the tool stacking process, to conduct an in-depth analysis and interpretation of the reasons behind the performance improvements in tool stacking, thereby enhancing the interpretability of the experiments. 2 Related Work 2.1 Large Language Models for Chemistry Large language models (LLMs) have demonstrated significant potential in chemistry, with applications spanning molecular generation, property prediction, reaction modeling, and retrosynthetic analysis Fang et al. (2024) ; Tang et al. (2024) ; Liao et al. (2024) . For instance, the ChemDFM Zhao et al. (2024) pretrained on chemical literature and textbooks and further refined through extensive instruction tuning, has exhibited enhanced performance across various chemical tasks. Similarly, ChemCrow Bran et al. (2023) , an LLM-powered chemistry assistant, integrates multiple expert-designed chemical tools to improve LLM performance in chemistry-related applications.Despite these advancements, LLMs continue to face challenges in handling complex chemical computations and generalizing across diverse