Bridging Chemists and AI: An Expert-Augmented Framework for Interpretable Route Evaluation
Yujia Guo, Mikhail Kabeshov, Tat Hong Duong Le, Samuel Genheden, Marco V. Mijangos, Varvara Voinarvoska, Giulia Bergonzini, Ola Engkvist, Samuel Kaski, [2mm] Department of Computer Science, Aalto University, Espoo, Finland · 2026
Read Bridging Chemists and AI: An Expert-Augmented Framework for Interpretable Route Evaluation by Yujia Guo, Mikhail Kabeshov, Tat Hong Duong Le, Samuel Genheden, Marco V. Mijangos, Varvara Voinarvoska, Giulia Bergonzini, Ola Engkvist, Samuel Kaski, [2mm] Department of Computer Science, Aalto University, Espoo, Finland (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-29108.txt.
Introduction
Yujia Guo and colleagues build an expert-augmented scoring framework for multi-step synthetic route evaluation. A DeepSets model trained on tree edit distance between reference and machine-generated routes is fine-tuned with expert evaluations, yielding quantitative scores and qualitative categories of Good, Plausible, and Bad. The system reaches correlations above three-quarters for category prediction and about 60 percent top-1 ranking accuracy for score prediction. That beats the previous baseline near 18 percent, showing expert knowledge plus machine learning beats proxy patent routes.
Catalog record
| CREATOR | Yujia Guo, Mikhail Kabeshov, Tat Hong Duong Le, Samuel Genheden, Marco V. Mijangos, Varvara Voinarvoska, Giulia Bergonzini, Ola Engkvist, Samuel Kaski, [2mm] Department of Computer Science, Aalto University, Espoo, Finland |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33120 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.29108
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Bridging Chemists and AI: An Expert-Augmented Framework for Interpretable Route Evaluation Yujia Guo, Mikhail Kabeshov, Tat Hong Duong Le, Samuel Genheden, Marco V. Mijangos, Varvara Voinarvoska, Giulia Bergonzini, Ola Engkvist, Samuel Kaski, [2mm] Department of Computer Science, Aalto University, Espoo, Finland Abstract Selecting efficient multi-step synthetic routes is a central challenge in organic synthesis, particularly in medicinal and process chemistry, where route choice directly impacts feasibility, cost, and development efficiency. The data-driven assessement systems often oversimplify the multi-objective nature of synthesis design and rely on proxy datasets (e.g., patent routes) rather than universal grounded criteria. To address this, we introduce an expert-augmented, data-driven scoring framework that integrates machine learning with chemists’ domain knowledge for both numerical and explainable route assessment. A DeepSets-based model is trained using tree edit distance between reference and machine-generated routes, then fine-tuned with expert evaluations to produce both quantitative scores and interpretable qualitative categories (Good, Plausible, Bad). The resulting system achieves an Spearman correlation coefficient of 0.78 ± 0.05 and Pearson correlation of 0.77 ± 0.06 regarding its category assessment prediction, and 60.2% top-1 ranking accuracy regarding its score prediction, substantially outperforming the previous baseline (17.5%). \workshoptitle Generative Models, LLMs, and the Future of Molecular AI (ML4Molecules 2025) 1 Introduction The selection of an appropriate multi-step synthetic route is crucial in organic synthesis, particularly in medicinal and process chemistry, where it plays a central role in drug discovery and development 4 . While Computer-Aided Synthesis Planning (CASP) tools have achieved success in generating diverse route options, the subsequent evaluation of these routes remains a critical bottleneck. Although substantial efforts have been made to improve single-step retrosynthetic transformations, the feasibility prediction of forward synthesis remains challenging, partly due to the lack of high-quality negative reaction data 17 . Furthermore, the focus on high "success rates" in CASP can be misleading if the underlying single-step model may be overly permissive to allow unrealistic retrosynthetic steps 18 . The multi-objective nature of synthesis planning also needs expert to balance off, where factors such as feasibility, cost, route length, availability of starting materials, sustainability, safety, and scalability often conflict. Consequently, the field must exert domain knowledge to filter these options, relying heavily on the expertise of synthetic chemists to answer the ultimate chemical question: Is this route experimentally feasible and optimal? Currently, this reliance on human expertise creates a dependency on manual evaluation, which is slow, expensive, and difficult to scale 28 . To automate this, recent machine learning methods have treated patent-extracted routes as proxies for "expert-validated" ground truth, training models to distinguish these from machine-generated routes 19 ; 14 . However, patents often reflect time-constrained choices rather than optimal chemistry. The existing datasets is sparse 18 because usually only one or a few possible syntheses have been reported for most molecules. Since retrosynthesis is multi-objective and lacks a universal objective truth, optimizing solely on patent data risks overfitting to the appearance of a patent route rather than learning the underlying reasoning and evaluation heuristics used by chemists. Figure 1 : Pipeline for developing an expert-augmented deep learning system. In this work, we propose an expert-augmented framework (Figure 1 ) that combines large-scale data-driven modeling with small-scale, expert-aligned assessment, providing interpretable metrics actionable in synthesis practice. We aim to learn a generalizable model capable of both scoring and rating synthetic routes, predicting feasibility based on intrinsic chemical merit while capturing how experts resolve multi-objective trade-offs. To achieve this, we first employ a similarity comparison metric to construct a DeepSets-based 29 scoring model designed with multiple route-level objectives and reaction features, trained on a large corpus of patent routes. Then, to bridge the gap between numerical similarity and human judgment, we then design a qualitative reaction-to-route evaluation criterion that translates complex chemical reasoning into a learnable framework. We subsequently employ a fine-tuning strategy to adapt the model using expert assessments derived from this specific criterion. This allows the model to learn a distinct route feasibility rating, efficiently leveraging limited but high-value human assessment data. Our expert-augmented framework provides a more reliable, transparent, and dual-output (multi-objective quality score + feasibility rating) evaluation of synthetic routes, better aligned with real-world decision-making in retrosynthetic planning. In quantitative ranking, The model reached 60.2% top-1 accuracy and an RMSE of 2.72 using SDF embeddings on the test dataset, outperforming previous baselines 19 (17% vs. 60% top-1 accuracy). The model fine-tuned on this expert-labeled framework, is able to predict not just a numerical similarity score, but an interpretable qualitative evaluation of feasibility. The model achieved a Spearman correlation of 0.782\pm 0.050 , a Pearson correlation of 0.769\pm 0.064 with expert ratings in 5-point prediction, and 67\pm 6.4\% classification accuracy in the final three-tier rating, demonstrating its ability to successfully capture the nuance of expert chemical judgment. 2 Expert-augmented route assessment system 2.1 Pre-training of DeepSets-based scoring model We constructed the evaluation model using the DeepSets 29 neural network architecture, incorporating an embedding of both the route and the route property values. It is specifically designed to process sets with permutation-invariance. This allowed the model to robustly handle varying numbers of reactions and unordered inputs, ensuring flexibility and scalability in route evaluation. This model predicts the TED score of any synthetic route without knowing the reference route. The information of all reactions in one route is processed as route encoding, and then combined with other route features such as complexity and cost to predict the final TED score. Through the manuscript, we refer to the reaction-level processing network as the encoder network, and the route score prediction network as the scorer network. Formally, let X=\{\mathbf{x}_{1},\mathbf{x}_{2},\dots,\mathbf{x}_{n}\} represent the set of reaction features of n reactions in one route. Each reaction i is represented by a feature vector \mathbf{x}_{i}=\{x^{1}_{i},x^{2}_{i},x^{3}_{i},\mathbf{x}^{4}_{i}\} , where the components include the reaction features detailed in Section A.3 : the reaction class, feasibility score, target compound representation vector, and an optional representation vector (if route embedding is employed). The encoder \phi we built satisfies \phi(\mathbf{x}_{1},\mathbf{x}_{2},\dots,\mathbf{x}_{n})=\phi(\mathbf{x}_{\pi(1)},\mathbf{x}_{\pi(2)},\dots,\mathbf{x}_{\pi(n)}), (1) where \pi is a permutation function that reorders these elements. Regardless of how the order of reactions is shuffled by \pi , the function \phi produces the same encoding. This ensures that the output remains the same, regardless of how the input reactions are ordered. Then, the aggregated reaction encoding from the encoder was concatenated with the route properties, including cost, price, and complexity, along with the molecule fingerprints, before being passed to the scorer network to compute the TED score. The fingerprint used as input in both networks is designed to generate target-specific reaction encodings and target-specific route scoring. This setup also allowed the two models to function independently, accommodating various practical demands or constraints. The complete model can be expressed as: SCORE \displaystyle=\sigma\left(\phi(\mathbf{x}_{1},\mathbf{x}_{2},\dots,\mathbf{x}_{n}),c,e,v\right) (2) \displaystyle=\sigma\left(\sum_{i=1}^{n}f(\mathbf{x}_{i}),c,e,v\right) (3) where f is a neural network applied to each reaction feature list, and the transformed inputs are summed, producing a representation that is invariant to the reaction order. The scorer net \sigma processes the aggregated reaction encoding as well as the route features cost c , volume v and complexity e . In summary, as shown in Figure 3 , the DeepSets-based network architecture consists of two primary modules: the reaction-level encoder \phi and route-level scorer \sigma , which take in route-level