Combining Graph Neural Networks and Mixed Integer Linear Programming for Molecular Inference under the Two-Layered Model

Jianshen Zhu, Naveed Ahmed Azam, Kazuya Haraguchi, Liang Zhao, Tatsuya Akutsu · 2025

Read Combining Graph Neural Networks and Mixed Integer Linear Programming for Molecular Inference under the Two-Layered Model by Jianshen Zhu, Naveed Ahmed Azam, Kazuya Haraguchi, Liang Zhao, Tatsuya Akutsu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-03920.txt.

Introduction

Jianshen Zhu and co-workers built new molecules by marrying graph networks to exact tuning in a 2025 paper. The mol-infer setup invents lab graphs with prescribed form and property values by coding a trained predictor inside mixed integer coding. Any put forth molecule provably satisfies the predictor's verdict. Handcrafted feature vectors, chosen for coding tractability, capped forecast quality on some traits, and poor forecasts poison the invented compounds.

Graph neural networks read the molecule itself and predict better, but resist exact coding. The authors combine the two so network-grade learning feeds the guessing tool set under a two-layered model of lab form. Better property models should translate straight into better option molecules for synthesis.

Catalog record

CREATORJianshen Zhu, Naveed Ahmed Azam, Kazuya Haraguchi, Liang Zhao, Tatsuya Akutsu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE146 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-03920

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Combining Graph Neural Networks and Mixed Integer Linear Programming for Molecular Inference under the Two-Layered Model Jianshen Zhu, Naveed Ahmed Azam, Kazuya Haraguchi, Liang Zhao, Tatsuya Akutsu Abstract Abstract Recently, a novel two-phase framework named mol-infer for inference of chemical compounds with prescribed abstract structures and desired property values has been proposed. The framework mol-infer is primarily based on using mixed integer linear programming (MILP) to simulate the computational process of machine learning methods and describe the necessary and sufficient conditions to ensure such a chemical graph exists. The existing approaches usually first convert the chemical compounds into handcrafted feature vectors to construct prediction functions, but because of the limit on the kinds of descriptors originated from the need for tractability in the MILP formulation, the learning performances on datasets of some properties are not good enough. A lack of good learning performance can greatly lower the quality of the inferred chemical graphs, and thus improving learning performance is of great importance. On the other hand, graph neural networks (GNN) offer a promising machine learning method to directly utilize the chemical graphs as the input, and many existing GNN-based approaches to the molecular property prediction problem have shown that they can enjoy better learning performances compared to the traditional approaches that are based on feature vectors. In this study, we develop a molecular inference framework based on mol-infer , namely mol-infer-GNN , that utilizes GNN as the learning method while keeping the great flexibility originated from the two-layered model on the abstract structure of the chemical graph to be inferred. We conducted computational experiments on the QM9 dataset to show that our proposed GNN model can obtain satisfying learning performances for some properties despite its simple structure, and can infer small chemical graphs comprising up to 20 non-hydrogen atoms within reasonable computational time. Keywords: Machine Learning, Graph Neural Networks, Integer Programming, Chemoinformatics, Molecular Design, Inverse QSAR/QSPR. 1 Introduction Designing novel molecules with predetermined structures and desired properties is a critical challenge across diverse research fields, including materials science [ 28 ] and drug discovery [ 27 , 32 ] . In recent years, significant progress has been made in molecular design using various machine learning techniques [ 23 , 40 ] . Computational molecular design, historically entrenched in chemoinformatics, has been studied under the name of quantitative structure activity/property relationship (QSAR/QSPR) [ 10 , 35 ] and its inverse counterpart inverse quantitative structure activity/property relationship (inverse QSAR/QSPR) [ 17 , 27 , 30 ] . Analysis of the activities and properties of chemical compounds is crucial not only in chemistry but also in biology, given their pivotal roles in various metabolic pathways. QSAR/QSPR aims to predict chemical activities from given chemical structures [ 10 ] . A prediction function is usually constructed from existing structure-activity relation data, employing machine learning-based methods, including artificial neural network (ANN)-based methods [ 23 , 40 ] . On the other hand, inverse QSAR/QSPR seeks to infer chemical structures from given chemical activities [ 17 , 27 , 30 ] . In most classical approaches, chemical structures are typically treated as an undirected graph called chemical graphs and encoded as a vector of real numbers called descriptors or feature vectors . A typical approach to inverse QSAR/QSPR involves first inferring feature vectors from given chemical activities and then reconstructing chemical graphs from these feature vectors [ 17 , 27 , 30 ] . While these handcrafted features have been effective in many cases, the limitations become apparent when dealing with large-scale datasets [ 14 ] . Recent advancements in deep learning, especially the development of graph neural networks (GNNs), have provided a promising alternative to traditional feature-based methods. GNNs have demonstrated superior performance in capturing intricate relationships with chemical graphs by directly utilizing the graph structure as input, eliminating the need for manually designed descriptors [ 21 , 31 , 14 ] . The ability to automatically learn meaningful representations from non-Euclidean data has opened new avenues for molecular property prediction, with several GNN-based models achieving state-of-the-art results on benchmark datasets like QM9 [ 11 , 14 , 31 , 13 , 46 ] . Also, there are several GNN-based approaches to the molecular graph generation problem [ 41 ] . These methods either generate a new graph in a sequential manner [ 15 , 22 ] –adding vertices and edges step by step, or in a global manner [ 8 , 5 ] –outputting an entire graph at once. However, despite the remarkable progress made with GNNs (and other deep learning-based approaches), most existing approaches focus mainly on the prediction task of QSAR/QSPR, and few studies have effectively integrated GNNs into the inverse QSAR/QSPR frameworks. A significant challenge is to ensure the following two important properties of the generated chemical structures, namely optimality —the quality of the solution for the inverse problem of the learning methods, and exactness —whether the solution admits a valid chemical graph. While many deep learning-based generative models (e.g., [ 34 , 7 , 6 , 19 ] ) aim to create chemically plausible molecules, they often fail to guarantee the optimality or the exactness of the inferred solutions mathematically, which can be problematic in practical applications [ 47 ] . Figure 1: An illustration of the two-phase framework mol-infer . To overcome these limitations, a novel framework called mol-infer [ 2 , 44 , 33 , 49 ] was recently proposed for inferring chemical compounds with prescribed abstract structures and desired property values. This framework is primarily based on using the mixed integer linear programming (MILP) formulation to simulate the computational process of machine learning methods and also describe the necessary and sufficient conditions to ensure the existence of a valid chemical graph. As a result, mol-infer generates chemical graphs in a global manner and guarantees both the optimality and exactness of the inferred chemical graph. Figure 1 provides an illustration of mol-infer . Simply put, mol-infer consists of two phases. Phase 1 is the QSAR/QSPR phase aiming to construct a prediction function \eta between chemical compounds and their observed property values. Let \mathcal{G} denote the set of all possible chemical graphs. First, we collect a dataset D_{\pi}\subseteq\mathcal{G} of chemical graphs consisting of chemical graphs \mathbb{C} and the observed values a(\mathbb{C}) (Stage 1). Then we use a feature function f:\mathcal{G}\to\mathbb{R}^{K} ( K is a positive integer) to convert chemical graphs to a K -dimensional real vectors (Stage 2). Finally, a prediction function \eta:\mathbb{R}^{K}\to\mathbb{R} is constructed by some machine learning methods (Stage 3). Phase 2 is the inverse QSAR/QSPR phase, and the target is to infer chemical graphs with specific property values. Given a set of rules called topological specification \sigma that specifies the desired structure of the inferred chemical graphs, and a desired range [\underline{y}^{*},\overline{y}^{*}] of the target value, Stage 4 is designed to infer chemical graphs \mathbb{C}^{*} that satisfy the rules \sigma and \eta(f(\mathbb{C}^{*}))\in[\underline{y}^{*},\overline{y}^{*}] by solving an MILP formulation \mathcal{M}(g,x,y;\mathcal{C}_{1},\mathcal{C}_{2}) that represents: (i) \mathcal{M}(x,y;\mathcal{C}_{1}) : the computation process of the prediction function \eta ; and (ii) \mathcal{M}(g,x;\mathcal{C}_{2}) : that of the feature function f and the constraints for \mathbb{C}\in\mathcal{G}_{\sigma} , where \mathcal{G}_{\sigma} denotes the set of all chemical graphs satisfying \sigma . In Stage 5, dynamic programming-based graph

Read the complete text