Pre-training Graph Neural Networks on 2D and 3D Molecular Structures by using Multi-View Conditional Information Bottleneck
Van Thuy Hoang, O-Joun Lee · 2025
Read Pre-training Graph Neural Networks on 2D and 3D Molecular Structures by using Multi-View Conditional Information Bottleneck by Van Thuy Hoang, O-Joun Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-18404.txt.
Introduction
Van Thuy Hoang and O-Joun Lee pre-train graph networks on molecules given in two views. One view shows the flat bond map; the other shows the 3D shape. Past methods align whole molecule summaries, but they miss two needs: keep what the views share, drop what is view only, and align key sub parts like functional groups.
Their frame, MVCIB, uses one view as context to judge the other under a bottleneck rule. That rule squeezes out noise while it keeps shared signal, at both whole graph and sub part levels. Training needs no labels, since each view teaches the other. The result should give richer molecule features for later tasks like property forecasts.
Catalog record
| CREATOR | Van Thuy Hoang, O-Joun Lee |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 69 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2511-18404
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Pre-training Graph Neural Networks on 2D and 3D Molecular Structures by using Multi-View Conditional Information Bottleneck Van Thuy Hoang, O-Joun Lee Abstract Recent pre-training strategies for molecular graphs have attempted to use 2D and 3D molecular views as both inputs and self-supervised signals, primarily aligning graph-level representations. However, existing studies remain limited in addressing two main challenges of multi-view molecular learning: (1) discovering shared information between two views while diminishing view-specific information and (2) identifying and aligning important substructures, e.g., functional groups, which are crucial for enhancing cross-view consistency and model expressiveness. To solve these challenges, we propose a Multi-View Conditional Information Bottleneck framework, called MVCIB, for pre-training graph neural networks on 2D and 3D molecular structures in a self-supervised setting. Our idea is to discover the shared information while minimizing irrelevant features from each view under the MVCIB principle, which uses one view as a contextual condition to guide the representation learning of its counterpart. To enhance semantic and structural consistency across views, we utilize key substructures, e.g., functional groups and ego-networks, as anchors between the two views. Then, we propose a cross-attention mechanism that captures fine-grained correlations between the substructures to achieve subgraph alignment across views. Extensive experiments in four molecular domains demonstrated that MVCIB consistently outperforms baselines in both predictive performance and interpretability. Moreover, MVCIB achieved the 3d Weisfeiler-Lehman expressiveness power to distinguish not only non-isomorphic graphs but also different 3D geometries that share identical 2D connectivity, such as isomers. Department of Artificial Intelligence, The Catholic University of Korea {hoangvanthuy90, ojlee}@catholic.ac.kr Figure 1: (a) It is difficult to distinguish cis and trans isomers only based on the 2D molecular graphs. (b) The incorporation of a Nitro group (R- {NO}_{2} ) into an Aromatic Hydroxyl group (R- C_{6}H_{5} , R- OH ) could change its chemical property. Introduction Pre-training Graph Neural Networks (GNNs) for molecules has emerged as a promising approach to address the challenge of limited labels of molecular data ( Rong et al. 2020 ; Luong and Singh 2023 ) . Most recent methods have mainly focused on 2D molecular graphs, which represent atoms as nodes and chemical bonds as edges. However, relying only on 2D information can be insufficient to determine chemical properties of molecules ( Liu et al. 2022 ) . As shown in Fig. 1 (a), cis and trans isomers have the same 2D connectivity, yet differ in the 3D atom positions, leading to different properties. That is, cis isomers tend to be more soluble in polar solvents and exhibit a higher boiling point than trans isomers. However, representations of 2D molecular structures are difficult to reflect such 3D geometric features. Recently, 2D and 3D molecular information have been jointly used in the pre-training of GNNs to enhance the quality of representations ( Kim et al. 2024 ; Stärk et al. 2022 ) . Most strategies aim to leverage the complementary information between the two views by employing contrastive learning objectives to maximize agreement between graph-level representations ( Stärk et al. 2022 ; Liu et al. 2022 ) . For example, GraphMVP ( Liu et al. 2022 ) introduces a joint training framework that combines contrastive learning with a reconstruction objective to align graph-level representations. More recently, a few methods have extended contrastive objectives to the subgraph level, aiming to align semantic substructures, e.g., functional groups, to learn chemically informed representations ( Kim et al. 2024 ; Luong and Singh 2023 ) . To sum up, most recent studies adopt the contrastive objectives to maximize the agreement between views on graph- or subgraph-level representations. However, two main challenges limit the recent studies. (1) Most recent multi-view strategies are limited to extracting shared and task-relevant information while minimizing irrelevant features from each view. From the multi-view learning perspective, each view is expected to contain a mixture of shared information and view-specific information, as they originate from the same molecule and share the same label ( Tsai et al. 2021 ) . Recent studies show that maximizing the shared features is crucial for enhancing the model generalization for downstream tasks ( Federici et al. 2020 ) . However, recent studies focus only on maximizing mutual information between representations from different views, without considering shared and view-specific information. (2) The recent studies are limited in their ability to identify and align important substructures across views. That is, while graph structures can differ between 2D and 3D views, the important substructures, e.g., functional groups, are invariant and commonly play a critical role in determining molecular properties ( Kim et al. 2024 ) . Through empirical experiments, we showed that capturing and aligning these substructures could enhance the model’s expressiveness in distinguishing not only non-isomorphic graphs but also isomers with identical 2D connectivity but differ in 3D geometry (Appendix D.6). Moreover, the co-occurrences of functional groups can be significant features for property prediction. For example, Fig. 1 (b) shows that adding a nitro group ( {NO}_{2} ) to a molecule containing a phenyl ( C_{6}H_{5} ) and alcohol ( {OH} ) can alter the chemical properties. In this paper, we propose the Multi-View Conditional Information Bottleneck (MVCIB), a GNN pre-training method designed to maximize shared information and align important substructures across molecular views. MVCIB is characterized by two main contributions. (1) The key contribution of MVCIB lies in its ability to maximize the shared and task-relevant information while minimizing irrelevant information from specific views in a self-supervised setting. We address this problem with the Information Bottleneck (IB) principle for learning compressed yet informative representations. However, applying the IB principle in a self-supervised setting is challenging due to the absence of labels, making it difficult to capture task-relevant information. To solve it, we propose the MVCIB principle, which utilizes a conditional compression strategy by using one molecular view as a conditional context to guide the representation learning of the other view. This is based on the multi-view assumption that, although each view could differ in perspective, all views originate from the same underlying molecule. To align important substructures across views, we first sample key subgraphs from molecular views to serve as anchor points, followed by a cross-attention mechanism to align the representations across views. (2-1) We extract two types of important subgraphs, i.e., functional groups and ego-networks rooted at each node, to enable MVCIB to capture both chemical semantics and contextual structures, enhancing the model’s transferability and expressiveness, respectively. That is, the model could benefit from learning correct patterns, e.g., functional groups, during the pre-training phase, enhancing its ability to transfer knowledge from large-scale unlabeled datasets to downstream datasets. To extract functional groups, we employ the BRICS algorithm ( Degen et al. 2008 ) to decompose molecules into chemical subgraphs. (2-2) We propose a cross-attention mechanism to align subgraph-level representations across views, where each subgraph representation from one view is used to attend over representations in the other view. By doing so, the cross-attention scores could enable MVCIB to learn fine-grained cross-view correlations between subgraph representations and align the important substructures. Related work Recent studies have jointly used 2D and 3D molecular information to pre-train GNNs for improving molecular property prediction ( Liu et al. 2022 ; Zhu et al. 2022 ) . The main idea is to learn