A Semi-supervised Molecular Learning Framework for Activity Cliff Estimation
Fang Wu · 2026
Read A Semi-supervised Molecular Learning Framework for Activity Cliff Estimation by Fang Wu (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-04507.txt.
Introduction
Fang Wu tackles the molecules that break machine learning's favourite assumption, in a 2026 arXiv paper. Property predictors rest on similarity: similar molecules should behave alike. Activity cliffs are the exceptions, near-identical molecules with sharply different potency, and they wreck graph-based models exactly where drug hunters care most. Labelled cases near cliffs are scarce, which rules out brute-force teaching.
His system, SemiMol, learns in a partly guided way from the many molecules with no labels instead. A teacher model grades the trustworthiness of pseudo-labels the main model assigns, a step ordinary pseudo-labelling cannot do for regression because it lacks confidence outputs. A self-adaptive curriculum then walks the target model toward the hard examples at a controlled pace. Across thirty activity cliff datasets, SemiMol greatly improved graph-based designs and beat state-of-the-art pretraining and partly guided baselines.
Catalog record
| CREATOR | Fang Wu |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-04507
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
A Semi-supervised Molecular Learning Framework for Activity Cliff Estimation Fang Wu Abstract Machine learning (ML) enables accurate and fast molecular property predictions, which is of interest in drug discovery and material design. Their success is based on the principle of similarity at its heart, assuming that similar molecules exhibit close properties. However, activity cliffs challenge this principle, and their presence leads to a sharp decline in the performance of existing ML algorithms, particularly graph-based methods. To overcome this obstacle under a low-data scenario, we propose a novel semi-supervised learning (SSL) method dubbed SemiMol, which employs predictions on numerous unannotated data as pseudo-signals for subsequent training. Specifically, we introduce an additional instructor model to evaluate the accuracy and trustworthiness of proxy labels because existing pseudo-labeling approaches require probabilistic outputs to reveal the model’s confidence and fail to be applied in regression tasks. Moreover, we design a self-adaptive curriculum learning algorithm to progressively move the target model toward hard samples at a controllable pace. Extensive experiments on 30 activity cliff datasets demonstrate that SemiMol significantly enhances graph-based ML architectures and outpasses state-of-the-art pretraining and SSL baselines. 1 Introduction The Similar-Structure, Similar-Property Principle (SSP) 3 has been a central premise in medicinal chemistry that similar molecules tend to exhibit similar properties, which can be physical ( e.g. , boiling points) or biological ( e.g. , activity). This fundamental assertion is validated by long experience suggesting that rules of thumb such as phenethylamines are likely to have activity in the central nervous system and that \beta -lactams frequently possess antibacterial activity 25 . Computational chemists have also exploited this premise in their analysis of the molecular diversity of compound libraries and the selection of compounds for high-throughput screening (HTS) 16 . Figure 1: For non-activity cliffs, GNNs successfully discover the motif of COC(=O)c1ccccc1 and group molecules with this pattern as local anesthetics. For activity cliffs, GNNs are misguided by the shared motif pattern of COCCNCc1ccccc1 and wrongly predict the inactivity of relevant molecules. This concept of chemical similarity (or molecular similarity) rationalizes the thriving deployment of machine learning (ML) models in discovering and designing new drugs with expected functions. Noticeably, ML algorithms usually work by recognizing the statistically important patterns and assigning close values to neighbor samples in the high-dimensional feature space 26 . They learn motifs that appear repeatedly in the training set, cluster molecules that carry the same motif, and make similar predictions for them 48 . Therefore, SSP lays down a solid scientific foundation for and highly aligns with the inner operation logic of ML mechanisms. Despite the triumph that ML has achieved in forecasting molecular properties, one particular exception to this principle holds great insights into the underlying structure-activity (or structure-property) relationships 37 . This exception is constituted by activity cliffs 24 , which are pairs of structurally similar molecules that exhibit a large difference in their biological activity. These outliers can impose a detrimental effect on ML models by misguiding them to seriously mispredict the activity of certain molecules, even with an overall high model predictivity (see Figure 1 ). Although numerous studies have focused on defining activity cliffs and investigating their influence 41 , how to ameliorate this obstacle to the development of ML remains unexplored. In particular, the quantity and quality of the data are one of the most pivot factors in the success of deep learning (DL) algorithms, but the evaluation of DL methods on activity cliff estimation is always in a low-data scenario. Meanwhile, the graph research community for molecule modeling has been trying to replicate the victory of self-supervised pretraining in NLP and claims substantial improvements by pretraining on large-scale datasets 32 ; 56 . Consequently, it provokes the question that “how much benefit self-supervised learning can bring to estimate activity cliffs?” . As an answer, we observe a negligible reward gained by pretraining in many cases. Our first important finding is that self-supervised graph pretraining does not always have statistically significant advantages over non-pretraining methods with an average improvement ratio of merely 6.35%. Secondly, although several recent studies leverage the 3D spatial information of molecules during the pretraining stages 9 , the incorporation of 3D geometry does not exhibit considerable advantages in recognizing molecular cliffs. Third, the design of the backbone GNNs has a larger impact on the accuracy of activity cliff estimation than the choice of pretraining mechanisms. This phenomenon inspires us to explore a more efficient schema to employ the abundant unlabeled molecules and relieve the data scarcity in activity cliff identification. Towards this direction, we present a novel and effective semi-supervised learning (SSL) mechanism dubbed SemiMol, which leverages predictions on unannotated data as supervised signals for subsequent training. However, pseudo-labels can be unreliable because labeled and unlabeled samples are usually drawn from different data distributions and DL models often struggle to detect this discrepancy. Besides that, existing pseudo-labeling approaches require probabilistic outputs to reveal the model’s confidence and fail to be applied in regression tasks 31 ; 47 . To surmount this barrier, we introduce an additional instructor model to evaluate the accuracy and trustworthiness of proxy labels. These confidence scores then instruct the target molecular model to selectively focus on different data points in a progressive way. In SemiMol, rather than using fixed thresholds or manually tuning thresholds with percentile scores 5 , we propose a self-adaptive criterion for curriculum learning to determine which subset of pseudo-labeled samples should be incorporated into the training set. With these delicately designed controllable learning paces, the target molecular model can take advantage of the unlabeled data assuredly without suffering from over-reliance on labeled data and the severe inaccuracy of some pseudo-labels. We conducted extensive experimentation and visualization on MoleculeACE 41 to verify the effectiveness of our method. It can be found that our SemiMol significantly promotes the representation ability of graph-based DL models in low-data scenarios and it outperforms state-of-the-art (SOTA) pretrained GNNs, descriptor-based ML models, and sequenced-based language models as well as prevailing SSL methods on all 30 activity cliff datasets. These results provide encouraging evidence that SemiMol can accurately capture adequate chemical and biological information to recognize cliffs in bioactivity. Our work positions itself in a broader movement within the graph-learning community for bioinformatics and aims to explore the optimal solution for low-data molecular property prediction systematically. Figure 2: Illustration of SemiMol. The target model first assigns predictions for unlabeled molecular data. Then the instructor model analyzes the confidence of those proxy labels. After that, a self-adaptive curriculum learning schema is adopted to move the target model towards hard samples progressively. By iteratively repeating these processes, the target model can extract task-specific information from vast unannotated molecules to the greatest extent. 2 Method 2.1 Preliminaries and Background Task formulation. Assume that there exists a set of accessible molecular data \mathcal{D}^{\star}=\left\{\left(x_{i}^{\star},y_{i}^{\star}\right)\right\}_{i=1}^{N} , which consists of labeled data points x_{i}^{\star} . They can be in different formats such as 1D sequences, 2D graphs, and 3D structures, and y_{i}^{\star} can be any discrete ( e.g. , toxicity, and drug reaction) or continuous properties ( e.g. , water solubility, and free energy). Here we only consider the continuous property to align with the setting of the activity cliff estimation problem. Still, our approach can