Sub-Clustering for Class Distance Recalculation in Long-Tailed Drug Classification DOI: XXXXXXX.XXXXXXX Conference: 31st SIGKDD Conference on Knowledge Discovery and Data Mining; August 03–07, 2025; Toronto, Canada ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Applied computing Chemistry CCS: Computing metho

Yujia Su, Xinjie Li, Lionel Z. WANG · 2025

Read Sub-Clustering for Class Distance Recalculation in Long-Tailed Drug Classification DOI: XXXXXXX.XXXXXXX Conference: 31st SIGKDD Conference on Knowledge Discovery and Data Mining; August 03–07, 2025; Toronto, Canada ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Applied computing Chemistry CCS: Computing metho by Yujia Su, Xinjie Li, Lionel Z. WANG (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-04647.txt.

Introduction

Yujia Su, Xinjie Li, and Lionel Wang recast how distances between drug classes are computed for lopsided data in this 2025 paper. Rare classes usually lose in long-tailed datasets. Drug chemistry breaks that rule in an odd way. Some rare drug classes are easy to spot thanks to odd molecular shapes. Standard fixes, like resampling, worship sample counts alone. They can over-serve the tail and hurt the common classes.

The new method splits classes into sub-clusters before measuring distances. Identifiability, not headcount, then drives the learning balance. The setting is drug classification with skewed categories. Better tail handling could speed compound screening. The paper challenges a static counting habit in the field. It is a machine learning methods study.

Catalog record

CREATORYujia Su, Xinjie Li, Lionel Z. WANG
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-04647

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Sub-Clustering for Class Distance Recalculation in Long-Tailed Drug Classification DOI: XXXXXXX.XXXXXXX Conference: 31st SIGKDD Conference on Knowledge Discovery and Data Mining; August 03–07, 2025; Toronto, Canada ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Applied computing Chemistry CCS: Computing methodologies Learning latent representations Yujia Su, Xinjie Li, Lionel Z. WANG Abstract . In the real world, long-tailed data distributions are prevalent, making it challenging for models to effectively learn and classify tail classes. However, we discover that in the field of drug chemistry, certain tail classes exhibit higher identifiability during training due to their unique molecular structural features—a finding that significantly contrasts with the conventional understanding that tail classes are generally difficult to identify. Existing imbalance learning methods, such as resampling and cost-sensitive reweighting, overly rely on sample quantity priors, causing models to excessively focus on tail classes at the expense of head class performance. To address this issue, we propose a novel method that breaks away from the traditional static evaluation paradigm based on sample size. Instead, we establish a dynamical inter-class separability metric using feature distances between different classes. Specifically, we employ a sub-clustering contrastive learning approach to thoroughly learn the embedding features of each class. and we dynamically compute the distances between class embeddings to capture the relative positional evolution of samples from different classes in the feature space, thereby rebalancing the weights of the classification loss function. We conducted experiments on multiple existing long-tailed drug datasets and achieved competitive results by improving the accuracy of tail classes without compromising the performance of dominant classes. Code is available at https://github.com/womale/LTDD/tree/master 1. Introduction In the field of drug discovery, deep neural networks have been successfully applied to key tasks such as molecular property prediction, virtual screening, and compound synthesis route planning ( Schwaller et al. 2021 ; Lu and Zhang 2022 ) . However, existing research often ignores an essential challenge - the long-tail nature of real-world drug discovery data. In a typical drug discovery dataset, there is an order of magnitude difference between the high frequency and low frequency categories, with some tail categories containing only a few dozen samples, while the head category can have a sample size of tens of thousands. This data imbalance will lead to systematic bias in the deep learning model: It means that the classification accuracy of the head class is high and the classification accuracy of the tail class is low in the test set. Figure 1. The relationship between the number of samples of different classification labels and classification accuracy in the dataset. However, we found that in the field of drug classification, insufficient sample size does not exactly equate to classification difficulty. As shown in figure 1 , due to their unique molecular structure characteristics, some tail categories show good recognition in practical classification models. This phenomenon conflicts with the core idea of traditional long-tail learning. The core assumption of traditional long-tail learning methods, such as reweighting ( Byrd and Lipton 2019 ) and re-sampling ( Ando and Huang 2017 ) , is that classes with a smaller sample size are more difficult to classify, so more attention needs to be paid to the tail classes during training. However, these methods may bring some disadvantages. When the classification difficulty of tail classes is not completely related to the number of samples, the classification difficulty of some tail classes may be overestimated, resulting in the loss of the overall sample information, and the noise in the tail classes is excessively amplified, thus reducing the classification accuracy of the head classes and further decreasing the overall classification ability of the model. This unbalanced optimization strategy may cause the model to ignore the importance of the head class while pursuing the performance of the tail class, and ultimately affect the overall performance of the model. We believe that categories with lower classification accuracy may be caused by two intrinsic reasons. The first point may be that the model does not sufficiently learn the features of these categories, which may be related to the small sample size of these categories. The insufficient number of samples limits the model to capture the features of the tail class, resulting in inadequate learning. The second point may be that the actual differences between certain categories or individual samples are small, making them closer in the feature space and therefore easy to confuse when classifying. For the first point, we need to design a method that can learn the features of all samples as fully as possible, especially the features of the tail category, to make up for the lack of information caused by the insufficient number of samples. For the second point, we propose to evaluate the classification difficulty of a class by calculating the class spacing between embedded features of different classes, so as to construct a more meaningful measure of identifiability. Our research will focus on how to rationally utilize inter-class distances to measure classification difficulty. Supervised Contrastive Learning (SCL) effectively addresses this need, as it can pull samples of the same class closer together in the feature space while pushing samples of different classes farther apart, thereby facilitating the calculation of inter-class distances. However, considering that only a subset of samples within a class may be prone to confusion, rather than all samples posing a risk of confusion with other classes, we adopt a sub-clustering supervised contrastive learning approach to achieve more refined feature representation. Specifically, we further cluster the head classes into multiple sub-classes in the learned feature space, with the number of samples in each sub-class being comparable to that of the tail classes, and incorporate the distances between these sub-classes into the optimization objective of the loss function. This method not only provides more nuanced feature representation but also enables us to simultaneously compute inter-class distances and intra-class sub-class distances. This methodology offers a supplementary view of class distance, providing insights into the nuances of classification at a more detailed level. By examining this distance representation at the subclass level, we gain a nuanced understanding of the classification hurdles encountered within the most intricate segments of each class. Clearly, if the samples of a class are farther apart from samples of other classes in the feature space, it indicates that the class possesses more distinctive features, making it more independent in the feature space and consequently reducing its classification difficulty. Through this approach, we can more accurately assess the classification difficulty of classes and provide more targeted guidance for model optimization. In this paper, we implement the proposed method across various long-tailed drug classification tasks and experimentally validate its significant advantages over previous approaches. The main contributions of this study can be summarized as follows: (a) We reveal that in the field of drug classification, the number of samples is not the decisive factor for classification difficulty. This finding challenges the assumptions of traditional long-tailed learning methods, indicating that these methods are not entirely applicable in this domain. (b) We propose a classification difficulty assessment method based on inter-class distances and design an innovative model architecture that integrates sub-clustering contrastive learning with inter-class distance re-weighting. This approach enables a more accurate measurement of the separability between classes, thereby dynamically adjusting the weights of the

Read the complete text