Class–Confidence Aware Reweighting for Long-Tailed Learning
Brainard Philemon Jagati, Jitendra Tembhurne, Harsh Goud, Rudra Pratap Singh, Chandrashekhar Meshram · 2026
Read Class–Confidence Aware Reweighting for Long-Tailed Learning by Brainard Philemon Jagati, Jitendra Tembhurne, Harsh Goud, Rudra Pratap Singh, Chandrashekhar Meshram (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-15924.txt.
Introduction
Brainard Philemon Jagati and four co-authors fix learning on skewed class data in a 2026 arXiv paper. Deep networks degrade badly under long-tailed distributions. A few head classes dominate the training data. Tail classes get very few examples. The model then masters the common and fumbles the rare. Their method is class-confidence aware reweighting, per the title. Training examples are reweighted by class and by model confidence.
Reweighting shifts attention toward what the model gets wrong. Class awareness counters the head classes' bulk. Confidence awareness focuses on uncertain cases. Rare classes matter in medicine and safety, where the rare event is often the important one. Methods that lift tail performance without hurting the head are in real demand.
Catalog record
| CREATOR | Brainard Philemon Jagati, Jitendra Tembhurne, Harsh Goud, Rudra Pratap Singh, Chandrashekhar Meshram |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-15924
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Class–Confidence Aware Reweighting for Long-Tailed Learning Brainard Philemon Jagati, Jitendra Tembhurne, Harsh Goud, Rudra Pratap Singh, Chandrashekhar Meshram Abstract Deep neural network models degrade significantly in the long-tailed data distribution, with the overall training data dominated by a small set of classes in the head, and the tail classes obtaining less training examples. Addressing the imbalance in the classes, attention in the related literature was given mainly to the adjustments carried out in the decision space in terms of either corrections performed at the logit level in order to compensate class-prior bias, with the least attention to the optimization process resulting from the adjustments introduced through the differences in the confidences among the samples. In the current study, we present the design of a class and confidence-aware re-weighting scheme for long-tailed learning. This scheme is purely based upon the loss level and has a complementary nature to the existing methods performing the adjustment of the logits. In the practical implementation stage of the proposed scheme, we use an Ω ( p t , f c ) \Omega(p_{t},f_{c}) function. This function enables the modulation of the contribution towards the training task based upon the confidence value of the prediction, as well as the relative frequency of the corresponding class. Our observations in the experiments are corroborated by significant experimental results performed on the CIFAR-100-LT, ImageNet-LT, and iNaturalist2018 datasets under various values of imbalance factors that clearly authenticate the theoretical discussions above. I Introduction Deep learning models derived from neural network architectures [ 11 ] have become the most popular choice for a broad spectrum of classification tasks. These models include speech recognition [ 24 ] , natural language processing [ 32 ] , anomaly detection [ 25 ] , recommendation systems [ 36 ] , and health care [ 29 ] . In all such systems, a classifier and an encoder transform the hierarchical representation of a neural network into a discrete class, making accuracy a crucial determinant of system performance. This explains why a great deal of effort and innovation have been directed toward developing optimized architectures for greater accuracy, precision, and generalization. Despite these advances, most real-world datasets are not collected under controlled or balanced conditions. Instead, data are often acquired from heterogeneous and naturally occurring sources, where certain classes appear far more frequently than others. This leads to imbalanced or long-tailed data distributions [ 1 , 6 ] , under which neural networks tend to overfit dominant (head) classes while failing to learn discriminative representations and reliable decision boundaries for under-represented (tail) classes. To address class imbalance, a variety of strategies have been explored in prior work. A widely adopted approach is data re-sampling [ 2 ] , where minority classes are over-sampled or majority classes are under-sampled to improve class balance [ 5 , 28 ] . Though successful in some applications, re-sampling may end up replicating some samples or removing useful information in the process. A related but distinct approach is where the model addresses loss re-weighting based on classes. This involves assigning higher weights to the losses of under-represented classes. One such technique is the Class-Balanced Loss [ 9 ] , which reweights the gradients using effective sample sizes. This method takes advantage of statistics but addresses the issue only at the class level. In parallel, confidence-based methods such as Focal Loss [ 18 ] prioritize hard-to-classify samples by down-weighting well-classified ones; however, these approaches are class-agnostic and do not explicitly model long-tailed class distributions. More recently, logit-level correction and margin-based methods have been proposed to directly counteract class-prior bias in the decision space [ 23 , 35 , 27 ] . Although effective, these methods typically apply uniform, class-level corrections and do not explicitly account for sample-wise confidence variations during optimization. In contrast, our work focuses on loss-level reweighting that jointly incorporates class frequency and prediction confidence, offering a complementary mechanism to decision-space corrections by adaptively modulating gradient contributions without modifying logits or inference behavior. • To propose a simple and lightweight class–confidence aware reweighting formulation that modulates sample-wise optimization dynamics without modifying logits, margins, or inference behavior. The formulation introduces a single suppression parameter \omega , which controls the degree of hardness modulation in a stable and interpretable manner. • To propose a unified weight function that multiplies the cross-entropy loss with an exponential term that involves the predicted class probability p_{t}. of the positive class and its frequency f_{c}. The proposed framework seeks to emphasize stronger gradients of samples from minority classes with weak confidence levels while suppressing the gradients of samples with strong confidence levels in the major classes. • To evaluate the effectiveness of our method through extensive experiments on common long-tailed datasets: CIFAR-100-LT [ 4 ] , ImageNet-LT [ 19 ] , and iNaturalist [ 13 ] , on various values of the imbalance factor. Our reweighting method is shown to improve the accuracy of tail classes while maintaining competitive performance on head classes compared to the recent methods. II Related Work Current methods for solving the class imbalance problem in supervised learning can be generally classified into sampling methods and loss-weighting approaches. II-A Data Re-sampling Techniques of re-sampling data attempt to counterbalance class distributions either through over-sampling in the minority class or through under-sampling in the majority class [ 5 , 28 ] . Although such techniques may have a positive impact on the imbalance at the data level, certain side effects inevitably crop up. Simple over-sampling may lead to repeated samples, thereby preferring model overfitting to the lesser variation in the tail class, as opposed to learning more generalizable features [ 10 ] . Under-sampling would necessarily entail losing informative samples in the major class, thereby suppressing the diversity of the data being learned. Recent works further accentuate the fact that re-sampling significantly changes over the empirical distribution of the data, causing a mismatch between the training and testing distributions [ 21 ] . Such a mismatch in distributions might affect the quality of the feature space, even if the classifier boundaries become more balanced. To overcome some of these deficiencies, recent methods aimed to decouple balancing classifier learning from representation learning or used progressive mixing schemes [ 17 ] that used tail class information without vitiating the entire feature space. II-B Class-aware Loss Reweighting In contrast to logit adjustments that adjust the boundary via model output offsets, class-aware loss weighting proposes to reduce class imbalance issues through direct adjustments to the penalty weight of each class during training. The traditional method tends to employ fixed weight schemes inversely proportional to class frequency or using the effective number of examples of each class [ 9 ] , presuming each class’s loss weight should be inversely proportional to its size. However, recent works call this assumption into question by claiming that sample cardinality is a rough guideline that cannot capture the semantic or geometric variations among classes satisfactorily. Chen et al. [ 7 ] demonstrate that tail classes tend to have an even smaller feature volume than head classes and present the Adaptive Diversity-Induced Reweighting (ADIR) method that adjusts the weights of the loss function in accordance with the natural diversity of classes rather than their sample