BAPE: Learning an Explicit Bayes Classifier for Long-tailed Visual Recognition

Chaoqun Du, Yulin Wang, Shiji Song, Gao Huang, [email protected] · 2025

Read BAPE: Learning an Explicit Bayes Classifier for Long-tailed Visual Recognition by Chaoqun Du, Yulin Wang, Shiji Song, Gao Huang, [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-23280.txt.

Introduction

Chaoqun Du and co-authors learn the best call rule for sight kinds in plain form, to beat the skew of rare kind data, in a paper from 2025. Stock nets learn the rule in hid form through a loss slope, which skew data warps. Their path writes the best rule terms out and solves them point by point.

A shift trick then bends the learnt rule to any test mix at no more cost. Gains stack with past rare kind tricks, since those work the hid path while this works the plain one. Four long tail sets, from toy to vast wild kinds, show wide gains for stock nets.

Catalog record

CREATORChaoqun Du, Yulin Wang, Shiji Song, Gao Huang, [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE38 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-23280

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

BAPE: Learning an Explicit Bayes Classifier for Long-tailed Visual Recognition Chaoqun Du, Yulin Wang, Shiji Song, Gao Huang, [email protected] Abstract Bayesian decision theory advocates the Bayes classifier as the optimal approach for minimizing the risk in machine learning problems. Current deep learning algorithms usually solve for the optimal classifier by implicitly estimating the posterior probabilities, e.g. , by minimizing the Softmax cross-entropy loss. This simple methodology has been proven effective for meticulously balanced academic benchmark datasets. However, it is not applicable to the long-tailed data distributions in the real world, where it leads to the gradient imbalance issue and fails to ensure the Bayes optimal decision rule. To address these challenges, this paper presents a novel approach (BAPE) that provides a more precise theoretical estimation of the data distributions by explicitly modeling the parameters of the posterior probabilities and solving them with point estimation. Consequently, our method directly learns the Bayes classifier without gradient descent based on Bayes’ theorem, simultaneously alleviating the gradient imbalance and ensuring the Bayes optimal decision rule. Furthermore, we propose a straightforward yet effective distribution adjustment technique. This method enables the Bayes classifier trained from the long-tailed training set to effectively adapt to the test data distribution with an arbitrary imbalance factor, thereby enhancing performance without incurring additional computational costs. In addition, we demonstrate the gains of our method are orthogonal to existing learning approaches for long-tailed scenarios, as they are mostly designed under the principle of implicitly estimating the posterior probabilities. Extensive empirical evaluations on CIFAR-10-LT, CIFAR-100-LT, ImageNet-LT, and iNaturalist demonstrate that our method significantly improves the generalization performance of popular deep networks, despite its simplicity. 1 Introduction As grounded in Bayesian decision theory, the Bayes classifier is usually identified as the optimal classifier that minimizes the risk in machine learning tasks vapnik1991principles ; vapnik1999nature ; murphy2012machine . However, the complex and often intractable nature of real data distributions presents significant challenges to the direct computation of the posterior distribution, and hence hinders attaining Bayes-optimal decision-making. In most cases, popular methodologies are designed to implicitly estimate posterior probabilities based on training data. This typically involves the optimization of a Softmax classifier through the application of cross-entropy loss and gradient descent Goodfellow-et-al-2016 ; Krizhevsky2017 ; He2016 ; Huang2017 ; dosovitskiy2021an ; guo2023faceclip ; guo2024smooth ; guo2023zero ; guo2022assessing . This approach has consistently demonstrated its efficacy across a broad range of benchmark datasets deng2012mnist ; krizhevsky2009learning ; Russakovsky2015 . However, real-world application scenarios are generally not as ideal as these academic benchmarks du2024unitta ; du2024switta ; guo2025everything ; du2024probabilistic ; du2024simpro ; huang2022high . As a notable difference, real data often follows a long-tailed distribution, characterized by a significant drop in the number of samples per class from the head (high-frequency classes) to the tail (low-frequency classes) VanHorn2018 . Given such an imbalance, the standard Softmax cross-entropy algorithm suffers from two major issues. Through the lens of optimization, it leads to a minority collapse phenomenon Fang2021 caused by gradient imbalance, i.e. , classifiers for minority classes tend to become closer to each other due to the progressively suppressed gradients as the level of imbalance escalates. From the perspective of Bayesian decision-making, the Bayesian optimal decision rule is usually not ensured Menon2021 . To alleviate these two problems, some methods have been proposed, such as re-sampling Kubat1997 ; Wallace2011 ; Chawla2002 ; Kubat1997 ; buda2018systematic ; byrd2019effect ; mahajan2018exploring ; Kang2020 , re-weighting Huang2016 ; Menon2013 ; Cui2019 ; lin2017focal ; Wang2021b ; wu2020distribution ; Tan2020 , re-margining Cao2019 ; khan2019striking ; cao2020domain and logit adjustment hong2021disentangling ; Menon2021 ; provost2000machine ; wang2022towards ; Ren2020 . However, importantly, they continue to adopt the paradigm that implicitly estimates the posterior distribution. Such implicit estimation is developed and mostly effective for balanced training data. We argue that this design may result in sub-optimal algorithms in the context of realistic long-tailed training data. In this paper, we seek to explore whether a better machine learning algorithm can be acquired under the principle of explicitly modeling the Bayesian decision process. We achieve this by proposing a BAPE approach (BAyes classifier by Point Estimation). In specific, BAPE offers a more precise theoretical estimation of data distribution by explicitly modeling the data distribution and employing point estimation for distribution parameters. As a consequence, it directly learns the Bayes classifier through point estimation without relying on gradient descent, effectively mitigating the issue of gradient imbalance. Furthermore, the Bayes classifier is learned explicitly based on Bayes’ theorem, adhering to the optimal decision rule. Our primary focus lies in explicitly modeling the data distribution and estimating its parameters. However, translating this idea into practice is not straightforward, as the methodologies for modeling real data distributions often involve complexities, such as the necessity of training deep generative models Goodfellow2020 ; SohlDickstein2015 . We propose a more elegant and manageable solution to this challenge. Instead of modeling the data distribution in its original form, we propose to do so in the feature space, which is generally simpler and more tractable. Specifically, inspired by the Simplex-Encoded-Labels Interpolation (SELI) Thrampoulidis2022 that the features tend to collapse towards their corresponding class means in imbalanced learning, we adopt the von Mises-Fisher (vMF) distribution on the unit sphere to model the feature distribution. Building on this vMF distribution assumption, we can estimate the parameters using point estimation method. Crucially, this only requires the first sample moment, which can be efficiently computed across various batches during the training process. Thus, we eliminate the need for gradient descent, making our approach computationally efficient and straightforward. Moreover, a crucial aspect we consider is the disparity in feature distributions between the training and testing set, a phenomenon often arising due to the limited size of available data for estimation. Such discrepancy implies that a Bayes classifier trained on the training set might not deliver optimal performance when applied to the test set. To counter this, leveraging our explicit estimation of data distribution, we can modify the parameters to better align with the test set which exhibits an arbitrary imbalance factor. Notably, our approach incurs no additional computational costs, making it an efficient solution. Empirical results demonstrate that it considerably enhances the performance. The primary contributions of this study are outlined as follows: 1) we propose a novel method for explicitly learning a Bayes classifier using point estimation, which ensures the Bayesian optimal decision rule and alleviates the problem of gradient imbalance; 2) we introduce a straightforward yet effective method to adjust the distribution, which boosts performance without incurring any additional costs; 3) empirical evaluations on image classification tasks with CIFAR-10/100-LT, iNaturalist 2018, and ImageNet-LT demonstrate that the proposed BAPE algorithm consistently improves the generalization performance of existing long-tailed recognition methods. 2 Related Works Re-sampling. The re-sampling methods aim to rectify the uneven distribution of training data by either downsampling the high-frequency classes Kubat1997 ; Wallace2011 or upsampling the low-frequency classes Chawla2002 ; buda2018systematic ; byrd2019effect , thereby facilitating the acquisition of knowledge of the tail classes. Square-root sampling mahajan2018exploring is a modified version of class-balanced sampling, in which the sampling probability for each class is determined by the square root of the sample size within that specific class. Progressively-balanced sampling Kang2020 gradually transitions between random sampling and

Read the complete text