EDGE: Unknown-aware Multi-label Learning by Energy Distribution Gap Expansion

Yuchen Sun, Qianqian Xu, Zitai Wang, Zhiyong Yang, Junwei He · 2024

Read EDGE: Unknown-aware Multi-label Learning by Energy Distribution Gap Expansion by Yuchen Sun, Qianqian Xu, Zitai Wang, Zhiyong Yang, Junwei He (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-07499.txt.

Introduction

Sun and co-authors sharpen a safety sense for image classifiers that juggle many labels at once: is this input from the known world, or something foreign? In multi-label settings, foreign inputs hide unevenly — samples belonging only to rare classes get flagged as foreign when they are legitimate, because the energy score blurs their signal. Shifting the decision rules designed for ordinary training data makes things worse, the authors show.

Their framework, EDGE, trains with auxiliary foreign examples and reshapes the energy landscape. It lifts rare-class insiders' scores while pushing outsiders down, widening the gap, and picks its teaching examples for informativeness. Across multi-label and out-of-distribution data sets, the method beat the alternatives. For vision systems — medical, industrial, or on the road — the gain matters where errors concentrate: the rare cases a system sees least and must not misjudge.

Catalog record

CREATORYuchen Sun, Qianqian Xu, Zitai Wang, Zhiyong Yang, Junwei He
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-07499

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

EDGE: Unknown-aware Multi-label Learning by Energy Distribution Gap Expansion Yuchen Sun, Qianqian Xu, Zitai Wang, Zhiyong Yang, Junwei He Abstract Multi-label Out-Of-Distribution (OOD) detection aims to discriminate the OOD samples from the multi-label In-Distribution (ID) ones. Compared with its multiclass counterpart, it is crucial to model the joint information among classes. To this end, JointEnergy, which is a representative multi-label OOD inference criterion, summarizes the logits of all the classes. However, we find that JointEnergy can produce an imbalance problem in OOD detection, especially when the model lacks enough discrimination ability. Specifically, we find that the samples only related to minority classes tend to be classified as OOD samples due to the ambiguous energy decision boundary. Besides, imbalanced multi-label learning methods, originally designed for ID ones, would not be suitable for OOD detection scenarios, even producing a serious negative transfer effect. In this paper, we resort to auxiliary outlier exposure (OE) and propose an unknown-aware multi-label learning framework to reshape the uncertainty energy space layout. In this framework, the energy score is separately optimized for tail ID samples and unknown samples, and the energy distribution gap between them is expanded, such that the tail ID samples can have a significantly larger energy score than the OOD ones. What’s more, a simple yet effective measure is designed to select more informative OE datasets. Finally, comprehensive experimental results on multiple multi-label and OOD datasets reveal the effectiveness of the proposed method. 1 Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, CAS, Beijing, China 2 School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing, China {sunyuchen22s, xuqianqian, wangzitai}@ict.ac.cn, [email protected], [email protected] (a) Distribution of baseline (b) Distribution of EDGE (c) FPR95 comparison result (d) AUROC comparison result Figure 1: Distribution and performance results with Binary Cross-Entropy loss (BCE) training loss and our framework on Places50 dataset. (a) shows the small gap between known and unknown domains under basic multi-label models, and (b) indicates the improvement of our method. The last two figures show the (c) FPR95 and (d) AUROC imbalanced and balanced results on different in-distribution subsets, where the proportion of in-distribution samples that only relate to minority classes increases with the x-axis value increases. Introduction Traditional classification methods mainly focus on In-Distribution (ID) scenarios, where the training set and the test set share the same data distribution. However, in practical applications, it is unavoidable that some test samples are Out Of the Distribution (OOD) of the training ones ( Yang et al. 2021 ) . In this case, an ID model will classify the OOD samples into one of the ID classes due to the notorious overconfidence issue. Such wrong predictions seriously degenerate the model performance. Given this, OOD detection has attracted rising attention in recent years, intending to discriminate the OOD samples from the ID ones ( Huang and Li 2021 ; Wang et al. 2022c ; Djurisic et al. 2023 ) In this direction, most prior art focuses on scenarios where the ID samples only have a single ground-truth label. Nevertheless, samples are inherently associated with multiple labels in many real-world applications such as autonomous driving ( Mao et al. 2023 ) and medical image ( Zhou et al. 2023 ) . For multi-label OOD detection, one intuitive strategy is to adapt the off-the-shelf multiclass algorithms ( Du et al. 2022 ; Wang et al. 2022b ) . However, Wang et al. ( Wang et al. 2021 ) , pioneered in multi-label OOD detection, point out that simply using the largest model output ( i.e. , MaxLogit ( Hendrycks et al. 2022 ) , Max) might be sub-optimal. Considering this, it is crucial to jointly model the information across different labels for multi-label tasks. To fix this issue, they suggest summing the energy score of all labels as the inference criteria (dubbed JointEnergy), where the energy score is proportional to the logit. Although JointEnergy is effective for OOD inference, we are surprised to find that it induces a new imbalanced problem. As shown in Figure 1 (a), the energy gap between ID samples and OOD samples is relatively small, especially for the tail ID samples. Notably, in multi-label learning, tail samples refer to instances whose relevant classes are all minority ones. In contrast, head samples are relevant to at least one majority class, where minority/majority indicates the class is associated with many/few samples, respectively. The intuition behind this problem is that traditional multi-label optimization methods (like binary cross-entropy loss) treat each class of samples equally while somewhat ignoring the focus on minority classes. Consequently, head samples tend to have large logits and thus are more likely to be recognized as ID samples. By contrast, some hard samples generally have low logits and are misclassified as OOD ones. Due to such a distribution overlap, the OOD performance degenerates and becomes significantly imbalanced across head samples and tail samples. As the blue line shown in Figure 1 (c) & (d), we rank the classes according to the number of associated samples from largest to smallest. When the x-axis values increase, we remove all samples that are associated with the corresponding head categories and observe an obvious degradation in the FPR95 and AUROC for the remaining samples. To tackle this challenge, we propose a simple yet effective unknown-aware multi-label learning framework named E nergy D istribution G ap E xpansion (EDGE) . Specifically, this method could be divided into three parts. Firstly, we enhance the generalization of models by learning known distribution. Then, we adopt the Outlier Exposure (OE) strategy, i.e. , introducing auxiliary OOD data, to lower the logit of OOD samples and separate them from known classes. However, merely optimizing distribution space from the perspective of logit might suffer from a trivial solution. Thus thirdly, we further expand the positive energy gap between tail ID and OOD samples to establish a reliable energy boundary (see Figure 1 (b)). Compared with post-hoc methods, this framework could achieve a balanced performance, as the orange line shown in Figure 1 (c) & (d). To sum up, the whole learning framework is shown in Figure 2 , and the main contributions of this paper are three-fold: • To the best of our knowledge, we are the pioneer in discovering the induced imbalance issue existing in the energy-based method for multi-label OOD detection. • A novel unknown-aware multi-label learning framework EDGE is proposed to reshape the uncertainty energy space of ID and OOD data, as well as a feature-based pre-processing module to guide informative outlier exposure data selection. • We conduct comprehensive experiments on three large-scale real-world datasets and various OOD datasets, where the test results consistently show the superiority of the EDGE framework. Related Work Multi-label Classification Multi-label classification (MLC) focuses on the instances simultaneously assigned with multiple labels ( Wang et al. 2024 ; Liu et al. 2022 ; Huang et al. 2020 ) . This topic mainly falls into two categories: problem transformation and algorithm adaptation . For the former, most studies tend to simplify MLC into multi-class problems ( Jernite, Choromanska, and Sontag 2017 ; Wallach et al. 2019 ) . In contrast, algorithm adaptation leverages traditional machine-learning methods to model data ( Gong et al. 2014

Read the complete text