CARE: Class-Adaptive Expert Consensus for Reliable Learning with Long-Tailed Noisy Labels

Mengke Li, Haiquan Ling, Lihao Chen, Yang Lu, Yiqun Zhang, Hui Huang* · 2026

Read CARE: Class-Adaptive Expert Consensus for Reliable Learning with Long-Tailed Noisy Labels by Mengke Li, Haiquan Ling, Lihao Chen, Yang Lu, Yiqun Zhang, Hui Huang* (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-23254.txt.

Introduction

Li and five coauthors propose CARE, a tool for noisy tail labels. Real-world learning suffers from tail spreads plus noisy annotations. Existing methods partly fix these issues but ignore uneven label noise, giving weak tail fixes and over-control for head classes. CARE uses three sources: noisy labels, text vectors, and visual features. It enforces stricter expert agreement for tail classes and looser agreement for head classes. Pooling strong predictions, CARE filters unreliable signals. Tests show CARE beats top methods, with up to 3.0 percent gains.

Catalog record

CREATORMengke Li, Haiquan Ling, Lihao Chen, Yang Lu, Yiqun Zhang, Hui Huang*
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68248
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.23254

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CARE: Class-Adaptive Expert Consensus for Reliable Learning with Long-Tailed Noisy Labels Mengke Li, Haiquan Ling, Lihao Chen, Yang Lu, Yiqun Zhang, Hui Huang* Abstract Learning from real-world data is frequently hindered by the compound challenge of long-tailed class distributions and noisy annotations. Existing methods partially address these issues but typically ignore the non-uniform impact of label noise across classes, resulting in ineffective correction for tail classes and over-regularization for head classes. To address this issue, we propose Class-Adaptive Rectification with Experts (CARE), a parameter-efficient framework that leverages three complementary supervision sources from vision-language models (VLM): observed noisy labels, VLM text embeddings, and visual features. CARE introduces a class-adaptive expert consensus mechanism that enforces stricter agreement for tail classes and more permissive agreement for head classes based on class frequency. By aggregating high-confidence predictions across these sources, CARE filters unreliable signals and recalibrates class distributions, yielding more reliable rectification under long-tailed distributions. Extensive experiments on both synthetic and real-world benchmarks demonstrate that CARE consistently outperforms state-of-the-art methods, achieving up to 3.0% performance gains. The source code is available at https://github.com/qwq123-study/CARE . 1 Introduction Deep learning models rely heavily on large-scale datasets that are not only accurately annotated but also approximately class-balanced to ensure robust generalization ( 50 ) . The rise of large-scale foundation models in recent years has further amplified this demand for high-quality labeled data ( 14 ; 36 ) , as insufficient label quality may introduce unintended prior biases during training. However, such ideal conditions are rarely met in real-world scenarios. Accurate labeling is often prohibitively time-consuming and labor-intensive, while data acquisition pipelines inherently introduce imbalance due to varying collection difficulty across classes ( 13 ; 19 ) . Rare or under-represented categories, often referred to as tail classes, are particularly difficult to collect, leading to extreme data skew ( 68 ) . Consequently, real-world datasets are inherently challenged by the co-occurrence of pervasive annotation errors (noisy labels ( 74 ) ) and extreme class imbalance (long-tailed distributions ( 81 ) ), which synergistically degrade model generalization and severely impair recognition performance, especially on tail classes. When tackled separately, long‑tail learning methods assume clean labels and thus may amplify mislabeling in scarce tail classes, while noisy‑label learning methods assume roughly balanced classes and tend to discard noisy samples, thereby losing valuable information in under‑represented categories ( 78 ) . (a) Ground-truth label distribution (GTLD). (b) Observed label distribution (OLD). (c) RLD 1 by class-agnostic LC. (d) RLD 2 by class-agnostic LC. (e) RLD 3 by class-aware LC. Figure 1: Class-wise label distribution comparison on CIFAR-100. (a) The ground-truth distribution with an imbalance factor of 10. (b) The distribution under 50% joint noise. (c-e) Rectified label distributions (RLDs) obtained by different label correction (LC) methods. To address the practical and pervasive challenge of learning from data with both label noise and long-tailed distributions, the concept of long-tailed noisy label (LTNL) learning has recently been introduced ( 49 ; 79 ) . Several recent studies have explored this joint setting, with some methods incorporating long-tail characteristics into the noise detection process. A common strategy involves first identifying noisy samples, followed by applying long-tailed learning techniques ( 77 ; 79 ) . However, such sequential pipelines critically depend on the performance of the specifically designed noise detectors, which are typically tailored to either noise robustness or long-tailed data, limiting their effectiveness in addressing both issues simultaneously. For example, ( 6 ) propose a Robust Logit Adjustment (RLA), which first corrects the noisy labels and then leverages the refurbished label distribution for logit adjustment, yet still relies on a class-agnostic label correction strategy. Moreover, most existing methods simplify the problem by assuming a uniform noise rate across classes, ignoring the more realistic scenario where tail classes tend to exhibit higher noise levels. ( 49 ) take a more flexible view by considering discrepancies between the observed and intrinsic class distributions, highlighting the need for more flexible and class-aware solutions. Table 1: Acc. (%) comparison across different rectified labels. Lable distribution NR Head Med. Tail All GTLD ( Figure 1a ) 0 86.2 84.9 82.9 84.8 OLD ( Figure 1b ) 50% 79.6 79.9 78.8 79.5 RLD 1 ( Figure 1c ) 24% 80.6 79.7 78.2 79.6 RLD 2 ( Figure 1d ) 25% 77.0 76.5 77.0 76.8 RLD 3 ( Figure 1e ) 28% 81.4 80.9 80.2 80.9 Although class-agnostic label refurbishment methods show promise in reducing overall noise, their effectiveness under long-tailed scenarios is limited and can even degrade performance in certain cases. In particular, we preliminarily adopted the label correction strategy from ( 6 ) , generating two rectified label distributions under different hyperparameters, as illustrated in Figure 1c and Figure 1d . For comparison, we also present the ground-truth label distribution, the initial 50% joint noise distribution, and the CARE-refined class-aware label distribution in Figure 1a , Figure 1b , and Figure 1e , respectively. Fine-tuning CLIP with these three types of noisy-labeled data yields the results shown in Table 1 . Despite achieving similar overall noise rates and significantly reducing label noise compared to the original noisy labels, the results reveal that insufficient correction of tail-class labels (e.g., Figure 1c ) yields limited performance gains (79.6% vs. 79.5% ), or even leads to degradation, as seen in Figure 1d vs. Figure 1b (total accuracy 76.8% vs. 79.5%). The decline stems from inaccurate regularization introduced during long-tailed learning. This observation shows that merely lowering the noise ratio is not sufficient, and class-aware rectification is essential. In contrast, by emphasizing accurate tail label correction, RLD 3 (shown in Figure 1e ) ensures that the strong calibration induced by tail classes is meaningful, while the weaker regularization from uncorrected head labels avoids over-regularization and/or over-calibration. This class-aware strategy leads to more balanced supervision and improves overall robustness. To this end, we propose a novel framework named Class-Adaptive Rectification with Experts (CARE) for robust learning under long-tailed noisy label (LTNL) settings. CARE leverages three complementary sources of information, namely, observed labels, Vision-Language Model (VLM)-based text embeddings, and VLM-based image features, to derive class-adaptive expert consensus for robust label rectification. Without introducing additional parameters, CARE identifies low-noise candidates through adaptive class-wise Top- K voting, where larger K values are used for head classes and smaller K for tail classes to reflect their respective data abundances and reduce confirmation bias in underrepresented categories. The expert-consensus semantics are then dynamically integrated into class frequency estimation, while low-confidence predictions are filtered through a strict hierarchical filtering mechanism that enforces consistency across classes. This enables CARE to produce reliable label distributions and perform effective noise correction. Our main contributions are summarized as follows: 1) We identify that ignoring tail label noise, while significantly reducing overall noise rate, fails to improve overall performance under long-tailed distributions. 2) We propose a parameter-free CARE framework that unifies noisy label correction and long-tailed calibration for improved generalization. 3) We design a class-aware consensus mechanism that dynamically adjusts correction confidence based on class frequency and inter-expert agreement. 4) Extensive experiments on both synthetic and real-world LTNL benchmarks demonstrate that CARE consistently outperforms state-of-the-art methods under various noise and imbalance settings. 2 Proposed Method 2.1 Preliminaries Basic Notations. Given a C -class classification

Read the complete text