Preserving AUC Fairness in Learning with Noisy Protected Groups
Mingyang Wu, Li Lin, Wenbin Zhang, Xin Wang, Zhenhuan Yang, Shu Hu · 2025
Read Preserving AUC Fairness in Learning with Noisy Protected Groups by Mingyang Wu, Li Lin, Wenbin Zhang, Xin Wang, Zhenhuan Yang, Shu Hu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18532.txt.
Introduction
Mingyang Wu and co-authors worked in 2025 on keeping a fairness measure honest when the group labels used to check it are noisy. The measure, based on ranking quality, matters most where classes are lopsided, such as medical scans. Most fairness tools assume the race or sex labels in the data are clean, which real data often breaks.
Their method is the first to guard this fairness score under label noise with proof behind it, built on training that plans for the worst plausible data shift. Tests on table and image data beat the leading rivals at holding fairness steady. The team shares its code in public. They argue that fairness work must face messy labels head-on, since quiet violations grow where checks assume clean data.
Catalog record
| CREATOR | Mingyang Wu, Li Lin, Wenbin Zhang, Xin Wang, Zhenhuan Yang, Shu Hu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 76 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-18532
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Preserving AUC Fairness in Learning with Noisy Protected Groups Mingyang Wu, Li Lin, Wenbin Zhang, Xin Wang, Zhenhuan Yang, Shu Hu Abstract The Area Under the ROC Curve (AUC) is a key metric for classification, especially under class imbalance, with growing research focus on optimizing AUC over accuracy in applications like medical image analysis and deepfake detection. This leads to fairness in AUC optimization becoming crucial as biases can impact protected groups. While various fairness mitigation techniques exist, fairness considerations in AUC optimization remain in their early stages, with most research focusing on improving AUC fairness under the assumption of clean protected groups. However, these studies often overlook the impact of noisy protected groups, leading to fairness violations in practice. To address this, we propose the first robust AUC fairness approach under noisy protected groups with fairness theoretical guarantees using distributionally robust optimization. Extensive experiments on tabular and image datasets show that our method outperforms state-of-the-art approaches in preserving AUC fairness. The code is in https://github.com/Purdue-M2/AUC_Fairness_with_Noisy_Groups . † † affiliationnotice: Equal contribution 1 Introduction The Area Under the ROC Curve (AUC) ( Hanley & McNeil 1982 ) is one of the most widely used performance metrics in classification tasks, particularly when addressing challenges such as class imbalance or uncertain relative costs of false positives and false negatives. It provides a measure of a classifier’s ability to distinguish between classes across all possible decision thresholds, making it especially relevant in domains like information retrieval ( Cortes & Mohri 2003 ) , medical image analysis ( Yuan et al. 2021 ) , and deepfake detection ( Pu et al. 2022 ) . In particular, in deepfake detection, misclassifying fake content as real can lead to the widespread dissemination of misinformation, potentially undermining public trust, manipulating discourse, or enabling fraud. AUC is thus preferred over fixed-threshold metrics, as it captures model performance comprehensively across varying operational settings. This has motivated numerous studies ( Yang 2021 ; Kumagai et al. ; Guo et al. 2022 ; Zhang et al. 2023 ) focusing on training AI models to maximize AUC rather than relying on traditional loss functions ( e.g. , cross-entropy loss), as this approach directly optimizes a metric better aligned with the desired application outcomes. By doing so, models achieve improved performance in scenarios where distinguishing between classes with high sensitivity and specificity is essential. The optimization of AUC in machine learning models necessitates a focus on fairness, particularly in light of growing concerns that algorithmic decisions often exacerbate inequities faced by vulnerable groups defined by sensitive attributes such as gender and race, also known as protected groups . Recent studies ( Caton & Haas 2024 ; Kenfack et al. 2024 ) have highlighted how machine learning models, if left unchecked, can perpetuate or worsen biases in allocation decisions, leading to unfavorable outcomes for these groups. To address this, a range of bias mitigation techniques ( Hu & Chen 2024 ; Lin et al. 2024 ; Tian et al. 2025 ; Kollias et al. 2024 ; Ju et al. 2024 ) has been developed, including methods that focus on statistical fairness metrics derived from confusion matrices. However, fairness considerations in AUC optimization ( Yang et al. 2023 ; Yao et al. 2023 ) remain an early stage of exploration despite its significance in many applications and most of them focus on the group-level AUC fairness. Figure 1: Illustrative inter-/intra-group AUC dicrepancy examples of existing MinimaxFairAUC method ( Yang et al. 2023 ) (dashed curves) and our method (solid curves) on Default ( Yeh & Lien 2009 ) dataset with noisy levels 0 and 0.3, respectively. Notations are defined in Section 4 . In general, our method is better than MinimaxFairAUC in preserving AUC fairness, demonstrating robustness to noisy groups. The group-level fairness for AUC leads to three categories of metrics, each addressing different aspects of disparate impacts. First, intra-group AUC ( Beutel et al. 2019 ; Yao et al. 2023 ) focuses constraining both positive and negative examples to the same group. Second, inter-group AUC ( Beutel et al. 2019 ; Kallus & Zhou 2019 ; Yao et al. 2023 ) considers ranking fairness between groups, evaluating the metric by comparing positive examples from one group to negative examples from another. Lastly, a few works ( Yang et al. 2023 ; Yao et al. 2023 ) have sought to considering both intra-group and inter-group AUC fairness during the learning process. Nevertheless, existing AUC fairness studies often overlook the reliability of protected group information. This raises a crucial question: Can AUC fairness notions be accurately measured or effectively enforced when the protected group data is noisy or unreliable? Noisy protected group labels are prevalent in many scenarios. For instance, survey participants may intentionally obfuscate their responses due to concerns about privacy, fear of disclosure, or potential discrimination, leading to response biases ( Krumpal 2013 ) . Similarly, in deepfake datasets, demographic annotations are often inferred using deep learning models ( Lin et al. 2025 ) . However, the accuracy of these annotations is inherently limited, as the true demographic information cannot be verified or tracked when the faces are AI-generated. Our practical evaluation (see Fig. 1 ) reveals that training with traditional AUC fairness under noisy protected group labels can result in significant group AUC gap in model deployment. This highlights the critical need for designing a robust approach to ensure reliable AUC fairness. In this work, we propose the first robust AUC fairness approach for learning under noisy protected groups, providing theoretical fairness guarantees. We begin by conducting experiments to illustrate the adverse effects of noisy protected group labels on existing AUC fairness methods. Next, we introduce a novel and general AUC fairness metric that accounts for both intra-group and inter-group AUC. Based on this metric, we formulate a new learning objective for AUC fairness using a distributionally robust optimization (DRO) framework ( Duchi & Namkoong 2021 ) , which bounds the Total Variation (TV) distance between clean and noisy group distributions. We also provide a theoretical analysis demonstrating that our approach ensures fairness even under noisy protected group labels. To estimate the TV distance bound, we reformulate it in terms of noisy label ratios and propose an empirical estimation method leveraging pre-trained multi-modal foundation models. Finally, we design an efficient stochastic gradient descent-ascent (SGDA) algorithm to optimize the proposed learning objective, enhancing both AUC fairness and the model’s generalization capabilities in deployment scenarios. Our key contributions are: 1. We present the first experimental analysis of the impact of noisy protected group labels on the existing AUC fairness learning method. 2. We introduce a novel AUC fairness metric and propose the first approach to preserve AUC fairness under noisy protected groups with theoretical guarantees. 3. Extensive experiments on tabular and image datasets show that our method surpasses state-of-the-art approaches across applications like socioeconomic analysis and deepfake detection. 2 Related Work AUC-based Fairness . A pioneering effort by Dixon et al. 2018 introduced the Pinned AUC metric for text classification tasks, which involves resampling the data so that each of the two groups constitutes half of the dataset, followed by calculating the AUC difference on the resampled data. Building on this foundation, Beutel et al.