FairSAM: Fair Classification on Corrupted Image Data Through Sharpness-Aware Minimization

Yucong Dai [email protected], Jie Ji [email protected], Xiaolong Ma [email protected], Yongkai Wu [email protected] · 2025

Read FairSAM: Fair Classification on Corrupted Image Data Through Sharpness-Aware Minimization by Yucong Dai [email protected], Jie Ji [email protected], Xiaolong Ma [email protected], Yongkai Wu [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-22934.txt.

Introduction

Yucong Dai and co-authors tackle a double failure of image classifiers: dirty inputs hurt accuracy, and they hurt some demographic groups more than others. Noise and weather corruption at deployment can quietly widen bias. Methods that harden models overall do not close the group gap, and fairness methods wilt under corruption.

Their approach, FairSAM, builds on sharpness-aware minimization, which seeks flat, robust solutions. They add a metric for how much each subgroup's performance degrades under corruption, and train against it. The goal is accuracy that is both sturdy and even-handed when the camera feed degrades. Self-driving and surveillance systems, where corruption is routine, need exactly that pairing.

Catalog record

CREATORYucong Dai [email protected], Jie Ji [email protected], Xiaolong Ma [email protected], Yongkai Wu [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-22934

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FairSAM: Fair Classification on Corrupted Image Data Through Sharpness-Aware Minimization Yucong Dai [email protected], Jie Ji [email protected], Xiaolong Ma [email protected], Yongkai Wu [email protected] Abstract Image classification models trained on clean data often degrade sharply when exposed to corrupted test or deployment data, such as images with impulse noise, Gaussian noise, or environmental noise. This degradation reduces overall performance and disproportionately affects demographic subgroups, raising algorithmic bias concerns. Although robust learning algorithms such as Sharpness-Aware Minimization improve overall robustness and generalization, they do not address biased performance degradation across demographic subgroups. Existing fairness-aware machine learning methods reduce performance disparities but struggle to maintain robust and equitable accuracy across demographic subgroups under data corruption. This limitation reveals an inherent tension between robustness and fairness under corrupted data. To address these challenges, we introduce a metric to assess performance degradation across subgroups under data corruption. We propose FairSAM , a framework that integrates Fair ness-oriented strategies into SAM to equalize performance across demographic groups under corrupted conditions. Experiments on multiple real-world datasets and prediction tasks show that FairSAM balances robustness and fairness in corrupted image classification. The framework yields a structured solution for fair and robust image classification in the presence of data corruption. Reviewed on OpenReview: https://openreview.net/forum?id=W2QKvn57yw 1 Introduction Deep neural networks have achieved strong results in AI applications such as image classification, image segmentation, and object detection. However, corrupted data challenge deep neural networks in real-world applications. In this paper, we focus on image classification tasks that encounter corrupted data from diverse sources, including user-uploaded images, mobile device captures, and network transmission artifacts. We investigate unequal model degradation when models trained on clean data are applied to corrupted images affected by impulse noise, Gaussian noise, weather effects (e.g., snow, fog), and motion blur during capture or transfer. Recent work ( Nanda et al., 2021 ) shows that this degradation disproportionately affects demographic subgroups, i.e., accuracy drops vary significantly across subgroups and raise algorithmic bias concerns. Thus, applying models trained on clean data to corrupted images can create or amplify algorithmic bias. Although various fairness-aware methods, such as fairness constraints ( Calders & Verwer, 2010 ; Kamiran et al., 2010 ; Corbett-Davies et al., 2017 ; Zafar et al., 2017b ) and reweighing strategies ( Calders et al., 2009 ) , have been proposed to address bias in machine learning models, they often fail to mitigate unequal accuracy degradation across subgroups and neglect broader robustness requirements. Recent research frames corrupted-data classification as a robustness and generalization challenge as the model must maintain performance under noise perturbations that differ from the training distribution. Sharpness-Aware Minimization (SAM) ( Foret et al., 2021 ) has emerged as an effective robustness approach by promoting “flat” minima in the loss landscape, where loss changes gradually with parameter variation. This property improves generalization and resilience to data corruption. However, while SAM improves aggregate robustness, it does not inherently address fairness across demographic subgroups. SAM’s performance gains are often unevenly distributed, and some disadvantaged subgroups remain more susceptible to accuracy degradation. This disparity highlights a critical limitation of SAM in scenarios where both robustness and fairness are equally essential. To address these inherent challenges, we first formulate the fair classification problem in the context of corrupted data. Specifically, we study a setting where a model is trained on clean data and tested on corrupted data containing various types of noise. We restrict the current scope to binary sensitive attributes, where each sensitive attribute partitions samples into advantaged and disadvantaged groups. This setting reflects real deployments where training data are carefully curated but trained models face unexpected corrupted data in the wild. We then evaluate model performance and assess performance degradation across demographic subgroups, such as age (young/non-young) and gender (female/male), to understand both robustness and fairness under corrupted conditions. We introduce a metric to quantify fairness in performance degradation under corruption. This metric differs from one-shot fairness notions that require equal robustness across population partitions under imperceptible input perturbations. The metric, Corrupted Degradation Disparity , captures the difference in accuracy degradation (i.e., the drop in accuracy between clean and corrupted data) between specific subgroups, such as young and non-young individuals. Based on this metric, we propose FairSAM , the first framework that incorporates fairness-oriented strategies into SAM. Specifically, we develop instance-reweighted SAM and approximate per-sample perturbations with a per-batch perturbation algorithm to promote fairness and robustness simultaneously. FairSAM distributes robustness improvements equitably across demographic subgroups. It addresses fairness concerns while maintaining high overall accuracy under corrupted conditions. We conduct experiments on multiple real-world datasets, including imbalanced CelebA and balanced FairFace, across prediction tasks with different target and sensitive attributes. These experiments evaluate FairSAM and baselines in terms of both robustness and fairness. The results show that FairSAM addresses the tension between robustness and fairness. FairSAM attains lower values on Corrupted Degradation Disparity , where lower is better. Our contributions are as follows: 1) We identify and formalize the robustness bias challenge in image classification under data corruption and introduce Corrupted Degradation Disparity to evaluate performance degradation fairness across demographic subgroups. 2) We introduce FairSAM , a novel framework that integrates SAM with fairness-enhancing strategies to achieve both robustness and fairness in corrupted image classification tasks. 3) We validate FairSAM on multiple datasets and configurations, where it consistently improves accuracy and fairness compared with various baselines. 2 Related Work 2.1 Fairness in Machine Learning Algorithmic fairness has become a central topic in machine learning as researchers increasingly recognize biases that disproportionately affect marginalized groups based on demographic factors such as gender, race, or age. In image classification, these biases can appear as unequal performance across subgroups, especially under challenging conditions such as image corruption. Despite its importance, fairness in the presence of image corruption remains an underexplored area. This gap matters because machine learning models deployed in real-world environments frequently encounter corrupted data, which can amplify existing inequalities by disproportionately affecting certain demographic groups. Existing research on fair machine learning focuses primarily on two objectives: (1) defining and identifying bias in machine learning models and (2) developing algorithms to effectively mitigate bias. Various fairness definitions have been proposed, with statistical parity being one of the most widely recognized. Statistical parity ensures that the likelihood of favorable outcomes remains similar across protected and non-protected groups. This can be quantified through metrics like risk difference , risk ratio , relative change , and odds ratio ( Žliobaite, 2017 ) . These metrics quantify fairness and support comparisons of bias in model predictions. Bias mitigation strategies fall into three main categories: pre-processing, in-processing, and post-processing methods. Pre-processing techniques modify the training data to remove potential biases before model training. Examples include Massaging ( Kamiran & Calders, 2009 ) , reweighing ( Calders et al., 2009 ) , and Preferential Sampling ( Kamiran & Calders, 2012 ) , which adjust data distributions to promote fairness. In contrast, in-processing methods ( Calders & Verwer, 2010 ; Corbett-Davies et al., 2017 ; Kamiran et al., 2010 ; Zafar et al., 2017b ; Wu et al., 2019 ; Dai et al., 2024 ; Jiang et al., 2023 ) introduce fairness constraints or regularization terms directly into the model objective so the learning algorithm optimizes fairness alongside accuracy. Finally,

Read the complete text