FAIR-SIGHT: Fairness Assurance in Image Recognition via Simultaneous Conformal Thresholding and Dynamic Output Repair

Arya Fayyazi, Mehdi Kamal, Massoud Pedram · 2025

Read FAIR-SIGHT: Fairness Assurance in Image Recognition via Simultaneous Conformal Thresholding and Dynamic Output Repair by Arya Fayyazi, Mehdi Kamal, Massoud Pedram (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-07395.txt.

Introduction

Arya Fayyazi, Mehdi Kamal, and Massoud Pedram present a post-hoc fairness guard for image recognition in a 2025 study. Their framework scores each prediction for both error risk and fairness violation in one nonconformity measure. Conformal prediction turns that score into a threshold with distribution-free guarantees that hold on finite samples.

When a new image scores above the threshold, a dynamic repair step adjusts the output instead of simply flagging it. Repair keeps the system useful while holding its fairness promise. Because the guard wraps around an existing model, owners can add assurance without retraining the recognizer underneath.

Catalog record

CREATORArya Fayyazi, Mehdi Kamal, Massoud Pedram
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE39 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-07395

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

FAIR-SIGHT: Fairness Assurance in Image Recognition via Simultaneous Conformal Thresholding and Dynamic Output Repair Arya Fayyazi, Mehdi Kamal, Massoud Pedram Abstract We introduce FAIR-SIGHT, an innovative post-hoc framework designed to ensure fairness in computer vision systems by combining conformal prediction with a dynamic output repair mechanism. Our approach calculates a fairness-aware non-conformity score that simultaneously assesses prediction errors and fairness violations. Using conformal prediction, we establish an adaptive threshold that provides rigorous finite-sample, distribution-free guarantees. When the non-conformity score for a new image exceeds the calibrated threshold, FAIR-SIGHT implements targeted corrective adjustments, such as logit shifts for classification and confidence recalibration for detection, to reduce both group and individual fairness disparities—-all without the need for retraining or having access to internal model parameters. Comprehensive theoretical analysis validates our method’s error control and convergence properties. At the same time, extensive empirical evaluations on benchmark datasets show that FAIR-SIGHT significantly reduces fairness disparities while preserving high predictive performance. 1 Introduction Advances in deep learning [ 1 , 7 , 3 ] have propelled computer vision systems to near-human performance in tasks such as object detection, semantic segmentation, and face recognition [ 11 , 26 , 17 ] . As these systems are increasingly integrated into high-stakes applications, from security and autonomous driving to healthcare, the risk of unequal treatment across demographic groups has garnered significant attention [ 20 ] . The early revelations of biases in facial analysis [ 5 ] underscored the potential for serious social harm, prompting a proliferation of research on fairness in vision [ 25 , 14 ] . However, most existing solutions modify model architectures or retrain models with fairness constraints [ 16 , 19 , 12 ] , approaches that are often impractical for proprietary large-scale systems or models that are computationally expensive to retrain. Moreover, static fairness regularizers embedded at training time may fail to adapt as data distributions shift, gradually eroding fairness guarantees. Motivated by these limitations, we present a new perspective on the enforcement of fairness in computer vision (CV), one that requires no retraining or internal parameter access but still offers formal statistical guarantees to limit unfair outcomes. Our approach draws on recent extensions of conformal prediction (CP) [ 21 , 2 , 8 ] , a distribution-free framework that provides guarantees of finite sample coverage under exchangeability assumptions. In previous work, FACTER [ 8 ] demonstrated the viability of CP for fairness in recommendation systems; here, we extend those ideas to high-dimensional vision outputs such as bounding boxes and pixel-level predictions. Our framework, FAIR-SIGHT (Figure 1 ), tackles the dual challenge of (i) maintaining high precision of the vision model and (ii) mitigating biases at both the group level and the individual level. We achieve this by combining CP’s interpretability and statistical coverage properties with an adjustable, task-driven penalty function that quantifies fairness deviations. Crucially, this post hoc strategy (1) takes a black-box model as given, (2) calibrates fairness thresholds on a held-out dataset, and (3) applies real-time repairs (e.g., logit shifts for classification, confidence recalibration for detection) when predictions exceed the calibrated threshold. By adopting a dynamic, data-driven thresholding mechanism, our approach adapts to evolving distributions, thereby addressing the shortcomings of static fairness interventions. Beyond its practical advantages, FAIR-SIGHT establishes formal fairness guarantees by ensuring that the fraction of outputs flagged as unfair can be controlled by a user-specified significance level \alpha ; that is, at most \alpha of future samples are expected to exceed our fairness threshold. This statistical coverage is particularly valuable in complex scenarios—such as object detection or instance segmentation—where standard metrics like IoU or AP must be carefully balanced across protected groups. In this paper, we show how to formalize fairness deficits as non-conformity scores that integrate both predictive error and demographic disparity, calibrate these scores via conformal prediction to yield robust fairness thresholds, and apply dynamic repairs with an adaptive feedback loop such that fairness constraints hold even as data distributions shift. Our experiments indicate that FAIR-SIGHT consistently reduces group-level disparities and enhances individual-level consistency in classification and detection tasks while preserving high accuracy. Images (Protected Attribute) Black-Box CV Model FAIR-SIGHT Post-hoc Repair Fair Output Less Bias & Better Results Figure 1 : High-level overview of proposed workflow. We start with input images (possibly containing a protected attribute), feed them into a black-box computer vision (CV) model, then apply FAIR-SIGHT module as a post-hoc fairness repair. Its output is a fair set of predictions, mitigating bias while preserving accuracy. 2 Preliminaries In this section, we set the stage for our proposed FAIR-SIGHT framework by reviewing advances in fairness-aware computer vision, formalizing core fairness concepts, and laying out the central ideas of conformal prediction. This background contextualizes the methodological details in Section 3 . 2.1 Related Works Fairness in computer vision has garnered increased attention as vision-based systems are increasingly deployed in sensitive areas such as healthcare, surveillance, and autonomous driving. Early studies revealed demographic biases in facial analysis [ 5 ] , driving further investigation into biases across a range of tasks, including object detection, semantic segmentation, and image captioning. Below, we summarize recent contributions that reflect the fast-evolving state of fairness-aware vision research. Recent studies have sought to ensure equitable bounding-box predictions across demographic groups. For instance, Xu et al. [ 27 ] introduced fairness-aware detectors that dynamically align confidence thresholds for protected and non-protected groups, reducing performance gaps in person detection. These methods often require modifying architectures or retraining from scratch, posing challenges for black-box or proprietary models. Much work has also addressed pixel-level tasks. Lee et al. [ 14 ] integrated fairness constraints into semantic segmentation losses, underscoring the tension between enforcing parity in pixel-level predictions and sustaining accuracy. Such approaches frequently embed fairness regularizers during training, limiting post-deployment adaptivity. As data distributions shift over time, static fairness interventions risk losing efficacy. A dynamic threshold adaptation scheme was presented in [ 24 ] that periodically recalibrates decision criteria to maintain demographic parity. Although effective, these methods typically require partial retraining or consistent updates to internal model parameters. Post-hoc fairness modules have emerged as a practical solution to accommodate scenarios where model internals are inaccessible. Dubey et al. [ 6 ] explored external calibration pipelines that wrap around black-box classifiers to adjust skewed outputs. However, these methods often lack finite-sample coverage guarantees, and their fairness improvements can be degraded when data distributions evolve. Conformal prediction (CP) has recently been extended to ensure statistical coverage in complex tasks such as object segmentation and multi-label recognition [ 22 ] . Although CP has long been used to provide classification uncertainty sets, the use of CP for fairness is a more recent development. FACTER [ 8 ] demonstrated how CP-based thresholds can control fairness violation rates in the language-model-driven recommendation. Our Contribution. Despite the advances cited above, a practical gap remains: post-hoc fairness methods that require neither architectural modifications nor retraining often lack rigorous distribution-free guarantees, whereas conformal-based solutions have seldom targeted comprehensive fairness in high-dimensional vision tasks. Building on the insights of dynamic calibration [ 24 ] , external repair modules [ 6 ] , and CP-based coverage [ 22 , 8 ] , our framework unifies these concepts to deliver finite sample fairness guarantees

Read the complete text