A Generic Framework for Conformal Fairness

Aditya T. Vadlamani, Anutam Srinivasan, Pranav Maneriker, Ali Payani, Srinivasan Parthasarathy · 2025

Read A Generic Framework for Conformal Fairness by Aditya T. Vadlamani, Anutam Srinivasan, Pranav Maneriker, Ali Payani, Srinivasan Parthasarathy (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-16115.txt.

Introduction

Vadlamani and co-authors build a fairness frame for prediction methods that report sets of likely labels in 2025. Such methods promise that the true label sits in the set at a set rate. That promise ignores group gaps: some groups may be covered less. The team defines a fairness notion for these predictors.

Their method controls coverage gaps between sensitive groups. It rests on data swapping rather than the usual same source assumption. That lets it serve graph data and other linked cases. Tests on graph and table data matched the theory. Coverage and fairness both held as designed. The authors offer the frame as a general tool for fair uncertainty reports.

Catalog record

CREATORAditya T. Vadlamani, Anutam Srinivasan, Pranav Maneriker, Ali Payani, Srinivasan Parthasarathy
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE69 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-16115

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Generic Framework for Conformal Fairness Thanks: Equal Contribution, This work was done while the author was a student at The Ohio State University Aditya T. Vadlamani, Anutam Srinivasan, Pranav Maneriker, Ali Payani, Srinivasan Parthasarathy Abstract Conformal Prediction (CP) is a popular method for uncertainty quantification with machine learning models. While conformal prediction provides probabilistic guarantees regarding the coverage of the true label, these guarantees are agnostic to the presence of sensitive attributes within the dataset. In this work, we formalize Conformal Fairness , a notion of fairness using conformal predictors, and provide a theoretically well-founded algorithm and associated framework to control for the gaps in coverage between different sensitive groups. Our framework leverages the exchangeability assumption (implicit to CP) rather than the typical IID assumption, allowing us to apply the notion of Conformal Fairness to data types and tasks that are not IID, such as graph data. Experiments were conducted on graph and tabular datasets to demonstrate that the algorithm can control fairness-related gaps in addition to coverage aligned with theoretical expectations. \MHInternalSyntaxOn \MHInternalSyntaxOff 1 Introduction Machine learning (ML) models are increasingly used to make critical decisions in many fields of human endeavor, making it essential to quantify the uncertainty associated with their predictions. Conformal Prediction (CP) is a distribution-free framework ( Vovk et al. 2005 ) which produces confidence sets with rigorous theoretical guarantees and has become popular in real-world applications ( Cherian & Bronner 2020 ) . Post-hoc CP allows for facile integration into ML pipelines and applies to a wide variety of data types, including graph data ( H. Zargarbashi et al. 2023 ; Huang et al. 2024 ) , because of its weaker requirement of a statistical exchangeability . Relatedly, ensuring the fairness of machine learning models is vital for their high-stakes deployments in critical decision-making. Biases affect ML models at different stages - from data collection to algorithmic learning stages ( Mehrabi et al. 2021 ) . During the data collection stage, measurement and representation biases can skew how each feature is interpreted, leading to inaccurate determinations by learning models. Algorithmic bias, caused by model design choices and prioritization of specific metrics while learning the model, can also lead to unfair outcomes. Many models inherit biases from historical outcomes ( Kallus & Zhou 2018 ; Dwork et al. 2012 ) and inadvertently skew decisions towards members of certain advantaged groups ( Mehrabi et al. 2021 ) . These biases have led to several global actors proposing and requiring practitioners to adhere to certain fairness standards ( Hirsch et al. 2023 ) . To facilitate ML pipeline and model adherence to socio-cultural or regulatory fairness standards, researchers have proposed methods to either construct fair-predictors ( Alghamdi et al. 2022 ; Creager et al. 2019 ; Zhao et al. 2023 ) or audit fairness claims made by deployed machine learning models ( Ghosh et al. 2021 ; Maneriker et al. 2023 ; Yan & Zhang 2022 ) . However, these efforts on fairness (predictors, auditing, and uncertainty quantification) primarily focus on binary classification, often implicitly relying on the independent and identically distributed (IID) assumption, and largely do not bridge fairness and uncertainty quantification. The need to both quantify uncertainty and ensure fairness considerations are met is critical. A few researchers have started to examine how to assess (and possibly improve) the prediction quality of unreliable models ( Wang & Wang 2024 ) while meeting socio-cultural or regulatory standards of fairness. However, these efforts are limited in that they either require knowledge of group membership at inference time (a somewhat impractical assumption) ( Lu et al. 2022 ) or are model-specific ( Wang & Wang 2024 ) . Key Contributions: We propose a novel and comprehensive Conformal Fairness (CF) Framework to redress these concerns. First, we develop the theoretical insights that facilitate how our framework leverages CP’s distribution-free approach to build and construct fair uncertainty sets according to user-specified notions of fairness. Our framework is not only comprehensive but also highly flexible, as it can be adapted to bespoke user-specified fairness criteria. This adaptability ensures that the framework can be customized to meet the specific needs of different users, enhancing its practicality and usability. Second, the weaker (exchangeability) assumptions required by CP allow us to extend the utility of our framework to fairness problems in graph models. Graph models, in particular, suffer from the homophily effect , which exacerbates inherent segregation due to node linkages and causes further biases in predictions ( Current et al. 2022 ; Dong et al. 2023 ; He et al. 2023 ) . Third, we discuss how our approach serves as a fairness auditing tool for conformal predictors. This function is important as it allows one to verify model fairness, ensuring that fairness is not just a theoretical concept but a practical reality in predictive modeling. Finally, we demonstrate the effectiveness of our CF Framework by evaluating fairness using multiple popular fairness metrics for multiple different conformal predictors on both real-world graph and tabular fairness datasets. 2 Background 2.1 Conformal Prediction Conformal Prediction ( Vovk et al. 2005 ) is a framework for quantifying the uncertainty of a model by constructing prediction sets that satisfy a coverage guarantee. For expository simplicity, we will focus on split (or inductive) conformal prediction (CP) in the classification setting. Given a calibration dataset, \mathcal{D_{\mathrm{calib}}}=\{(\bm{x}_{i},y_{i})\}_{i=1}^{n} and a test point (\bm{x}_{n+1},y_{n+1}) , where \bm{x}_{i}\in\mathcal{X}={\mathbb{R}}^{d} and y_{i}\in\mathcal{Y}=\{0,\dots,K-1\} , CP is used to construct a prediction set \mathcal{C}(\bm{x}_{n+1}) such that: \displaystyle 1-\alpha\leq\Pr[y_{n+1}\in\mathcal{C}({\bm{x}}_{n+1})]\leq 1-\alpha+\frac{1}{n+1}, (1) where 1-\alpha\in(0,1) is the coverage bound. Concretely, given a non-conformity score function s:\mathcal{X}\times\mathcal{Y}\to{\mathbb{R}} , let \hat{q}(\alpha)=\text{Quantile}(\frac{\lceil(n+1)(1-\alpha)\rceil}{n};\{s(\bm{x}_{i},y_{i})\}_{i=1}^{n}) be the conformal quantile . Then {\mathcal{C}}_{\hat{q}(\alpha)}(\bm{x}_{n+1})=\{y\in\mathcal{Y}:s(\bm{x}_{n+1},y)\leq\hat{q}(\alpha)\} is a prediction set that satisfies Equation 1 . Evaluating CP : Coverage quantifies the true test time probability \Pr[y_{n+1}\in{\mathcal{C}}_{\hat{q}(\alpha)}(\bm{x}_{n+1})] while efficiency is the average test prediction set size, \lvert{\mathcal{C}}_{\hat{q}(\alpha)}(\bm{x}_{n+1})\rvert . Intuitively, there is an inverse relationship between coverage and efficiency, as a higher desired coverage is harder to achieve, the method may produce larger prediction sets to satisfy the guarantee. In CP, the only assumption made about the data is that \mathcal{D_{\mathrm{calib}}}\cup\{(\bm{x}_{n+1},y_{n+1})\} is exchangeable – a weaker notion than iid, enabling its use on non-iid data, including graph data. Graph CP: In this work, we focus on the node classification task. Given an attributed graph {\mathcal{G}}=({\mathcal{V}},{\mathcal{E}},{\bm{X}}) , where {\mathcal{V}} is the set of nodes, {\mathcal{E}} is the set of edges, and {\bm{X}} is the set of node attributes. Let {\bm{A}} be the adjacency matrix for the graph. Further, let {\mathcal{Y}}=\{0,\dots,K-1\} denote the set of classes associated with the nodes. For v\in{\mathcal{V}} , {\bm{x}}_{v}\in\mathbb{R}^{d} denotes its features and y_{v}\in{\mathcal{Y}} denotes its true class. The task of node classification is to learn a model that predicts the label for each node given all the node features and the adjacency matrix, i.e., ({\bm{X}},{\bm{A}},v)\mapsto y_{v} . In the transductive setting, the entire graph, including test points, is accessible during the base model training. In this scenario, for any trained permutation-equivariant function (e.g., GNN) trained on a set of training/validation nodes, the scores produced on the calibration set and test set are exchangeable, thus enabling CP to be applied ( H. Zargarbashi et al. 2023 ; Huang et al. 2024 ) . 2.2 Fairness Metrics Group (or

Read the complete text