Achieving Distributive Justice in Federated Learning via Uncertainty Quantification

Alycia N. Carey, Xintao Wu · 2025

Read Achieving Distributive Justice in Federated Learning via Uncertainty Quantification by Alycia N. Carey, Xintao Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-15924.txt.

Introduction

Alycia Carey and Xintao Wu bring theories of justice into the math of federated learning. In federated learning, many clients train one model together, and fairness can mean equal results, or results matched to contribution. Practitioners pick a notion with little guidance, the authors note.

Their framework, UDJ-FL, weights clients by the noise inherent in their data and borrows rules from fair resource division. One set of dials then reaches four justice standards: strict equality, greatest total good, priority to the worst-off, and reward for desert. Tests show the framework matching or beating specialist fair methods at their own games. The paper also proves error bounds and explains why the uncertainty weighting is load-bearing.

Catalog record

CREATORAlycia N. Carey, Xintao Wu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE79 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-15924

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Achieving Distributive Justice in Federated Learning via Uncertainty Quantification Alycia N. Carey, Xintao Wu Abstract . Client-level fairness metrics for federated learning are used to ensure that all clients in a federation either: a) have similar final performance on their local data distributions (i.e., client parity ), or b) obtain final performance on their local data distributions relative to their contribution to the federated learning process (i.e., contribution fairness ). While a handful of works that propose either client-parity or contribution-based fairness metrics ground their definitions and decisions in social theories of equality – such as distributive justice – most works arbitrarily choose what notion of fairness to align with which makes it difficult for practitioners to choose which fairness metric aligns best with their fairness ethics. In this work, we propose UDJ-FL ( Uncertainty-based Distributive Justice for Federated Learning ), a flexible federated learning framework that can achieve multiple distributive justice-based client-level fairness metrics. Namely, by utilizing techniques inspired by fair resource allocation, in conjunction with performing aleatoric uncertainty-based client weighing, our UDJ-FL framework is able to achieve egalitarian, utilitarian, Rawls’ difference principle, or desert-based client-level fairness. We empirically show the ability of UDJ-FL to achieve all four defined distributive justice-based client-level fairness metrics in addition to providing fairness equivalent to (or surpassing) other popular fair federated learning works. Further, we provide justification for why aleatoric uncertainty weighing is necessary to the construction of our UDJ-FL framework as well as derive theoretical guarantees for the generalization bounds of UDJ-FL. Our code is publicly available at https://github.com/alycia-noel/UDJ-FL . DOI: XXXXXXX.XXXXXXX Conference: ACM Conference on Fairness, Accountability, and Transparency; June 23-26, 2025; Athens, Greece ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Computing methodologies Machine learning CCS: Computing methodologies Distributed computing methodologies CCS: Information systems Data mining CCS: Mathematics of computing Probabilistic inference problems CCS: Human-centered computing CCS: Computing methodologies Probabilistic reasoning 1. Introduction Federated learning (FL) is a machine learning paradigm that facilitates the joint training of a machine learning model by multiple parties (e.g., mobile devices, organizations, or individuals) under the organization of a central server without the parties explicitly having to share their private local data ( McMahan et al., 2017 ) . Due to its potential for solving challenges in domains such as IoT ( Nguyen et al., 2021 ) and healthcare ( Xu et al., 2021 ) , federated learning research has received significant interest especially in the areas of efficiency, privacy, and fairness ( Kairouz et al., 2021 ) . There are two main types of fairness explored in federated learning: client-level fairness and demographic fairness. Client-level fairness criteria are concerned with fairly distributing the performance of the global model across the clients whereas demographic fairness criteria are concerned with ensuring that traditional machine learning fairness definitions such as demographic parity or equalized odds. In this work, we focus our attention on client-level fairness. As with traditional machine learning, multiple definitions of client-level fairness for federated learning have been proposed. Some works say that all clients should achieve similar final accuracies (often referred to as client parity ) ( Li et al., 2019 ) . On the other hand, some works say that it is unfair for clients with low quality data to achieve the same final accuracy as clients with high-quality data ( Donahue and Kleinberg, 2023 ; Chu et al., 2022 ; Ray Chaudhury et al., 2022 ; Lyu et al., 2020 ) and propose that clients should receive final performance relative to their contribution to the overall federated learning process (termed contribution fairness ). Most of these proposed works, however, only vaguely discuss the philosophical underpinnings of their chosen fairness definition, which makes it difficult for practitioners to choose the fairness metric that aligns best with their fairness ethics. Additionally, most of the proposed methods are nonflexible, and only provide solutions for one, or infrequently two, client-level fairness definitions. In this work, in addition to grounding all of our proposed client-level fairness definitions in the social psychology theory of distributive justice, we provide a flexible framework that allows practitioners to switch between the fairness definitions without requiring them to significantly alter the federated training routine. Distributing final model performance in relation to some chosen fairness criteria is perfectly encapsulated by the framework of distributive justice from social psychology. In this work, we focus on four major thought theories of distributive justice that align well with the federated learning setting: strict egalitarianism , desert , Rawls’ difference principle , and utilitarianism . Strict egalitarianism is the concept of fairness where every person in a society receives the same level of material goods or services ( Lamont and Favor, 2017 ) . In federated learning, we relax strict egalitarianism to simple egalitarianism and it is often seen as models that aim to achieve parity in the final performance of each client 1 1 1 This relaxation is due to it being infeasible to ensure equal final model performance across the clients as each client has differing local data distributions and the probabilistic nature of machine learning. . Desert-based fairness is the concept that material goods and services should be distributed according to the effort or contribution one gives to a defined goal in society ( Lamont and Favor, 2017 ) . For federated learning, desert-based fairness could be achieved by ensuring higher performance for clients who contribute higher-quality data or those that participate in more rounds of training. Rawls’ difference principle states that the only allowable difference in distributing material goods and services are those that help the least advanced in society ( Lamont and Favor, 2017 ) . This can be seen in the federated setting as ensuring good performance for clients with low quality data or poor performing local models. Finally, utilitarianism requires that goods and services are distributed to maximize overall well being in society ( Lamont and Favor, 2017 ) , and this can be seen in the federated learning setting as maximizing the overall average performance. While theoretically simple to understand, implementing distributive justice within federated learning is a non-trivial task. And even though the federated learning research community has begun to utilize techniques such as resource allocation (which can be neatly tied to distributive justice ( Lan et al., 2010 ) ) to ensure fair distributions of resources and/or final model performance ( Li et al., 2019 ; Zhang et al., 2022 ) , it is still difficult to determine which client is the least advantaged or how to define client contribution. In this work, we show that a client’s aleatoric uncertainty – the uncertainty relating to their local data distribution – can be used to both specify the advantage level of the client and as a pragmatic value of client contribution. In this work, we propose UDJ-FL ( Uncertainty-based Distributive Justice for Federated Learning ), a novel federated learning objective that is grounded in distributive justice and utilizes uncertainty quantification-based client weighing. Borrowing ideas from the axiomatic approach to resource allocation ( Lan et al., 2010 ) , as well as techniques for measuring the aleatoric uncertainty of a client’s local dataset ( Mukhoti et al., 2023 ) , we construct UDJ-FL such that it can achieve all four notions of distributive

Read the complete text