Fairness under uncertainty in sequential decisions \conffull ( \confshort ), \confdate , \confloc Conference: The 2026 ACM Conference on Fairness, Accountability, and Transparency; June 25–28, 2026; Montreal, QC, Canada The 2026 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’26), June 25–28, 2026, Montreal, QC, Canada DOI: 10.1145/3805689.3812272 ISBN: XXXXX ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Theory of computation Online learning algorithms CCS: Computing methodologies Sequential decision making CCS: Computing methodologies Batch learning CCS: Computing methodologies Online learning settings CCS: Computing methodologies Learning from implicit feedback CCS: Social and professional topics User characteristics CCS: Information systems Uncertainty CCS: Computing methodologies Planning under uncertainty CCS: Computing methodologies Uncertainty quantification CCS: Applied computing Business intelligence CCS: Applied computing Multi-criterion optimization and decision-making
Michelle Seng Ah Lee, Kirtan Padh, David Watson, Niki Kilbertus, Jatinder Singh · 2026
Read Fairness under uncertainty in sequential decisions \conffull ( \confshort ), \confdate , \confloc Conference: The 2026 ACM Conference on Fairness, Accountability, and Transparency; June 25–28, 2026; Montreal, QC, Canada The 2026 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’26), June 25–28, 2026, Montreal, QC, Canada DOI: 10.1145/3805689.3812272 ISBN: XXXXX ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Theory of computation Online learning algorithms CCS: Computing methodologies Sequential decision making CCS: Computing methodologies Batch learning CCS: Computing methodologies Online learning settings CCS: Computing methodologies Learning from implicit feedback CCS: Social and professional topics User characteristics CCS: Information systems Uncertainty CCS: Computing methodologies Planning under uncertainty CCS: Computing methodologies Uncertainty quantification CCS: Applied computing Business intelligence CCS: Applied computing Multi-criterion optimization and decision-making by Michelle Seng Ah Lee, Kirtan Padh, David Watson, Niki Kilbertus, Jatinder Singh (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-21711.txt.
Introduction
Lee and four colleagues sort out fairness when decisions follow one after another under uncertainty, as in lending or hiring. Past choices shape later data, and denied applicants leave no record of whether they would have repaid. The paper sets out three kinds of uncertainty: model, feedback, and prediction. It shows how uncertainty-aware exploration can cut outcome variance for disadvantaged groups while still serving institutional goals.
Catalog record
| CREATOR | Michelle Seng Ah Lee, Kirtan Padh, David Watson, Niki Kilbertus, Jatinder Singh |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 78856 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.21711
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Fairness under uncertainty in sequential decisions \conffull ( \confshort ), \confdate , \confloc Conference: The 2026 ACM Conference on Fairness, Accountability, and Transparency; June 25–28, 2026; Montreal, QC, Canada The 2026 ACM Conference on Fairness, Accountability, and Transparency (FAccT ’26), June 25–28, 2026, Montreal, QC, Canada DOI: 10.1145/3805689.3812272 ISBN: XXXXX ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Theory of computation Online learning algorithms CCS: Computing methodologies Sequential decision making CCS: Computing methodologies Batch learning CCS: Computing methodologies Online learning settings CCS: Computing methodologies Learning from implicit feedback CCS: Social and professional topics User characteristics CCS: Information systems Uncertainty CCS: Computing methodologies Planning under uncertainty CCS: Computing methodologies Uncertainty quantification CCS: Applied computing Business intelligence CCS: Applied computing Multi-criterion optimization and decision-making Michelle Seng Ah Lee, Kirtan Padh, David Watson, Niki Kilbertus, Jatinder Singh Abstract . Fair machine learning (ML) methods support the identification and mitigation of the risk that algorithms will encode and/or automate social injustices. While algorithmic approaches alone cannot resolve structural inequalities, these techniques can support socio-technical decision systems by surfacing unintended discriminatory biases, clarifying trade-offs, and enabling governance. Although fairness has been well studied in supervised learning, many real-life ML applications are online and sequential, with feedback from previous decisions informing future decisions. Each decision in such a setting is taken under uncertainty due to unobserved counterfactual outcomes and finite samples, with especially dire consequences for under-represented groups, who are often systematically under-observed due to historical exclusion and selective feedback. For example, a bank cannot know whether a denied loan would have been repaid, and it may have less data about previously marginalized and financially excluded populations. Towards this, this paper introduces a taxonomy of uncertainty in sequential decision-making—including model uncertainty , feedback uncertainty , and prediction uncertainty —to provide a shared vocabulary for assessing and governing sequential decision systems in which uncertainty is unevenly distributed across groups. We formalize the model uncertainty and feedback uncertainty using counterfactual logic and reinforcement learning techniques. We illustrate the potential harms for both the decision maker (unrealized gains and losses) and the decision subject (compounding exclusion and reduced access) of naïve policies that ignore the unobserved space. We illustrate our framework using simple algorithmic examples that demonstrate the possibility of simultaneously reducing the variance in outcomes for historically disadvantaged groups while preserving institutional objectives (e.g. expected utility) of the decision maker. Our experiments on data, simulated to include varying degrees of bias, illustrate how unequal uncertainty and selective feedback can produce disparities in sequential decision systems, and how uncertainty-aware exploration can alter observed fairness metrics. By providing a structured lens for identifying where and how uncertainty arises, this framework equips researchers and practitioners to better diagnose, audit, and govern fairness risks in sequential decision systems. In sequential and online systems in which uncertainty is a core driver of unfair outcomes, not merely incidental noise, our results highlight the importance of explicitly accounting for uncertainty in fair and effective decision-making. † † cc-license: by 1. Introduction Machine learning (ML) algorithms can aid decision-makers in many high-stakes settings, such as healthcare, finance, and criminal justice. While resulting models are often faster and more accurate than human experts, they also pose an especially pernicious risk when historical inequities are reflected—not only in training data—but also from measurement, labelling, system design choices, and feedback from prior decisions ( Barocas et al. 2019 ; Lee and Singh 2021b ; Corbett-Davies et al. 2023 ) . For instance, if racial discrimination has artificially reduced the number of loans given to applicants from minority groups, then ML models may perpetuate this injustice at scale, automating harmful policies in a feedback loop that makes it difficult for qualified applicants from underrepresented minorities to access credit. To date, this problem has been studied primarily in supervised learning. Academics have proposed a variety of (often mutually incompatible ( Kleinberg et al. 2017 ) ) fairness metrics for classification or regression models ( Barocas et al. 2019 ) and methods for imposing fairness constraints on the learning process itself ( Zafar et al. 2019 ) . These fairness measurement and mitigation methods are best understood as tools to formalize particular values and trade-offs, rather than complete solutions, with their appropriateness depending on the socio-technical context. Existing fairness metrics designed for supervised models are ill-suited to many real-world ML applications if they do not capture how inequities compound over time under selective feedback and uncertainty -- our focus in this work. High-stakes settings often require dynamic decisions, rather than static predictions. In domains such as insurance pricing, fraud detection, hiring, and lending, predictions are not evaluated in a one-off mass dataset; rather, a decision is made for each individual or a batch of individuals, and the outcome of that decision informs future policies. In addition, each decision in such a setting is made under uncertainty, a subtlety that is generally overlooked in supervised ML. For example, a bank cannot know whether a denied loan would have been repaid, and it may have less data about previously marginalized and financially excluded populations. Such sequential decision-making procedures are more naturally modeled by reinforcement learning (RL) algorithms, which seek to maximize expected rewards over trials by exploring the unobserved space. 1 1 1 Though some prefer to reserve the term “RL” for policy optimization in complex dynamic systems with long-term horizons, we adopt a more inclusive usage that extends to simpler online learning settings such as bandits. This is common in standard textbooks, e.g. ( Sutton and Barto 2018 ) . There has been a recent burst of interest in fair RL. (For survey introductions, see ( Zhang and Liu 2021 ; Gohar et al. 2025 ; Caton and Haas 2024 ) ) While fairness and uncertainty considerations are well-studied in supervised learning (especially binary classification), comparable work in online settings is relatively limited. These gaps are discussed in § 6 with recommendations for future research. Much of existing literature on RL has introduced several valuable technical methodologies, but their engagement with the nature or consequences of uncertainty in fair decision-making in socio-technical systems, which is compounded by numerous observed and unobserved processes and competing incentives, has been limited. Unlike many of the technical papers in this area, here we do not introduce a novel fairness algorithm. Instead, we provide a taxonomy and diagnostic framework that gives practitioners and fair-ML researchers a shared vocabulary for identifying where uncertainty enters sequential decision pipelines, paving the way for more principled auditing, governance, and algorithm design in fair sequential decision-making. In our next section, we situate our work in the context of the debate around the legal and practical considerations of using RL in real-world settings. 1.1. Legal, practical, and societal risks of RL The use of RL in sequential decision-making can be challenging to justify to key stakeholders due to its potential risks. In this section, we briefly discuss the implications of RL beyond model performance metrics. RL carries legal risks if it is in violation of non-discrimination laws and regulations, reputational risks if misaligned to customer expectations, and practical risks if misaligned to business strategy. Recent work on the societal implications of RL deployment takes an important step in addressing this gap in literature ( Khanna et al. 2025 ;