The Disparate Effects of Partial Information in Bayesian Strategic Learning
Srikanth Avasarala, Serena Wang, Juba Ziani · 2025
Read The Disparate Effects of Partial Information in Bayesian Strategic Learning by Srikanth Avasarala, Serena Wang, Juba Ziani (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00627.txt.
Introduction
Srikanth Avasarala and two co-authors study in 2025 how half-seen scoring rules warp fairness when people game the system. In strategic learning, a scorer sets a rule and people adjust their traits, at a cost, to score better. Here the rule reaches people only as a noisy signal, and groups differ in what adjustment costs them.
Naive agents who trust the signal can see outcome gaps grow without bound as noise rises, and the cheaper-to-adjust group can paradoxically suffer most. Bayesian agents who reason about the noise keep gaps bounded. Fairness, it turns out, is often best at middling transparency, a non-obvious sweet spot for designers of scoring systems.
Catalog record
| CREATOR | Srikanth Avasarala, Serena Wang, Juba Ziani |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 58 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-00627
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Disparate Effects of Partial Information in Bayesian Strategic Learning Srikanth Avasarala, Serena Wang, Juba Ziani Abstract We study how partial information about scoring rules affects fairness in strategic learning settings. In strategic learning, a learner deploys a scoring rule, and agents respond strategically by modifying their features—at some cost–—to improve their outcomes. However, in our work, agents do not observe the scoring rule directly; instead, they receive a noisy signal of said rule. We consider two different agent models: (i) naive agents, who take the noisy signal at face value, and (ii) Bayesian agents, who update a prior belief based on the signal. Our goal is to understand how disparities in outcomes arise between groups that differ in their costs of feature modification, and how these disparities vary with the level of transparency of the learner’s rule. For naive agents, we show that utility disparities can grow unboundedly with noise, and that the group with lower costs can, perhaps counter-intuitively, be disproportionately harmed under limited transparency. In contrast, for Bayesian agents, disparities remain bounded. We provide a full characterization of disparities across groups as a function of the level of transparency and show that they can vary non-monotonically with noise; in particular, disparities are often minimized at intermediate levels of transparency. Finally, we extend our analysis to settings where groups differ not only in cost, but also in prior beliefs, and study how this asymmetry influences fairness. . 1 Introduction Machine learning systems are increasingly being deployed in high-stakes domains such as college admissions, lending, and hiring. A common assumption in the design of these models is that the data encountered at test time is drawn from the same distribution as the training data. However, this assumption breaks down when individuals strategically adapt their features in response to the deployed model. In real life, individuals may invest in test preparation, tune their resumes to match job descriptions and automated CV reviewing algorithms, or open dummy credit accounts to artificially improve metrics like credit usage—all in an effort to improve their predicted outcomes. This phenomenon, known as strategic learning , was first formalized by Hardt et al. 2016 , and has become central to understanding robustness algorithmic decision-making. While such strategic behavior may be rational from an individual perspective, it can have undesirable implications for society and in particular for fairness. When individuals differ in the cost of modifying their features—due to resource constraints, institutional barriers, or historical disadvantage—strategic adaptation can reinforce or amplify existing inequalities. Prior work has shown that disparities in the cost of feature manipulation can translate into disparities in both scoring and classification outcomes even when the underlying model treats all individuals equally ( Milli et al. 2019 ; Hu et al. 2019 ) . A common, key assumption in much of the strategic classification literature is that individuals have full knowledge of the deployed model and can best respond accordingly. Yet this assumption is often unrealistic. In practice, scoring rules are rarely transparent. Banks and credit bureaus do not disclose the exact algorithms behind loan decisions or credit scores; recidivism prediction tools such as COMPAS operate as proprietary black boxes ( Angwin et al. 2016 ) ; and AI-based hiring platforms use complex and often non-interpretable models to rank candidates. Therefore, addressing fairness in strategic learning environments also requires thinking about how individuals perceive deployed rules and algorithms, both when all agents have access to the same information about the deployed rule and when there are informational disparities across individuals. These observations raise a critical question: how does partial knowledge of the model affect the fairness of strategic learning systems? More precisely, how do different levels of transparency—ranging from full disclosure to total opacity—influence disparities in outcomes across populations? And how do these effects depend on the assumptions we make about how individuals operate under uncertainty? In this work, we develop a framework to study fairness under partial information in strategic learning environments. We model agents who observe only a noisy signal of the deployed decision rule. We consider two types of agent responses to this signal: (i) naive agents, who treat the signal as ground truth and optimize against it directly ( Jagadeesan et al. 2021 ) ; and (ii) Bayesian agents, who combine the signal with a prior belief to form a posterior, and optimize based on this posterior belief on the deployed rule ( Cohen et al. 2024 ) . Our analysis focuses on how outcome disparities—–measured both in terms of model scores and individual utilities (that also take costs into account)—–arise across groups that differ in their cost of feature modification. We examine how these disparities evolve as a function of the amount of information the learner releases about the model. Summary of Contributions. Our paper makes the following contributions: • In Section 4.1 , we analyze the fairness of naive agents under partial transparency. We show that while score disparities remain constant, utility disparities vary monotonically with the level of noise in the model signal. Surprisingly, the group with lower costs of feature change can be disproportionately harmed by noisy information, leading to unbounded disparities in utility, due to “over-spending” on ineffective modifications. • In Section 4.2 , we turn to Bayesian agents and fully characterize how score and utility disparities depend on the prior and noise level of the released signal. We characterize when disparities arise as a function of the parameter of the problem. Perhaps surprisingly, we show that disparities can be non-monotone in the level of information revealed by the learner and are minimized at intermediate transparency levels. • In Section 5 , we characterize disparities when groups differ not only in cost but also in their prior beliefs , expanding the model of Bechavod et al. 2022 . We derive bounds on group disparities as a function of the information overlap of Bechavod et al. 2022 . Related work This work lies at the intersection of fairness and strategic behavior in algorithmic decision-making. A growing body of research has studied how individuals adapt their features to secure better outcomes from predictive models—known as Strategic Classification or Strategic Learning —, and how such behavior leads to disparate impacts across populations. Strategic Learning was initially introduced by Hardt et al. 2016 and sparked a large area of research studying how agents respond to decision rules in learning systems ( Braverman and Garg 2020 ; Dong et al. 2018 ; Zhang et al. 2022 ; Lechner et al. 2023 ; Chen et al. 2020 ; Ahmadi et al. 2021 ; Sundaram et al. 2023 ) to only name a few. For a recent survey, please refer to ( Podimata 2025 ) . While early work primarily focused on agents “gaming” classifiers—in the context of loans, this could be seen as opening dummy credit cards to artificially lower credit utilization and inflate credit scores—, more recent papers have considered actual improvements—e.g., improving one’s ability to repay loans on time—, as seen in the works of Kleinberg and Raghavan 2020 ; Shavit et al. 2020 ; Harris et al. 2021 ; Bechavod et al. 2022 ; Ebrahimi et al. 2024 . A significantly smaller subset of this literature explicitly tackles fairness.