Counterfactually Fair Reinforcement Learning via Sequential Data Preprocessing
Jitao Wang, Chengchun Shi, John D. Piette, Joshua R. Loftus, Donglin Zeng, Zhenke Wu · 2025
Read Counterfactually Fair Reinforcement Learning via Sequential Data Preprocessing by Jitao Wang, Chengchun Shi, John D. Piette, Joshua R. Loftus, Donglin Zeng, Zhenke Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-06366.txt.
Description
Jitao Wang and colleagues make sequential decision algorithms fair in the counterfactual sense: would the same person, with a different protected trait, have been steered the same way? In health care, reinforcement learning that assigns interventions over time can quietly favor one subgroup and starve another, and the bias feeds itself. Writing in twenty twenty-five, the team characterizes the best policy that satisfies counterfactual fairness and proves it can be taken stationary, which means off-the-shelf learning algorithms can search for it. The theory then motivates a preprocessing routine that cleans the data stage by stage before learning.
Simulations confirm the approach holds unfairness down while keeping value near optimal. On a digital health data set aimed at cutting opioid misuse, the method greatly widened fair access to counseling. The framework is offered for multi-stage allocation problems generally.
Catalog record
| CREATOR | Jitao Wang, Chengchun Shi, John D. Piette, Joshua R. Loftus, Donglin Zeng, Zhenke Wu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 87 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-06366