Counterfactually Fair Reinforcement Learning via Sequential Data Preprocessing

Jitao Wang, Chengchun Shi, John D. Piette, Joshua R. Loftus, Donglin Zeng, Zhenke Wu · 2025

Read Counterfactually Fair Reinforcement Learning via Sequential Data Preprocessing by Jitao Wang, Chengchun Shi, John D. Piette, Joshua R. Loftus, Donglin Zeng, Zhenke Wu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-06366.txt.

Description

Jitao Wang and colleagues make sequential decision algorithms fair in the counterfactual sense: would the same person, with a different protected trait, have been steered the same way? In health care, reinforcement learning that assigns interventions over time can quietly favor one subgroup and starve another, and the bias feeds itself. Writing in twenty twenty-five, the team characterizes the best policy that satisfies counterfactual fairness and proves it can be taken stationary, which means off-the-shelf learning algorithms can search for it. The theory then motivates a preprocessing routine that cleans the data stage by stage before learning.

Simulations confirm the approach holds unfairness down while keeping value near optimal. On a digital health data set aimed at cutting opioid misuse, the method greatly widened fair access to counseling. The framework is offered for multi-stage allocation problems generally.

Catalog record

CREATORJitao Wang, Chengchun Shi, John D. Piette, Joshua R. Loftus, Donglin Zeng, Zhenke Wu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE87 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-06366

Browse the full library · About the Tower of Babel