Robust Counterfactual Inference in Markov Decision Processes
Jessica Lally, Milad Kazemi, Nicola Paoletti · 2025
Read Robust Counterfactual Inference in Markov Decision Processes by Jessica Lally, Milad Kazemi, Nicola Paoletti (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-13731.txt.
Description
Jessica Lally, Milad Kazemi, and Nicola Paoletti take on a flaw in how we reason about what might have been, in a 2025 paper. Their setting is a Markov decision process, a step by step model of choices and chance. Standard tools fix one causal story, yet many stories can fit the same data and give unlike answers.
The team gives a way to bound the odds of each next step across all stories that fit. Their formulas are closed form, so they stay fast even for large models where older tools bog down. From those bounds they build policies that do well in the worst case. Case studies show stronger results than past methods.
Catalog record
| CREATOR | Jessica Lally, Milad Kazemi, Nicola Paoletti |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 268 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-13731