Robust Counterfactual Inference in Markov Decision Processes

Jessica Lally, Milad Kazemi, Nicola Paoletti · 2025

Read Robust Counterfactual Inference in Markov Decision Processes by Jessica Lally, Milad Kazemi, Nicola Paoletti (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-13731.txt.

Description

Jessica Lally, Milad Kazemi, and Nicola Paoletti take on a flaw in how we reason about what might have been, in a 2025 paper. Their setting is a Markov decision process, a step by step model of choices and chance. Standard tools fix one causal story, yet many stories can fit the same data and give unlike answers.

The team gives a way to bound the odds of each next step across all stories that fit. Their formulas are closed form, so they stay fast even for large models where older tools bog down. From those bounds they build policies that do well in the worst case. Case studies show stronger results than past methods.

Catalog record

CREATORJessica Lally, Milad Kazemi, Nicola Paoletti
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE268 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-13731

Browse the full library · About the Tower of Babel