On the Complexity of Robust Markov Decision Processes and Bisimulation Metrics
Marnix Suilen, Guillermo A. Pérez · 2026
Read On the Complexity of Robust Markov Decision Processes and Bisimulation Metrics by Marnix Suilen, Guillermo A. Pérez (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-26748.txt.
Description
Suilen and Pérez study robust Markov decision processes with uncertainty over transition odds. The goal is discounted total reward under worst-case transitions. State-action-rectangular policy scoring is in P by robust linear programs. The threshold problem is in NP, so robust policy loops run in poly time at fixed discount. State-rectangular threshold problems land in PSPACE by first-order real theory. Lower bounds reduce parity games and bisimulation metrics to the threshold problem. A poly-time algorithm would settle whether parity games admit one.
Catalog record
| CREATOR | Marnix Suilen, Guillermo A. Pérez |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 83394 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.26748