Solving Robust Markov Decision Processes: Generic, Reliable, Efficient
Tobias Meggendorfer, Maximilian Weininger, Patrick Wienhöft · 2024
Read Solving Robust Markov Decision Processes: Generic, Reliable, Efficient by Tobias Meggendorfer, Maximilian Weininger, Patrick Wienhöft (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-10185.txt.
Description
Tobias Meggendorfer, Maximilian Weininger, and Patrick Wienhöft present a solver for decision problems where the odds themselves are uncertain. Their 2024 paper works with robust Markov decision processes, in which each action carries a whole set of possible probability rules. Such sets can be intervals, balls, or many-sided shapes.
Their framework leans on a known link to stochastic games but never builds the game outright, which is where older tools waste their effort. The solver handles many goals, from long-run average reward to shortest paths, and it reports how precise its answer is at every stage, not just in the limit. A prototype beats existing tools by orders of magnitude, clearing a million states in under a minute.
Catalog record
| CREATOR | Tobias Meggendorfer, Maximilian Weininger, Patrick Wienhöft |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 145 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-10185