Solving Robust Markov Decision Processes: Generic, Reliable, Efficient

Tobias Meggendorfer, Maximilian Weininger, Patrick Wienhöft · 2024

Read Solving Robust Markov Decision Processes: Generic, Reliable, Efficient by Tobias Meggendorfer, Maximilian Weininger, Patrick Wienhöft (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-10185.txt.

Description

Tobias Meggendorfer, Maximilian Weininger, and Patrick Wienhöft present a solver for decision problems where the odds themselves are uncertain. Their 2024 paper works with robust Markov decision processes, in which each action carries a whole set of possible probability rules. Such sets can be intervals, balls, or many-sided shapes.

Their framework leans on a known link to stochastic games but never builds the game outright, which is where older tools waste their effort. The solver handles many goals, from long-run average reward to shortest paths, and it reports how precise its answer is at every stage, not just in the limit. A prototype beats existing tools by orders of magnitude, clearing a million states in under a minute.

Catalog record

CREATORTobias Meggendorfer, Maximilian Weininger, Patrick Wienhöft
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE145 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-10185

Browse the full library · About the Tower of Babel