Robust Markov Decision Processes on Continuous State Spaces

Mengmeng Li, Yifan Hu, Daniel Kuhn, Yan Li · 2026

Read Robust Markov Decision Processes on Continuous State Spaces by Mengmeng Li, Yifan Hu, Daniel Kuhn, Yan Li (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28706.txt.

Description

Mengmeng Li, Yifan Hu, Daniel Kuhn, and Yan Li study endless robust Markov processes on state spaces with box sets. Their set sits in the hull of unknown kernels. They use the dynamic setup of robust processes and introduce a random first-order method for policy scoring. They prove its settling to the robust value function, giving sample needs of one over epsilon squared. A policy loop finds an epsilon-optimal policy with the same count. The method applies to zero-sum Markov games, strictly improving current sample needs.

Catalog record

CREATORMengmeng Li, Yifan Hu, Daniel Kuhn, Yan Li
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE136482
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.28706

Browse the full library · About the Tower of Babel