The Role of Environment Access in Agnostic Reinforcement Learning

Akshay Krishnamurthy, Gene Li, Ayush Sekhari · 2025

Read The Role of Environment Access in Agnostic Reinforcement Learning by Akshay Krishnamurthy, Gene Li, Ayush Sekhari (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-05405.txt.

Introduction

Akshay Krishnamurthy, Gene Li, and Ayush Sekhari ask in 2025 how much access to a world a learning agent needs. In reinforcement learning, an agent learns by trial and error. The weakest goal is to find the best plan inside a fixed set of plans, with no promise that the set holds the true best plan at all.

The authors show this weak goal stays out of reach under two tempting upgrades. A local simulator that restarts the agent at seen states does not save it. Neither does a restart rule with good coverage of the world. Two classic algorithms also fail without stronger promises. One special world type, the block model, does allow success when both upgrades are combined.

Catalog record

CREATORAkshay Krishnamurthy, Gene Li, Ayush Sekhari
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE320 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2504-05405

Browse the full library · About the Tower of Babel