The Role of Environment Access in Agnostic Reinforcement Learning
Akshay Krishnamurthy, Gene Li, Ayush Sekhari · 2025
Read The Role of Environment Access in Agnostic Reinforcement Learning by Akshay Krishnamurthy, Gene Li, Ayush Sekhari (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2504-05405.txt.
Introduction
Akshay Krishnamurthy, Gene Li, and Ayush Sekhari ask in 2025 how much access to a world a learning agent needs. In reinforcement learning, an agent learns by trial and error. The weakest goal is to find the best plan inside a fixed set of plans, with no promise that the set holds the true best plan at all.
The authors show this weak goal stays out of reach under two tempting upgrades. A local simulator that restarts the agent at seen states does not save it. Neither does a restart rule with good coverage of the world. Two classic algorithms also fail without stronger promises. One special world type, the block model, does allow success when both upgrades are combined.
Catalog record
| CREATOR | Akshay Krishnamurthy, Gene Li, Ayush Sekhari |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 320 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2504-05405