Optimistically Optimistic Exploration for Provably Efficient Infinite-Horizon Reinforcement and Imitation Learning
Antoine Moulin, Gergely Neu, Luca Viano · 2025
Read Optimistically Optimistic Exploration for Provably Efficient Infinite-Horizon Reinforcement and Imitation Learning by Antoine Moulin, Gergely Neu, Luca Viano (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-13900.txt.
Description
Antoine Moulin, Gergely Neu, and Luca Viano give an exploration method for learning agents that is, in their phrase, optimistically optimistic. Their 2025 work tackles reinforcement learning in endless, discounted tasks whose states can be captured by a modest set of features. Earlier methods either could not run in practice or paid too much regret, the gap between what the agent earns and the best possible.
Their algorithm joins two classic tricks: adding exploration bonuses to rewards, and letting the agent jump to an absorbing state with top return. Combined with a steadied form of dynamic programming, the method reaches the best known regret rate for this setting, and the bound holds even when rewards turn hostile. That hostile case covers imitation learning, where the agent copies an expert, and there the method also sets the state of the art.
Catalog record
| CREATOR | Antoine Moulin, Gergely Neu, Luca Viano |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 204 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-13900