Optimistically Optimistic Exploration for Provably Efficient Infinite-Horizon Reinforcement and Imitation Learning

Antoine Moulin, Gergely Neu, Luca Viano · 2025

Read Optimistically Optimistic Exploration for Provably Efficient Infinite-Horizon Reinforcement and Imitation Learning by Antoine Moulin, Gergely Neu, Luca Viano (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-13900.txt.

Description

Antoine Moulin, Gergely Neu, and Luca Viano give an exploration method for learning agents that is, in their phrase, optimistically optimistic. Their 2025 work tackles reinforcement learning in endless, discounted tasks whose states can be captured by a modest set of features. Earlier methods either could not run in practice or paid too much regret, the gap between what the agent earns and the best possible.

Their algorithm joins two classic tricks: adding exploration bonuses to rewards, and letting the agent jump to an absorbing state with top return. Combined with a steadied form of dynamic programming, the method reaches the best known regret rate for this setting, and the bound holds even when rewards turn hostile. That hostile case covers imitation learning, where the agent copies an expert, and there the method also sets the state of the art.

Catalog record

CREATORAntoine Moulin, Gergely Neu, Luca Viano
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE204 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-13900

Browse the full library · About the Tower of Babel