The Sample Complexity of Online Reinforcement Learning: A Multi-model Perspective

Michael Muehlebach, Zhiyu He, Michael I. Jordan · 2025

Read The Sample Complexity of Online Reinforcement Learning: A Multi-model Perspective by Michael Muehlebach, Zhiyu He, Michael I. Jordan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-15910.txt.

Description

Michael Muehlebach, Zhiyu He, and Michael Jordan study how much data online learning needs in a 2025 paper. Their setting is reinforcement learning, where an agent learns by acting in a system that never pauses. The systems here are nonlinear, with smooth, endless ranges of states and actions.

The analysis covers cases from a short list of candidate models to models set by a compact dial of values, such as neural nets. Bounds on regret, the loss against the best policy, are derived for each case. For the dial-set case the bound matches earlier results found for simple linear systems. The authors note their methods are simple and use prior knowledge well.

Catalog record

CREATORMichael Muehlebach, Zhiyu He, Michael I. Jordan
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE130 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-15910

Browse the full library · About the Tower of Babel