A Refined Analysis of UCBVI
Simone Drago [email protected] · 2025
Read A Refined Analysis of UCBVI by Simone Drago [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-17370.txt.
Description
UCBVI is a classic algorithm for learning to act in an unknown environment while keeping regrets low. Simone Drago, Marco Mussi, and Alberto Maria Metelli revisit its proof and sharpen it. Their refined analysis improves the exploration bonus terms that push the learner to try uncertain actions.
They compare the polished version against the original algorithm and against a current state-of-the-art rival, MVP. The tighter constants are not just cosmetic: in experiments, the refined algorithm performed clearly better. The authors argue that careful bookkeeping in regret bounds pays off in practice, because smaller constants mean less wasted exploration. The work is a reminder that theory polish and real performance can move together in reinforcement learning.
Catalog record
| CREATOR | Simone Drago [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 97 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-17370