A Refined Analysis of UCBVI

Simone Drago [email protected] · 2025

Read A Refined Analysis of UCBVI by Simone Drago [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-17370.txt.

Description

UCBVI is a classic algorithm for learning to act in an unknown environment while keeping regrets low. Simone Drago, Marco Mussi, and Alberto Maria Metelli revisit its proof and sharpen it. Their refined analysis improves the exploration bonus terms that push the learner to try uncertain actions.

They compare the polished version against the original algorithm and against a current state-of-the-art rival, MVP. The tighter constants are not just cosmetic: in experiments, the refined algorithm performed clearly better. The authors argue that careful bookkeeping in regret bounds pays off in practice, because smaller constants mean less wasted exploration. The work is a reminder that theory polish and real performance can move together in reinforcement learning.

Catalog record

CREATORSimone Drago [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE97 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-17370

Browse the full library · About the Tower of Babel