Bootstrapped Reward Shaping

Jacob Adamczyk, Volodymyr Makarenko, Stas Tiomkin, Rahul V. Kulkarni · 2025

Read Bootstrapped Reward Shaping by Jacob Adamczyk, Volodymyr Makarenko, Stas Tiomkin, Rahul V. Kulkarni (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-00989.txt.

Description

Jacob Adamczyk, Volodymyr Makarenko, Stas Tiomkin, and Rahul Kulkarni wrote a machine learning paper in two thousand twenty-five on helping agents learn when rewards are rare. In reinforcement learning, an agent learns by trial and error. When rewards come seldom, learning is slow. A known fix adds shaped rewards, extra signals that guide the agent without changing the best strategy.

Shaping needs a guide function, and a poor guide can hurt training. The authors let the agent use its own current guess of state value as that guide, a move they call bootstrapped reward shaping. They prove the method settles in simple settings and show faster training on Atari games.

Catalog record

CREATORJacob Adamczyk, Volodymyr Makarenko, Stas Tiomkin, Rahul V. Kulkarni
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-00989

Browse the full library · About the Tower of Babel