Hierarchical Behaviour Spaces

Michael Tryfan Matthews, Anssi Kanervisto, Jakob Foerster, Pierluca D’Oro, Scott Fujimoto, Mikael Henaff · 2026

Read Hierarchical Behaviour Spaces by Michael Tryfan Matthews, Anssi Kanervisto, Jakob Foerster, Pierluca D’Oro, Scott Fujimoto, Mikael Henaff (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-24558.txt.

Description

Matthews and five colleagues replace the single reward per option in hierarchical reinforcement learning with whole spaces of behaviours, letting a controller blend reward functions to shape richer policies. Tested in the NetHack Learning Environment, the method, called Hierarchical Behaviour Spaces, performs strongly. Follow-up tests trace its edge to wider exploration rather than deeper long-term planning, a result that cuts against common wisdom about why hierarchy helps.

Catalog record

CREATORMichael Tryfan Matthews, Anssi Kanervisto, Jakob Foerster, Pierluca D’Oro, Scott Fujimoto, Mikael Henaff
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27387
LICENSEhttp://creativecommons.org/licenses/by-sa/4.0/
RIGHTSCC BY SA
SOURCEarXiv

Source: https://arxiv.org/abs/2604.24558

Browse the full library · About the Tower of Babel