Which Features are Best for Successor Features?

Yann Ollivier · 2025

Read Which Features are Best for Successor Features? by Yann Ollivier (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-10790.txt.

Description

Yann Ollivier asks which base features a reinforcement learning agent should carry so it can adapt instantly to new tasks, in a 2025 paper. Successor features let an agent reuse learned structure: if rewards are linear mixes of base features, optimal policies for new mixes come free. The catch is picking features that stay useful beyond that linear family.

Laplacian eigenfunctions, drawn from the geometry of movement, were the leading candidate. Ollivier instead derives the best features from an explicit performance criterion, without assuming tasks are linear. He tests three broad task families: reaching random goals, dense random rewards, and scattered sparse rewards. Remarkably, the same features win in all three families. They are built from the movement operator but differ from the Laplacian eigenfunctions in general. The paper also sharpens understanding of related gradient methods in regularized policy learning.

Catalog record

CREATORYann Ollivier
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-10790

Browse the full library · About the Tower of Babel