When Are RL Hyperparameters Benign? A Study in Offline Goal-Conditioned RL

Jan Malte Töpperwien *, Aditya Mohan *, Marius Lindauer · 2026

Read When Are RL Hyperparameters Benign? A Study in Offline Goal-Conditioned RL by Jan Malte Töpperwien *, Aditya Mohan *, Marius Lindauer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-05459.txt.

Description

Success rates alone can hide how hard a learning method is to tune, a gap that Jan Malte Töpperwien, Aditya Mohan, and Marius Lindauer study for offline goal-conditioned reinforcement learning. In this setting, an agent learns from stored data to reach stated goals, and a shared extraction step turns learned values into actions. The authors ask how broad the range of good settings is for four known methods.

For each method they map performance across learning rates and a temperature that controls how strictly the agent copies high-value moves. Tests on maze, cube, and scene tasks show sharp contrasts: some high scorers work only in a narrow band of settings, while others are steady but capped lower. Extra checks help explain the patterns on the maze task. On the other tasks those checks and real success came apart, which warns against judging methods by peak scores alone.

Catalog record

CREATORJan Malte Töpperwien *, Aditya Mohan *, Marius Lindauer
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE71 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-05459

Browse the full library · About the Tower of Babel