When Are RL Hyperparameters Benign? A Study in Offline Goal-Conditioned RL
Jan Malte Töpperwien *, Aditya Mohan *, Marius Lindauer · 2026
Read When Are RL Hyperparameters Benign? A Study in Offline Goal-Conditioned RL by Jan Malte Töpperwien *, Aditya Mohan *, Marius Lindauer (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-05459.txt.
Description
Success rates alone can hide how hard a learning method is to tune, a gap that Jan Malte Töpperwien, Aditya Mohan, and Marius Lindauer study for offline goal-conditioned reinforcement learning. In this setting, an agent learns from stored data to reach stated goals, and a shared extraction step turns learned values into actions. The authors ask how broad the range of good settings is for four known methods.
For each method they map performance across learning rates and a temperature that controls how strictly the agent copies high-value moves. Tests on maze, cube, and scene tasks show sharp contrasts: some high scorers work only in a narrow band of settings, while others are steady but capped lower. Extra checks help explain the patterns on the maze task. On the other tasks those checks and real success came apart, which warns against judging methods by peak scores alone.
Catalog record
| CREATOR | Jan Malte Töpperwien *, Aditya Mohan *, Marius Lindauer |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 71 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-05459