State Entropy Regularization for Robust Reinforcement Learning
Yonatan Ashlag, Uri Koren*, Mirco Mutti, Esther Derman, Pierre-Luc Bacon, Shie Mannor · 2025
Read State Entropy Regularization for Robust Reinforcement Learning by Yonatan Ashlag, Uri Koren*, Mirco Mutti, Esther Derman, Pierre-Luc Bacon, Shie Mannor (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-07085.txt.
Description
Yonatan Ashlag and co-authors give the first theory for a popular trick in reinforcement learning in a 2025 paper. The trick, called state entropy regularization, rewards an agent for visiting a wide spread of states. In practice it improves exploration and learning speed, but no one had proven why it helps beyond those gains.
The authors show the trick also buys robustness. Agents trained this way withstand structured, spatially linked disturbances, the kind met when a learned skill moves to a new setting. Standard robust methods focus on small, random noise and miss that case. The proof turns a folk technique into a principled tool for transfer learning, where conditions shift in patterned ways.
Catalog record
| CREATOR | Yonatan Ashlag, Uri Koren*, Mirco Mutti, Esther Derman, Pierre-Luc Bacon, Shie Mannor |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-07085