Global Optimality for Constrained Exploration via Penalty Regularization
Florian Wolf 1, Ilyas Fatkhullin 2,3, Niao He 2,3 · 2026
Read Global Optimality for Constrained Exploration via Penalty Regularization by Florian Wolf 1, Ilyas Fatkhullin 2,3, Niao He 2,3 (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-28144.txt.
Introduction
Wolf, Fatkhullin and He propose Policy Gradient Penalty, a single-loop method for limited maximum-entropy exploration in reinforcement learning. Entropy maximisation lacks add-up structure, blocking Bellman methods, and policy tuning adds bends to goal and constraints. Their squared-penalty method imposes convex occupancy constraints through pseudo-rewards, and hidden convexity plus strong duality yield global last-iterate settling to near-optimal, nearly feasible policies, tested on grid-world and continuous-control tasks.
Catalog record
| CREATOR | Florian Wolf 1, Ilyas Fatkhullin 2,3, Niao He 2,3 |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 155487 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.28144