Entropy-Regularized Adjoint Matching for Offline Reinforcement Learning
Abdelghani Ghanem, Mounir Ghogho · 2026
Read Entropy-Regularized Adjoint Matching for Offline Reinforcement Learning by Abdelghani Ghanem, Mounir Ghogho (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06156.txt.
Description
Abdelghani Ghanem and Mounir Ghogho improve offline reinforcement learning with expressive generative policies. Flow matching policies can capture complex, multi modal behavior from fixed data sets. A prior method stabilizes their training through the continuous adjoint method, but stays bound to the behavior distribution in the data. That tie creates two flaws the authors name popularity bias and support binding.
Their framework, Maximum Entropy Adjoint Matching, attacks both flaws inside the flow formulation. An entropy maximization objective, set by mirror descent, counters the bias toward common actions. A mixture behavior prior widens the support so high reward actions outside the data manifold can be reached. Across sparse reward control tasks, the method matched or beat leading approaches while keeping the generative field well behaved.
Catalog record
| CREATOR | Abdelghani Ghanem, Mounir Ghogho |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 182 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.06156