Entropy-Regularized Adjoint Matching for Offline Reinforcement Learning

Abdelghani Ghanem, Mounir Ghogho · 2026

Read Entropy-Regularized Adjoint Matching for Offline Reinforcement Learning by Abdelghani Ghanem, Mounir Ghogho (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-06156.txt.

Description

Abdelghani Ghanem and Mounir Ghogho improve offline reinforcement learning with expressive generative policies. Flow matching policies can capture complex, multi modal behavior from fixed data sets. A prior method stabilizes their training through the continuous adjoint method, but stays bound to the behavior distribution in the data. That tie creates two flaws the authors name popularity bias and support binding.

Their framework, Maximum Entropy Adjoint Matching, attacks both flaws inside the flow formulation. An entropy maximization objective, set by mirror descent, counters the bias toward common actions. A mixture behavior prior widens the support so high reward actions outside the data manifold can be reached. Across sparse reward control tasks, the method matched or beat leading approaches while keeping the generative field well behaved.

Catalog record

CREATORAbdelghani Ghanem, Mounir Ghogho
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE182 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.06156

Browse the full library · About the Tower of Babel