Maximum Entropy Reinforcement Learning with Diffusion Policy

Xiaoyi Dong, Jian Cheng, Xi Sheryl Zhang · 2025

Read Maximum Entropy Reinforcement Learning with Diffusion Policy by Xiaoyi Dong, Jian Cheng, Xi Sheryl Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-11612.txt.

Description

Xiaoyi Dong and co-authors upgrade how an AI agent learns to act by trial and error. Their frame rewards both success and variety, a mix known as maximum entropy learning. The usual method shapes its choices as a simple bell curve. That shape explores poorly when a task has many goals or many good paths.

The team swaps the bell curve for a diffusion model, a richer shape builder borrowed from image tools. Their method, MaxEntDP, can spread choices across many modes at once. That spread brings the agent closer to the best plan the frame allows. On standard robot control tests, it beat the bell curve form and matched top rival methods.

Catalog record

CREATORXiaoyi Dong, Jian Cheng, Xi Sheryl Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE78 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-11612

Browse the full library · About the Tower of Babel