Diffusion Self-Weighted Guidance for Offline Reinforcement Learning

Augusto Tagle [email protected], Javier Ruiz-del-Solar [email protected], Felipe Tobar [email protected] · 2025

Read Diffusion Self-Weighted Guidance for Offline Reinforcement Learning by Augusto Tagle [email protected], Javier Ruiz-del-Solar [email protected], Felipe Tobar [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18345.txt.

Description

Augusto Tagle and co-authors streamline offline reinforcement learning, where an agent must learn the best policy from old logs alone. In practice the best policy is modeled as a weighted twist of the behavior that filled the logs. Diffusion-based methods score well here, but the scores they need depend on that unknown weight function.

The team's fix grows a diffusion process over actions and weights together. The needed scores then drop straight out of the model, with no extra networks to train. Guidance, steered by the weights, comes from the same model, so they call the method Self-Weighted Guidance. Toy tests confirm it samples the right distribution. On the hard D4RL suites it matches leading methods with a leaner pipeline.

Catalog record

CREATORAugusto Tagle [email protected], Javier Ruiz-del-Solar [email protected], Felipe Tobar [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-18345

Browse the full library · About the Tower of Babel