Diffusion Self-Weighted Guidance for Offline Reinforcement Learning
Augusto Tagle [email protected], Javier Ruiz-del-Solar [email protected], Felipe Tobar [email protected] · 2025
Read Diffusion Self-Weighted Guidance for Offline Reinforcement Learning by Augusto Tagle [email protected], Javier Ruiz-del-Solar [email protected], Felipe Tobar [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18345.txt.
Description
Augusto Tagle and co-authors streamline offline reinforcement learning, where an agent must learn the best policy from old logs alone. In practice the best policy is modeled as a weighted twist of the behavior that filled the logs. Diffusion-based methods score well here, but the scores they need depend on that unknown weight function.
The team's fix grows a diffusion process over actions and weights together. The needed scores then drop straight out of the model, with no extra networks to train. Guidance, steered by the weights, comes from the same model, so they call the method Self-Weighted Guidance. Toy tests confirm it samples the right distribution. On the hard D4RL suites it matches leading methods with a leaner pipeline.
Catalog record
| CREATOR | Augusto Tagle [email protected], Javier Ruiz-del-Solar [email protected], Felipe Tobar [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 60 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-18345