Accelerating Diffusion Models in Offline RL via Reward-Aware Consistency Trajectory Distillation
Xintong Duan, Yutong HeFahim Tajwar Ruslan Salakhutdinov J. Zico Kolter Jeff Schneider Carnegie Mellon University{ xintongd, yutonghe, ftajwar, rsalakhu, zkolter, jeff4}@cs.cmu.edu · 2025
Read Accelerating Diffusion Models in Offline RL via Reward-Aware Consistency Trajectory Distillation by Xintong Duan, Yutong HeFahim Tajwar Ruslan Salakhutdinov J. Zico Kolter Jeff Schneider Carnegie Mellon University{ xintongd, yutonghe, ftajwar, rsalakhu, zkolter, jeff4}@cs.cmu.edu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-07822.txt.
Description
Xintong Duan and co-authors present a 2025 paper on speeding up diffusion planners for offline learning from past logs. Such planners pick strong action chains but sample far too slowly for live use. Past shortcuts either copy weak demos or need many networks trained at once.
Their method folds reward into the shortcut training itself, with clean reward signals and split training steps. The result plans in a single step yet earns higher rewards than the slow form. Across gym, kitchen robot, and long-horizon tests it beat the past best while running far faster.
Catalog record
| CREATOR | Xintong Duan, Yutong HeFahim Tajwar Ruslan Salakhutdinov J. Zico Kolter Jeff Schneider Carnegie Mellon University{ xintongd, yutonghe, ftajwar, rsalakhu, zkolter, jeff4}@cs.cmu.edu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-07822