Accelerating Diffusion Models in Offline RL via Reward-Aware Consistency Trajectory Distillation

Xintong Duan, Yutong HeFahim Tajwar Ruslan Salakhutdinov J. Zico Kolter Jeff Schneider Carnegie Mellon University{ xintongd, yutonghe, ftajwar, rsalakhu, zkolter, jeff4}@cs.cmu.edu · 2025

Read Accelerating Diffusion Models in Offline RL via Reward-Aware Consistency Trajectory Distillation by Xintong Duan, Yutong HeFahim Tajwar Ruslan Salakhutdinov J. Zico Kolter Jeff Schneider Carnegie Mellon University{ xintongd, yutonghe, ftajwar, rsalakhu, zkolter, jeff4}@cs.cmu.edu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-07822.txt.

Description

Xintong Duan and co-authors present a 2025 paper on speeding up diffusion planners for offline learning from past logs. Such planners pick strong action chains but sample far too slowly for live use. Past shortcuts either copy weak demos or need many networks trained at once.

Their method folds reward into the shortcut training itself, with clean reward signals and split training steps. The result plans in a single step yet earns higher rewards than the slow form. Across gym, kitchen robot, and long-horizon tests it beat the past best while running far faster.

Catalog record

CREATORXintong Duan, Yutong HeFahim Tajwar Ruslan Salakhutdinov J. Zico Kolter Jeff Schneider Carnegie Mellon University{ xintongd, yutonghe, ftajwar, rsalakhu, zkolter, jeff4}@cs.cmu.edu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-07822

Browse the full library · About the Tower of Babel