DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Models

Quanhao Li Junqiu Yu Kaixun Jiang Yujie Wei, Zhen Xing Pandeng Li Ruihang Chu Shiwei Zhang Yu Liu Zuxuan WuFudan University Wan Team, Alibaba Group [email protected] [email protected] Project page: https://quanhaol.github.io/DiffusionOPD-site/ · 2026

Read DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Models by Quanhao Li Junqiu Yu Kaixun Jiang Yujie Wei, Zhen Xing Pandeng Li Ruihang Chu Shiwei Zhang Yu Liu Zuxuan WuFudan University Wan Team, Alibaba Group [email protected] [email protected] Project page: https://quanhaol.github.io/DiffusionOPD-site/ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-15055.txt.

Description

Quanhao Li and nine others propose DiffusionOPD, a multi-task training method for diffusion text-to-image models based on online policy distillation. Joint multi-task training suffers interference and imbalance, while cascaded training forgets earlier tasks. DiffusionOPD trains one teacher per task. It then distills them into a single student along the student's own rollouts. The authors lift the framework to continuous-state processes with a closed-form per-step objective, reporting lower-variance gradients and consistent wins over multi-reward and cascade baselines.

Catalog record

CREATORQuanhao Li Junqiu Yu Kaixun Jiang Yujie Wei, Zhen Xing Pandeng Li Ruihang Chu Shiwei Zhang Yu Liu Zuxuan WuFudan University Wan Team, Alibaba Group [email protected] [email protected] Project page: https://quanhaol.github.io/DiffusionOPD-site/
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE36166
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.15055

Browse the full library · About the Tower of Babel