DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Models
Quanhao Li Junqiu Yu Kaixun Jiang Yujie Wei, Zhen Xing Pandeng Li Ruihang Chu Shiwei Zhang Yu Liu Zuxuan WuFudan University Wan Team, Alibaba Group [email protected] [email protected] Project page: https://quanhaol.github.io/DiffusionOPD-site/ · 2026
Read DiffusionOPD: A Unified Perspective of On-Policy Distillation in Diffusion Models by Quanhao Li Junqiu Yu Kaixun Jiang Yujie Wei, Zhen Xing Pandeng Li Ruihang Chu Shiwei Zhang Yu Liu Zuxuan WuFudan University Wan Team, Alibaba Group [email protected] [email protected] Project page: https://quanhaol.github.io/DiffusionOPD-site/ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-15055.txt.
Description
Quanhao Li and nine others propose DiffusionOPD, a multi-task training method for diffusion text-to-image models based on online policy distillation. Joint multi-task training suffers interference and imbalance, while cascaded training forgets earlier tasks. DiffusionOPD trains one teacher per task. It then distills them into a single student along the student's own rollouts. The authors lift the framework to continuous-state processes with a closed-form per-step objective, reporting lower-variance gradients and consistent wins over multi-reward and cascade baselines.
Catalog record
| CREATOR | Quanhao Li Junqiu Yu Kaixun Jiang Yujie Wei, Zhen Xing Pandeng Li Ruihang Chu Shiwei Zhang Yu Liu Zuxuan WuFudan University Wan Team, Alibaba Group [email protected] [email protected] Project page: https://quanhaol.github.io/DiffusionOPD-site/ |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36166 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.15055