Inference-Time Diffusion Model Distillation
Geon Yeong Park, Sang Wan Lee, Jong Chul Ye · 2024
Read Inference-Time Diffusion Model Distillation by Geon Yeong Park, Sang Wan Lee, Jong Chul Ye (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-08871.txt.
Description
Geon Yeong Park, Sang Wan Lee, and Jong Chul Ye speed up image-making models that work in few steps. Diffusion models build images by clearing noise step by step, and distilled models compress that path. The compressed models still lag the full ones, and errors pile up across steps. Their method adds teacher guidance during sampling itself, with no new data or retraining.
Sampling is recast as a search that stays close to the student's path while a teacher score pulls it toward clean images. Gains over top distilled rivals were large, above all in early steps. The authors frame the method as guided sampling built for distilled models. Code is posted online for others to test and extend.
Catalog record
| CREATOR | Geon Yeong Park, Sang Wan Lee, Jong Chul Ye |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 48 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-08871