A Survey on Pre-Trained Diffusion Model Distillations
Xuhui Fan, Zhangkai Wu, Hongyu Wu, Longbing Cao · 2025
Read A Survey on Pre-Trained Diffusion Model Distillations by Xuhui Fan, Zhangkai Wu, Hongyu Wu, Longbing Cao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-08364.txt.
Description
Xuhui Fan, Zhangkai Wu, and Hongyu Wu organize the tricks for shrinking image generators. Their 2025 survey covers distillation of pre-trained diffusion models, the engines behind text-to-image tools, which are heavy to store and slow to run because each picture takes many passes.
The survey sorts methods into three families. Output loss distillation teaches a small model to match the big one's results. Trajectory distillation compresses the whole path a sample travels. Adversarial distillation adds a critic to keep quality honest. Together they yield compact models that generate in a few steps on modest hardware. The authors map where each family shines, then close with open challenges and directions for the next round of work.
Catalog record
| CREATOR | Xuhui Fan, Zhangkai Wu, Hongyu Wu, Longbing Cao |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-08364