A Survey on Pre-Trained Diffusion Model Distillations

Xuhui Fan, Zhangkai Wu, Hongyu Wu, Longbing Cao · 2025

Read A Survey on Pre-Trained Diffusion Model Distillations by Xuhui Fan, Zhangkai Wu, Hongyu Wu, Longbing Cao (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-08364.txt.

Description

Xuhui Fan, Zhangkai Wu, and Hongyu Wu organize the tricks for shrinking image generators. Their 2025 survey covers distillation of pre-trained diffusion models, the engines behind text-to-image tools, which are heavy to store and slow to run because each picture takes many passes.

The survey sorts methods into three families. Output loss distillation teaches a small model to match the big one's results. Trajectory distillation compresses the whole path a sample travels. Adversarial distillation adds a critic to keep quality honest. Together they yield compact models that generate in a few steps on modest hardware. The authors map where each family shines, then close with open challenges and directions for the next round of work.

Catalog record

CREATORXuhui Fan, Zhangkai Wu, Hongyu Wu, Longbing Cao
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE49 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-08364

Browse the full library · About the Tower of Babel