A Study in Dataset Distillation for Image Super-Resolution

Tobias Dietz, Brian B. Moser, Tobias Nauen, Federico Raue, Stanislav Frolov, Andreas Dengel · 2025

Read A Study in Dataset Distillation for Image Super-Resolution by Tobias Dietz, Brian B. Moser, Tobias Nauen, Federico Raue, Stanislav Frolov, Andreas Dengel (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-03656.txt.

Description

Tobias Dietz and five co-authors run the first systematic test of dataset distillation for image super-resolution, in a paper from 2025. Distillation squeezes a big dataset into a tiny synthetic one that trains models almost as well. The trick was proven for classification but untried for restoring fine image detail.

Both pixel-space and latent-space versions were evaluated. A distilled set under nine percent of the original size trained upscalers with nearly the same fidelity as full data. Starting points and training objectives strongly shaped efficiency, convergence, and visual quality. The results open a path to cheaper training for restoration models.

Catalog record

CREATORTobias Dietz, Brian B. Moser, Tobias Nauen, Federico Raue, Stanislav Frolov, Andreas Dengel
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-03656

Browse the full library · About the Tower of Babel