DiffSim: Taming Diffusion Models for Evaluating Visual Similarity
Yiren Song, Xiaokang Liu, Mike Zheng Shou · 2024
Read DiffSim: Taming Diffusion Models for Evaluating Visual Similarity by Yiren Song, Xiaokang Liu, Mike Zheng Shou (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-14580.txt.
Description
Yiren Song, Xiaokang Liu, and Mike Zheng Shou present a way to judge how similar two images look, using a diffusion model, in a paper from 2024. Standard scores compare pixels and textures but miss layout, pose, and meaning. Other learned scores squeeze images so hard that fine appearance detail is lost.
Their method reads features inside the attention layers of a pretrained diffusion model. It scores both appearance and style likeness, and it matched human taste better than prior scores. The team also built two new benchmarks, one for style match and one for instance match. Across many tests, their method reached top performance, which they offer as a tool for judging custom image generation.
Catalog record
| CREATOR | Yiren Song, Xiaokang Liu, Mike Zheng Shou |
|---|---|
| YEAR | 2024 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 42 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2412-14580