DiffSim: Taming Diffusion Models for Evaluating Visual Similarity

Yiren Song, Xiaokang Liu, Mike Zheng Shou · 2024

Read DiffSim: Taming Diffusion Models for Evaluating Visual Similarity by Yiren Song, Xiaokang Liu, Mike Zheng Shou (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2412-14580.txt.

Description

Yiren Song, Xiaokang Liu, and Mike Zheng Shou present a way to judge how similar two images look, using a diffusion model, in a paper from 2024. Standard scores compare pixels and textures but miss layout, pose, and meaning. Other learned scores squeeze images so hard that fine appearance detail is lost.

Their method reads features inside the attention layers of a pretrained diffusion model. It scores both appearance and style likeness, and it matched human taste better than prior scores. The team also built two new benchmarks, one for style match and one for instance match. Across many tests, their method reached top performance, which they offer as a tool for judging custom image generation.

Catalog record

CREATORYiren Song, Xiaokang Liu, Mike Zheng Shou
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2412-14580

Browse the full library · About the Tower of Babel