DSH-Bench: A Difficulty- and Scenario-Aware Benchmark with Hierarchical Subject Taxonomy for Subject-Driven Text-to-Image Generation

Zhenyu Hu, Qing Wang ⋆, Te Cao ⋆, Luo Liao ⋆, Longfei Lu, Liqun Liu †, Shuang Li, Hang Chen, Mengge Xue ‡, Yuan Chen, Chao Deng, Peng Shu, Huan Yu, Jie Jiang · 2026

Read DSH-Bench: A Difficulty- and Scenario-Aware Benchmark with Hierarchical Subject Taxonomy for Subject-Driven Text-to-Image Generation by Zhenyu Hu, Qing Wang ⋆, Te Cao ⋆, Luo Liao ⋆, Longfei Lu, Liqun Liu †, Shuang Li, Hang Chen, Mengge Xue ‡, Yuan Chen, Chao Deng, Peng Shu, Huan Yu, Jie Jiang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08090.txt.

Description

Hu and colleagues build DSH-Bench, a benchmark for subject-driven text-to-image generation. Such models must render target subjects from user instructions. Current benchmarks fall short in three ways. Subject images lack diversity. Scores lack granularity across difficulty levels and prompt scenarios. Results give little guidance for fixing models. DSH-Bench answers with a hierarchical taxonomy covering 58 fine-grained categories. It also sorts both subject difficulty and prompt scenario. Its new Subject Identity Consistency Score tracks human judgment of subject preservation more closely than prior measures.

Catalog record

CREATORZhenyu Hu, Qing Wang ⋆, Te Cao ⋆, Luo Liao ⋆, Longfei Lu, Liqun Liu †, Shuang Li, Hang Chen, Mengge Xue ‡, Yuan Chen, Chao Deng, Peng Shu, Huan Yu, Jie Jiang
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE35472
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.08090

Browse the full library · About the Tower of Babel