DSH-Bench: A Difficulty- and Scenario-Aware Benchmark with Hierarchical Subject Taxonomy for Subject-Driven Text-to-Image Generation
Zhenyu Hu, Qing Wang ⋆, Te Cao ⋆, Luo Liao ⋆, Longfei Lu, Liqun Liu †, Shuang Li, Hang Chen, Mengge Xue ‡, Yuan Chen, Chao Deng, Peng Shu, Huan Yu, Jie Jiang · 2026
Read DSH-Bench: A Difficulty- and Scenario-Aware Benchmark with Hierarchical Subject Taxonomy for Subject-Driven Text-to-Image Generation by Zhenyu Hu, Qing Wang ⋆, Te Cao ⋆, Luo Liao ⋆, Longfei Lu, Liqun Liu †, Shuang Li, Hang Chen, Mengge Xue ‡, Yuan Chen, Chao Deng, Peng Shu, Huan Yu, Jie Jiang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-08090.txt.
Description
Hu and colleagues build DSH-Bench, a benchmark for subject-driven text-to-image generation. Such models must render target subjects from user instructions. Current benchmarks fall short in three ways. Subject images lack diversity. Scores lack granularity across difficulty levels and prompt scenarios. Results give little guidance for fixing models. DSH-Bench answers with a hierarchical taxonomy covering 58 fine-grained categories. It also sorts both subject difficulty and prompt scenario. Its new Subject Identity Consistency Score tracks human judgment of subject preservation more closely than prior measures.
Catalog record
| CREATOR | Zhenyu Hu, Qing Wang ⋆, Te Cao ⋆, Luo Liao ⋆, Longfei Lu, Liqun Liu †, Shuang Li, Hang Chen, Mengge Xue ‡, Yuan Chen, Chao Deng, Peng Shu, Huan Yu, Jie Jiang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 35472 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.08090