T2I-FineEval: Fine-Grained Compositional Metric for Text-to-Image Evaluation
Seyed Mohammad Hadi Hosseini, Amir Mohammad Izadi, Ali Abdollahi, Mahdieh Soleymani Baghshah · 2025
Read T2I-FineEval: Fine-Grained Compositional Metric for Text-to-Image Evaluation by Seyed Mohammad Hadi Hosseini, Amir Mohammad Izadi, Ali Abdollahi, Mahdieh Soleymani Baghshah (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-11481.txt.
Description
Hosseini and co-authors propose a sharper yardstick for text-to-image generators. Their 2025 paper notes that today's models still fumble composed prompts: tying the right color to the right object, or placing things in the right spatial relation. Popular scores such as CLIPScore barely notice those failures. Question-based metrics help, by asking a visual question system about pieces of the prompt, yet they still miss much of the composition.
Their metric, T2I-FineEval, goes finer on both sides. The prompt is broken into detailed questions, and the image is broken into components, so each part of the scene is checked against each part of the text. Against earlier state-of-the-art metrics, the new one agrees better with human judgment. The authors release the code, and frame the work as a step toward honest grading of generative models.
Catalog record
| CREATOR | Seyed Mohammad Hadi Hosseini, Amir Mohammad Izadi, Ali Abdollahi, Mahdieh Soleymani Baghshah |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 18 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2503-11481