Towards Evaluating Robustness of Prompt Adherence in Text to Image Models
Sujith Vemishetty Synechron [email protected] [email protected] Advitiya Arora Synechron [email protected] [email protected] Anupama Sharma † [email protected] · 2025
Read Towards Evaluating Robustness of Prompt Adherence in Text to Image Models by Sujith Vemishetty Synechron [email protected] [email protected] Advitiya Arora Synechron [email protected] [email protected] Anupama Sharma † [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-08039.txt.
Description
The authors test how well image generators follow their text prompts in a paper from 2025. Three authors are named in the head byline: Vemishetty, Arora, and Sharma. Their framework builds a data set where each prompt varies two simple factors, such as a shape and its position, then checks whether the output image keeps those factors.
Five models were tested, spanning two Stable Diffusion versions and two Janus sizes. A captioning model described both the source and the generated images so the two could be compared. Even on simple two-factor images the models often drifted from the prompt. Pre-trained encoders also failed to match the data spread.
Catalog record
| CREATOR | Sujith Vemishetty Synechron [email protected] [email protected] Advitiya Arora Synechron [email protected] [email protected] Anupama Sharma † [email protected] |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2507-08039