Towards Evaluating Robustness of Prompt Adherence in Text to Image Models

Sujith Vemishetty Synechron [email protected] [email protected] Advitiya Arora Synechron [email protected] [email protected] Anupama Sharma † [email protected] · 2025

Read Towards Evaluating Robustness of Prompt Adherence in Text to Image Models by Sujith Vemishetty Synechron [email protected] [email protected] Advitiya Arora Synechron [email protected] [email protected] Anupama Sharma † [email protected] (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-08039.txt.

Description

The authors test how well image generators follow their text prompts in a paper from 2025. Three authors are named in the head byline: Vemishetty, Arora, and Sharma. Their framework builds a data set where each prompt varies two simple factors, such as a shape and its position, then checks whether the output image keeps those factors.

Five models were tested, spanning two Stable Diffusion versions and two Janus sizes. A captioning model described both the source and the generated images so the two could be compared. Even on simple two-factor images the models often drifted from the prompt. Pre-trained encoders also failed to match the data spread.

Catalog record

CREATORSujith Vemishetty Synechron [email protected] [email protected] Advitiya Arora Synechron [email protected] [email protected] Anupama Sharma † [email protected]
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-08039

Browse the full library · About the Tower of Babel