Evaluating AI-Generated Images of Cultural Artifacts with Community-Informed Rubrics

Nari Johnson, Deepthi Sudharsan, Hamna, Samantha Dalal, Theo Holroyd, Anja Thieme, Hoda Heidari, Daniela Massiceti, Jennifer Wortman Vaughan, Cecily Morrison · 2026

Read Evaluating AI-Generated Images of Cultural Artifacts with Community-Informed Rubrics by Nari Johnson, Deepthi Sudharsan, Hamna, Samantha Dalal, Theo Holroyd, Anja Thieme, Hoda Heidari, Daniela Massiceti, Jennifer Wortman Vaughan, Cecily Morrison (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-02406.txt.

Description

Johnson and team involve communities in defining cultural fit for AI images of artifacts. Auto checks can miss the expertise of impacted groups, so the team puts community input first, in the concept making phase, before building tests. Case studies with blind and low vision people in the UK, people in Kerala and Tamil Nadu yield defined concepts rooted in lived experience and depiction tastes. The concepts can feed auto tests via a language model judge approach, with benefits and limits discussed.

Catalog record

CREATORNari Johnson, Deepthi Sudharsan, Hamna, Samantha Dalal, Theo Holroyd, Anja Thieme, Hoda Heidari, Daniela Massiceti, Jennifer Wortman Vaughan, Cecily Morrison
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE148039
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.02406

Browse the full library · About the Tower of Babel