Evaluating AI-Generated Images of Cultural Artifacts with Community-Informed Rubrics
Nari Johnson, Deepthi Sudharsan, Hamna, Samantha Dalal, Theo Holroyd, Anja Thieme, Hoda Heidari, Daniela Massiceti, Jennifer Wortman Vaughan, Cecily Morrison · 2026
Read Evaluating AI-Generated Images of Cultural Artifacts with Community-Informed Rubrics by Nari Johnson, Deepthi Sudharsan, Hamna, Samantha Dalal, Theo Holroyd, Anja Thieme, Hoda Heidari, Daniela Massiceti, Jennifer Wortman Vaughan, Cecily Morrison (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-02406.txt.
Description
Johnson and team involve communities in defining cultural fit for AI images of artifacts. Auto checks can miss the expertise of impacted groups, so the team puts community input first, in the concept making phase, before building tests. Case studies with blind and low vision people in the UK, people in Kerala and Tamil Nadu yield defined concepts rooted in lived experience and depiction tastes. The concepts can feed auto tests via a language model judge approach, with benefits and limits discussed.
Catalog record
| CREATOR | Nari Johnson, Deepthi Sudharsan, Hamna, Samantha Dalal, Theo Holroyd, Anja Thieme, Hoda Heidari, Daniela Massiceti, Jennifer Wortman Vaughan, Cecily Morrison |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 148039 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.02406