The Case for “Thick Evaluations” of Cultural Representation in AI

Rida Qadri, Mark Díaz, Ding Wang, Michael Madaio · 2025

Read The Case for “Thick Evaluations” of Cultural Representation in AI by Rida Qadri, Mark Díaz, Ding Wang, Michael Madaio (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-19075.txt.

Introduction

Rida Qadri and co-authors argue that AI systems need thicker tests of how they portray cultures. Their 2025 paper critiques current evaluations of image models for non-Western representation. Such tests, they say, grade outputs against thin ideals cut loose from how people themselves define fair portrayal.

Their framework grows out of workshops in South Asia. Participants studied AI images of their own cultures and explained what the pictures got right, missed, or distorted. Those readings are rich, situated, and open to debate, nothing like a single score. The authors propose building measures with communities rather than for them. Thick evaluation, in their telling, treats representation as a living judgment that only insiders can ground.

Catalog record

CREATORRida Qadri, Mark Díaz, Ding Wang, Michael Madaio
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE67 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-19075

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Case for “Thick Evaluations” of Cultural Representation in AI Rida Qadri, Mark Díaz, Ding Wang, Michael Madaio Abstract Generative AI model outputs have been increasingly evaluated for their (in)ability to represent non-Western cultures. We argue that these evaluations often operate through reductive ideals of representation, abstracted from how people define their own representation and neglecting the inherently interpretive and contextual nature of cultural representation. In contrast to these ‘thin’ evaluations, we introduce the idea of ‘thick evaluations’ : a more granular, situated, and discursive measurement framework for evaluating representations of social worlds in AI outputs, steeped in communities’ own understandings of representation. We develop this evaluation framework through workshops in South Asia, by studying the ‘thick’ ways in which people interpret and assign meaning to AI-generated images of their own cultures. We introduce practices for thicker evaluations of representation that expand the understanding of representation underpinning AI evaluations and by co-constructing metrics with communities, bringing measurement in line with the experiences of communities on the ground. Google Research [email protected], [email protected], [email protected], [email protected] Introduction Generative AI (genAI) models, despite their popularity, have been shown to fail at inclusively representing different cultures in generated outputs—including images ( Qadri et al. 2023 ; Mim et al. 2024 ; Mack et al. 2024 ) and text ( Wang et al. 2024b ; Pawar et al. 2024 ; Singh et al. 2024 ; Myung et al. 2025 ; Khanuja et al. 2021 ) —much like failures of representation in other AI systems ( Katzman et al. 2023 ; Chien and Danks 2024 ; Wang et al. 2024a ; Kay et al. 2015 ; Shelby et al. 2023 ; Crawford 2017 , e.g.,) . To address these gaps, prior work has sought to evaluate the cultural representations in AI-generated output, but with few exceptions ( Ghosh 2024 ; Qadri et al. 2023 , e.g.,) , mostly through quantified, metricized approaches to representation such as statistical similarities and benchmark-style scoring ( Zhang et al. 2024 ; Li et al. 2024 ) . The use of these methods presumes that representation is an objective construct with a quantifiable, definitive ground truth that outputs can be compared against ( Kannen et al. 2024 ; Zhang et al. 2024 , e.g.,) ( Muller et al. 2021 , for a critique of ground truth, see) . Given limitations of computational methods, representation is reduced to evaluations of basic recognition or factual generation of artifacts. When human feedback on representation is sought, it is often solicited through narrow, constrained, quantitative scales from crowdworkers who may not have the lived experiences to evaluate nuances of content’s varied meanings to different social groups ( Díaz et al. 2022 ) . However, this approach to measuring representation is in contravention to decades of scholarship in the social sciences that emphasizes the subjective nature of representation, where judgments about representation in visual media are constructed in conversation with the viewer’s lived experiences and the broader context within which an image is viewed and published. ( Hall 1989 ; Hall 1997 ) . In addition, the categories many AI researchers use for evaluations are often abstracted from the experiences of communities, constructed by AI researchers without engaging with communities to understand what axes of representation might be salient in their contexts. For instance, while many representational evaluations focus on skin tone, skin tone might not be a salient category of differentiation for social groups in many cultures. Thus, while existing approaches to evaluating representation in AI/ML might be useful for evaluating the accuracy of visual depictions of the physical world, they may not allow us to engage with communities’ diverse desires for representations of their social worlds . As generative image models increasingly are used to represent social worlds, what new evaluation approaches are necessary to meaningfully account for the diverse ways that people interpret and evaluate cultural representation in AI? We argue that effectively evaluating cultural representation in AI images requires ‘thick evaluations’ —a more granular, situated, discursively constructed approach to measurement, steeped in communities’ own understanding of appropriate cultural representation. Our analysis draws on the ‘thick vs thin’ dichotomy introduced by philosopher Gilbert Ryle (1968) , later taken on by Clifford Geertz (2008) and others ( Ortner 1995 ; Love 2013 ; Jackson 2013 ; Riles 2000 ; Nelson 2023a ; Nelson 2023b ) to characterize descriptions of social worlds. Ryle’s classic example of a wink illustrates this distinction: a ‘thin description’ merely describes the physical act of closing one eye by focusing on observable details, while a ‘thick description’ unpacks the social meaning of the act and its significance as a signal to interlocutors. Seen through this framework, emerging methods for evaluating cultural representation in AI images involve ‘thin evaluations’; i.e., suited to evaluating the observable aspects of the physical world contained in AI-generated images, but not necessarily the social signals embedded in those physical depictions. To develop a ‘thick evaluation’ approach for cultural representation in AI images, we turned to the communities represented in images we seek to evaluate, recognizing their expertise and stakes in visual representations of their cultures. Given prior work on AI’s failures of representation for South Asian cultures ( Qadri et al. 2023 ; Ghosh et al. 2024b , e.g.,) , we conducted workshops with 37 participants in 3 South Asian countries to study the culturally-situated ways people assign meaning to, interpret, and evaluate the representation of their cultures in AI-generated images. We find that 1) people evaluate representation of social worlds not just through a singular category such as accuracy, but through multi-dimensional, fine-grained axes; 2) people’s goals for evaluating cultural representation are situated in their social context, negotiated through dialogue with others and in response to broader societal discourse about their cultures; and 3) people use situated social knowledge of and experiences with social worlds to evaluate varying social meanings of images. These findings demonstrate that thin evaluations alone cannot measure thick constructs like cultural representation, and they raise critical questions about the adequacy of existing evaluation paradigms for measuring cultural representation in AI images. As new methods and standards are being created for AI evaluations, this is a crucial moment to call for a thicker AI evaluation practice that reflexively interrogates epistemological underpinnings of AI evaluation practices, fundamentally rethinks whose expertise is included in the evaluation of AI systems, and opens up space for more interpretive qualitative evaluation methods. We provide pathways for such thickness by showing how AI researchers can interrogate the construct of cultural representation and the ways that that unobservable construct is operationalized in evaluation methods ( Jacobs and Wallach 2021 , cf.) . We provide empirical data on varied categories of representation people might evaluate images for, which shows the need for co-constructing evaluation methods with members of communities whose culture is being represented, to bring measurement in line with their experiences of AI images. We thus help AI practice move towards an ecosystem of both ‘thick’ and ‘thin’ evaluations, encouraging congruence between the construct being evaluated and the evaluation methods used. As AI technology is entering into the space of cultural production, our work suggests the need to develop new, thicker forms of evaluations of cultural representation, to better reflect

Read the complete text