Bias Amplification in Stable Diffusion’s Representation of Stigma Through Skin Tones and Their Homogeneity
Kyra Wilson, Sourojit Ghosh, Aylin Caliskan · 2025
Read Bias Amplification in Stable Diffusion’s Representation of Stigma Through Skin Tones and Their Homogeneity by Kyra Wilson, Sourojit Ghosh, Aylin Caliskan (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2508-17465.txt.
Introduction
Kyra Wilson, Sourojit Ghosh, and Aylin Caliskan measure how three versions of a popular image generator tie stigmatized identities to skin tone, in work from twenty twenty-five. Text to image tools can harden social stereotypes. The team tested ninety-three stigmatized identities across the model versions.
The newest and largest model drew stigmatized people with notably darker, less red skin tones than older versions. Its skin tones also varied far less, both against older models and against real face data sets. Most stigmatized identities came out less diverse than non stigmatized ones. Racial and ethnic identities were flattened most of all. Since users favor the newest model, the authors warn of growing representational harm.
Catalog record
| CREATOR | Kyra Wilson, Sourojit Ghosh, Aylin Caliskan |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 51 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2508-17465
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Bias Amplification in Stable Diffusion’s Representation of Stigma Through Skin Tones and Their Homogeneity Kyra Wilson, Sourojit Ghosh, Aylin Caliskan Abstract Text-to-image generators (T2Is) are liable to produce images that perpetuate social stereotypes, especially in regards to race or skin tone. We use a comprehensive set of 93 stigmatized identities to determine that three versions of Stable Diffusion (v1.5, v2.1, and XL) systematically associate stigmatized identities with certain skin tones in generated images. We find that SD XL produces skin tones that are 13.53% darker and 23.76% less red (both of which indicate higher likelihood of societal discrimination) than previous models and perpetuate societal stereotypes associating people of color with stigmatized identities. SD XL also shows approximately 30% less variability in skin tones when compared to previous models and 18.89-56.06% compared to human face datasets. Measuring variability through metrics which directly correspond to human perception suggest a similar pattern, where SD XL shows the least amount of variability in skin tones of people with stigmatized identities and depicts most (60.29%) stigmatized identities as being less diverse than non-stigmatized identities. Finally, SD shows more homogenization of skin tones of racial and ethnic identities compared to other stigmatized or non-stigmatized identities, reinforcing incorrect equivalence of biologically-determined skin tone and socially-constructed racial and ethnic identity. Because SD XL is the largest and most complex model and users prefer its generations compared to other models examined in this study, these findings have implications for the dynamics of bias amplification in T2Is, increasing representational harms and challenges generating diverse images depicting people with stigmatized identities. Code and Data — https://github.com/kyrawilson/Image-Generation-Bias Extended version — https://arxiv.org/a/wilson˙k˙1 1 Introduction The introduction of text-to-image generators (T2Is) has elicited excitement from artificial intelligence (AI) researchers and the general public alike due to their ability to produce original images using only natural language prompts. However, these images have also caused controversy around how people are represented, often in response to their apparent skin tone, which can have an interrelated relationship with other stereotypes and stigmas, leading to unique social categorizations, perceptions, and harms that cannot be reduced to one factor ( Kang and Bodenhausen 2015 ) . Studying skin tone in the context of colorism, a widely observed form of prejudice or discrimination, in conjunction with stigmatized identities (defined by Pachankis et al. 2018 as “traits that are devalued in a particular social context serving to reduce an individual from a whole and usual person to a tainted, discounted one”) is therefore essential to understanding how T2Is represent these groups. Recent public gaffes in which skin tone and other identities/traits have been incorrectly linked exemplify these issues. Image generation capabilities were suspended in the Gemini chatbot after it produced factually incorrect images of 1943-era German soldiers with dark skin tones ( Grant 2024 ) . A separate investigation into T2Is Midjourney, DALL-E, and Stable Diffusion (SD) revealed that when depicting “a beautiful woman” only 9% of images show subjects with dark skin tones ( Tiku and Yu Chen 2024 ) . These are typically representational harms , where depictions of people with particular identities erase the existence of certain groups in society or paint them in unfavorable or demeaning ways ( Blodgett et al. 2020 ) . For example, the association of dark skin tones with being “a poor person,” identified by Bianchi et al. 2023 , reinforces stereotypes about the wealth of people with dark skin tones and appearances of poor people. Representational harms and stereotypes are especially damaging for those with stigmatized identities because the outcomes they experience may depend on their ability to conceal visible markers of their stigma in addition to having worse health or economic well-being compared to their non-stigmatized counterparts ( Pachankis et al. 2018 ) . Because skin color is a feature which is also linked to health and economic outcomes, itself stigmatized, and difficult to conceal ( Keyes, Small, and Nikolova 2020 ) , analyzing how T2Is represent skin tone in conjunction with stigmatized identities is an important step towards preventing representational harms from T2I outputs. Early research into SDv1.5 and SDv2.1 by Fraser, Kiritchenko, and Nejadgholi 2023 and Ghosh and Caliskan 2023 has shown how depictions of human faces frequently default to light skin tones, but this is less well studied in the context of other stigmatized identities, across multiple models, or using dimensions of skin tone other than lightness/darkness. Branigan et al. 2023 find that not only are people able to perceive whether skin tones have more or less red/yellow in their skin tones in addition to differences in lightness/darkness, but also that people with yellower skin tones are more likely to experience discrimination. Therefore, it is an open question regarding whether successive releases of models improve their representations of people with stigmatized identities with respect to both the lightness/darkness and the yellowness/redness of their skin tones. We conduct the first large-scale investigation of representations of people with stigmatized identities by T2Is, especially their skin tone, with three different versions of SD: v1.5, v2.1, and XL. SD XL makes significant changes to previous versions by increasing the number of parameters and introducing new data augmentation strategies, which have the potential to amplify biases and decrease performance in minority cases (those which diverge from the items seen most frequently during training) ( Shumailov et al. 2024 ; D’Incà et al. 2024 ) . Skin tone bias can manifest in many intersecting ways—for example, systematically associating particular skin tones with stigmatized identities ( Bianchi et al. 2023 ) , representing skin tones of those with stigmatized identities differently from those without stigmatized identities ( Ghosh and Caliskan 2023 ) , or depicting some stigmatized groups has having more uniform skin tones than others ( Lee and Jeon 2024 ) . In this work, we use “bias” to encompass all of these in order to capture the variety of ways people can experience representational harm from synthetic images. We study a comprehensive taxonomy of 93 stigmatized identities, including those related to ethnicity, disease, disability, drug use, education, mental illness, physical traits, profession, religion, sexuality, socioeconomic status, and more shown in Table 2 ( Pachankis et al. 2018 ) . We analyze multidimensional skin tone in conjunction with stigmatized identities, following computational methods introduced by Thong, Joniak, and Xiang 2023 to measure skin tone in images. Complex cognitive interactions exist between salient features like skin tone and stigmatized identities, and analyzing these together can reveal patterns which do not exist in isolation ( Freeman and Ambady 2011 ; Kang and Bodenhausen 2015 ) . We make four novel contributions and will release code and data upon publication: 1. We conduct the largest analysis of stigma depiction within T2I outputs by examining the skin tones of individuals with stigmatized identities. We find that skin tones of these identities are 29.81% less differentiable and 21.36% darker when depicted by SD XL compared to SD v1.5, thus demonstrating how newer versions of SD generate images which more strongly associate people of color with stigmatized identities. To our knowledge, this is the first study of its kind demonstrating such decline in performance and potential worsening of societal impact across model iterations for depictions stigmatized of stigmatized identities, at scale.