Hidden Bias in the Machine: Stereotypes in Text-to-Image Models

Sedat Porikli Vedat PorikliCanyon Crest Academy {sedatporikli, vedatporikli}@gmail.com · 2025

Read Hidden Bias in the Machine: Stereotypes in Text-to-Image Models by Sedat Porikli Vedat PorikliCanyon Crest Academy {sedatporikli, vedatporikli}@gmail.com (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-13780.txt.

Introduction

Sedat Porikli and Vedat Porikli test bias in text-to-image models in a 2025 paper. Such models turn written prompts into pictures and are now widely used to create content. The team asked whether the images repeat social stereotypes about gender, race, age, and body type.

They wrote prompts across one hundred sixty topics, from jobs to family roles, with many variants each. Two leading models made more than sixteen thousand images under fixed settings. Eight thousand images from a web search served as a comparison set. Clear gaps appeared in who was shown for which role, often echoing harmful social patterns. The authors call for fairer training data and design habits.

Catalog record

CREATORSedat Porikli Vedat PorikliCanyon Crest Academy {sedatporikli, vedatporikli}@gmail.com
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE31 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-13780

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Hidden Bias in the Machine: Stereotypes in Text-to-Image Models Sedat Porikli Vedat PorikliCanyon Crest Academy {sedatporikli, vedatporikli}@gmail.com Abstract Text-to-Image (T2I) models have transformed visual content creation, producing highly realistic images from natural language prompts. However, concerns persist around their potential to replicate and magnify existing societal biases. To investigate these issues, we curated a diverse set of prompts spanning thematic categories such as occupations, traits, actions, ideologies, emotions, family roles, place descriptions, spirituality, and life events. For each of the 160 unique topics, we crafted multiple prompt variations to reflect a wide range of meanings and perspectives. Using Stable Diffusion 1.5 (UNet-based) and Flux-1 (DiT-based) models with original checkpoints, we generated over 16,000 images under consistent settings. Additionally, we collected 8,000 comparison images from Google Image Search. All outputs were filtered to exclude abstract, distorted, or nonsensical results. Our analysis reveals significant disparities in the representation of gender, race, age, somatotype, and other human-centric factors across generated images. These disparities often mirror and reinforce harmful stereotypes embedded in societal narratives. We discuss the implications of these findings and emphasize the need for more inclusive datasets and development practices to foster fairness in generative visual systems. 1 Introduction Recent advances in generative AI have given rise to Text-to-Image (T2I) models Rombach2022 ; Ramesh2022 ; Chen2023pixartalpha ; Betker2023 ; Flux ; Sauer2024 ; Zhang2024T2I , which have the power of realistic image generation from textual prompts. This technology is increasingly embedded into daily life with diverse and various applications Jaiprakash2025 . It facilitates the creation of educational content and demonstrates significant artistic capabilities, aids creative expression and assisting designers in visualizing concepts and generating digital artwork Wang2023 . In the retail sector, Text-to-Image (T2I) models enhance online shopping and digital marketing by generating customized and visually engaging content tailored to consumer preferences Surya2020 ; Postma2024 . In the field of interior design, these models streamline the creative workflow by enabling visualization of design concepts and supporting more efficient exploration of stylistic options Chen2023 . The entertainment industry also benefits, utilizing T2I models to accelerate processes such as movie story-boarding, concept art development, and the creation of assets for video games Li2019 . Additionally, T2I improves human-computer interaction by enabling cross-modal retrieval Gu2018 and facilitating accessibility for visually impaired individuals Zhang2022 . As AI-generated visual content becomes increasingly prevalent and harder to distinguish from real photographs, it is essential to critically examine the representations produced by text-to-image (T2I) models. Such models are trained on massive datasets like LAION Schuhmann2021 scraped from the web. However, using such datasets introduces the risk of systematic errors, as statistical biases from incomplete sampling and inaccurate annotations are compounded in the models. Previous research has shown that T2I models often exhibit social biases that can lead to representational harms and further marginalize minority groups Naik2023 ; Cho2023 . For example, a widely used model Rombach2022 generated mostly white males for high-income occupations, while dark-skinned men were depicted as inmates and dark-skinned women as low-income workers. Users unaware of these biases may unintentionally propagate them, further exacerbating the issue. Alarmingly, AI-generated images are already being used in political campaigns GOP2023 , potentially misleading the public before society adapts to this new technology. Generative bias not only perpetuates stereotypical portrayals but also limits the diversity of imagery produced Luccioni2023 . Some predict that 90% of internet content will be AI-generated within the next few years Europol2024 . If AI-generated images depicting amplified stereotypes contaminate the training data of future models, next-generation T2I models could become even more biased. We may soon reach a point where, unless visual content is corroborated by reliable sources, it will be safer to assume that it is AI-generated and potentially fabricated. Recognizing this issue, a growing body of recent research Wan2024survey ; Naik2023 ; Masrourisaadat2024 ; Chinchure2024 ; Cho2023 ; Shaw2025 has explored various dimensions of bias in T2I models. While much of the existing work has focused on biases related to gender, skin tone, and geocultural factors, there has been relatively limited exploration of biases in T2I models concerning other human-centric factors beyond the associations between certain professions and traits. In this paper, we aim to explore additional types of bias inherent in T2I models to guide more systematic approaches to AI governance. We expand on existing attribute categories of bias in generative models and investigate the outputs of T2I models when prompts are related to actions, emotions, ideologies, life events, family structures, religion, place descriptions, and life events, analyzing 24,000 images generated for a set of 160 prompt topics 1 1 1 We will release a benchmark of prompts used in our study. using three image sources: two popular T2I models (SD1.5 and Flux-1) and the Google image search engine. 2 Related Work Naik and Nushi Naik2023 were among the first to explore social biases in T2I models, focusing on how gender, age, race, and location influence the depiction of occupations, personality traits, and everyday situations. Their study revealed significant biases in occupational representations, which could be mitigated by using more specific prompts. It also highlighted that certain personality traits were predominantly associated with specific demographics and showed that images generated from location-neutral prompts often resembled countries like the U.S. and Germany. Building on this, Luccioni et al . Luccioni2023 examined how variations in gender and ethnicity markers in prompts affect the generated images. They found that T2I models reflected U.S. labor demographics but consistently underrepresented marginalized identities. In Cho2023 , Cho et al . analyzed social biases across diffusion- and transformer-based models, showing that T2I models learned biases related to gender and skin tone from web image-text pairs. Masrourisaadat Masrourisaadat2024 assessed several T2I models’ performance in generating images of human faces, groups, and objects, providing valuable insights into the models’ biases and limitations. Chinchure Chinchure2024 proposed using counterfactual reasoning to quantify biases, helping identify and measure their influence on generated images. Wan et al . Wan2024survey surveyed prior studies on gender, skin tone, and geocultural biases in T2I models, noting that existing evaluation methods and mitigation strategies are insufficient. Research has explored ways to improve T2I models through multilingual data Ye2024 ; Nguyen2024 and culturally aware interfaces Shaw2025 , encouraging diverse interpretations, capturing a broader range of perspectives, and highlighting the impact of cultural context on generated imagery. Despite this growing body of research, benchmarks and evaluation methods have varied significantly, highlighting the lack of a unified framework for measuring biases. Furthermore, existing mitigation strategies remain inadequate, failing to comprehensively address biases in T2I models. In our paper, we build on previous studies and focus on several underexplored bias categories to facilitate more effective mitigation strategies. 3 Method: Examining Inherent Biases 3.1 Experimental Setup To investigate biases in T2I models, we considered a wide spectrum of prompts covering various thematic groups: occupations, attributes and traits, actions, ideologies, emotions, family descriptions, place descriptions, depictions of spirituality, and life events. These prompts have been curated manually, representing a wide range of themes. We prepared up to 20 topics per category, resulting in 160 unique topics. For each topic, we assembled different prompts with diverse wording variations to capture a broad spectrum of meanings. We generated over 50 images per topic using random seeds, totaling

Read the complete text