Beyond Overcorrection: Evaluating Diversity in T2I Models with DivBench

Felix Friedrich, Thiemo Ganesha Welsch, Manuel Brack, Patrick Schramowski hidd Kristian Kersting · 2025

Read Beyond Overcorrection: Evaluating Diversity in T2I Models with DivBench by Felix Friedrich, Thiemo Ganesha Welsch, Manuel Brack, Patrick Schramowski hidd Kristian Kersting (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-03015.txt.

Introduction

Felix Friedrich and four co-authors introduced a benchmark in twenty twenty-five for checking diversity in text-to-image AI models. Efforts to widen the range of people shown in generated images can overshoot. A model may change a person's traits even when the prompt states them plainly, trading accuracy for diversity. Their framework, DivBench, measures both too little and too much diversity.

Testing leading image models, they found most show a narrow range of people by default. Many diversity fixes then overcorrect, altering traits the prompt had fixed. Methods that respect context did better. Guiding the model with a language model, or rewriting the prompt with care, raised diversity while keeping stated traits intact. The work offers a balanced yardstick for fair image generation.

Catalog record

CREATORFelix Friedrich, Thiemo Ganesha Welsch, Manuel Brack, Patrick Schramowski hidd Kristian Kersting
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE21 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-03015

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Beyond Overcorrection: Evaluating Diversity in T2I Models with DivBench Felix Friedrich, Thiemo Ganesha Welsch, Manuel Brack, Patrick Schramowski hidd Kristian Kersting Abstract Current diversification strategies for text-to-image (T2I) models often ignore contextual appropriateness, leading to over-diversification where demographic attributes are modified even when explicitly specified in prompts. This paper introduces DivBench , a benchmark and evaluation framework for measuring both under- and over-diversification in T2I generation. Through systematic evaluation of state-of-the-art T2I models, we find that while most models exhibit limited diversity, many diversification approaches overcorrect by inappropriately altering contextually-specified attributes. We demonstrate that context-aware methods, particularly LLM-guided FairDiffusion and prompt rewriting, can already effectively address under-diversity while avoiding over-diversification, achieving a better balance between representation and semantic fidelity. 1 1 1 We publicly release our data and code at anony.mous . 1 Introduction On February 23, 2024, Google temporarily suspended image generation on its Gemini platform following criticism of historically inaccurate outputs from its Imagen3 model [ 10 ] . Designed to promote demographic diversity, the model produced inappropriate results, such as racially diverse portrayals of Wehrmacht soldiers and Vikings, or female Popes [ 6 ] , undermining factual accuracy and user trust. Efforts to recalibrate the system led to excessive filtering, flagging even harmless prompts, and underscored the difficulty of balancing ethical representation with historical and contextual accuracy [ 8 ] . This incident illustrates a broader challenge within text-to-image (T2I) systems: while diversification techniques have improved demographic representation in appropriate contexts [ 16 , 11 , 7 , 15 ] —such as increasing the occurrence of female doctors or CEOs with diverse racial appearance—they struggle to balance diverse representation with contextual appropriateness. Current diversification approaches for T2I models can be broadly categorized into post-hoc guidance methods and fine-tuning strategies. Post-hoc methods like FairDiffusion [ 7 ] introduce FairGuidance, which adjusts demographic imbalances in generated images by guiding toward semantic attributes during inference. Fine-tuning approaches such as those by Shen et al. 2024 frame fairness as a distributional alignment issue, proposing a distributional alignment loss to nudge demographic traits toward target distributions while maintaining semantic accuracy. While both approaches effectively reduce demographic bias in professional contexts and can manage multiple attributes simultaneously, they tend to over-diversify when applied to prompts where diversity may not be contextually appropriate. Figure 1 : DivBench methodology. Items with potential group-attribute associations are systematically verified against trusted sources, then categorized into assigned and unassigned groups to create a comprehensive diversity evaluation benchmark. Despite growing interest in AI ethics, there remains a lack of systematic tools for evaluating and guiding diversity in T2I models. This work addresses that gap by proposing evaluation methods and design principles for context-aware image generation. In summary, our contributions are fourfold: (i) we propose DivBench , a novel benchmark to assess over- and under-diversity in image generation models; (ii) we introduce new metrics specifically designed to quantify these forms of diversity; (iii) we apply our benchmark to evaluate the diversity of state-of-the-art models; and (iv) we explore context-aware diversification strategies that balance representation with semantic fidelity. Disclaimer: This research evaluates image generation models for diversity by measuring over- and under-representation with a benchmark across demographic groups defined by single protected attributes (e.g., Pope as male, actress as female, Maharaja as Indian) based on linguistic analysis and established sources such as Wikidata and Wikipedia . We acknowledge that these operational definitions represent only one possible categorization among many valid alternatives and that identity is multifaceted, intersectional, and cannot be reduced to single attributes. These simplified definitions serve exclusively as methodological tools for detecting systematic bias patterns in AI-generated imagery, not as normative statements about how groups should be understood, and we recognize the limitations of categorical approaches to measuring diversity in AI systems. 2 Measuring Diversity in T2I Generation. The contribution of this section is threefold. We start by introducing our novel benchmark, DivBench , and then introduce novel metrics to measure over- and under-diversity. Then, we present various diversification techniques. 2.1 DivBench To systematically evaluate T2I models for both under- and over-diversification, we created a specialized benchmark dataset, called DivBench . It assesses whether models generate appropriate demographic diversity based on the given group in the prompt. We describe the overall setup in Fig. 1 . We manually collected and annotated samples, divided into two main categories: (i) examples without assigned demographic attributes (e.g., “farmer” or “housekeeper”), which test whether models naturally reflect inclusive and diverse outputs, and (ii) examples with clearly defined demographic constraints (e.g., “actress” or “Maasai person”), which test whether models introduce inappropriate or historically inaccurate diversity, referred to as over-diversity. To ensure correctness and consistency, demographic attribute assignments were fact-checked using reliable external sources such as Wikipedia and Wikidata. We illustrate how to obtain such results with SPARQL from Wikidata in App. Fig. 4 . Demographic assignments fall into four categories: (i) examples with no assignment, where full diversity is expected; (ii) examples that inherently (linguistically) imply attributes (e.g., “actress” defined as a female actor/performer); (iii) institutional or historical rules (e.g., only baptized male persons can become pope); and (iv) examples referencing well-documented groups where missing attributes can be reasonably excluded (e.g., no female US presidents). The full annotated dataset of 60 examples comprises 20 examples with unassigned attributes, 20 with assigned gender, and 20 with assigned race. The full benchmark is depicted in App. Tab. 2 . We deliberately adopted a depth-over-breadth approach, prioritizing consistency and correctness in our annotations over dataset size to ensure reliable evaluation. This structure allowed for identifying both under-diversification (unassigned samples showing a lack of expected diversity) and over-diversification (assigned samples showing inaccurate diversity). 2.2 Metrics for Evaluating Diversity Evaluating over- and under-diversity in image generation models requires well-suited metrics, which we will introduce in the following. We introduce task-specific Precision, Recall, and F1 scores to assess diversity in image generation models and the effectiveness of diversification approaches. Precision measures the percentage of correctly predicted classes in all predicted classes. A high precision value indicates that there is no over-diversification. \text{Precision}=\frac{\#correct\_labels}{\#predicted\_labels} Recall indicates the percentage of correctly identified attributes in all actually possible attributes. A high recall value indicates that there is no under-diversification. \text{Recall}=\frac{\#correct\_labels}{\#true\_labels} F1 is the harmonic mean of Precision and Recall and thus provides a balanced measure of model performance in terms of over- and under-diversity. \text{F1}=2\times\frac{\text{Precision}\times\text{Recall}}{\text{Precision}+\text{Recall}} 2.3 Diversification Strategies To address both under- and over-diversification in image generation, we propose and evaluate three diversification strategies that operate at different levels of contextual awareness. Random Attribute Steering. Our first approach builds on FairDiffusion [ 7 ] , a steering and guidance method for T2I models. We implement a simplified version that randomly applies attribute steering regardless of prompt content. For instance, we randomly guide with gender terms (+“male” or +“female”) with equal probability during generation, aiming to achieve balanced gender representation across all outputs. We apply the same random sampling approach to racial attributes. While this method effectively increases representation diversity, it suffers from a critical limitation: it lacks prompt awareness. This approach may appropriately diversify unassigned prompts (like CEO) but can inappropriately alter prompts that already contain specific demographic information (like pope), leading to over-diversification and semantic inconsistencies. Figure 2 : Performance of T2I models

Read the complete text