Stereotype Detection as a Catalyst for Enhanced Bias Detection: A Multi-Task Learning Approach

Aditya Tomar, Rudra Murthy, Pushpak Bhattacharyya · 2025

Read Stereotype Detection as a Catalyst for Enhanced Bias Detection: A Multi-Task Learning Approach by Aditya Tomar, Rudra Murthy, Pushpak Bhattacharyya (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2507-01715.txt.

Introduction

Aditya Tomar, Rudra Murthy, and Pushpak Bhattacharyya (2025) show that teaching a model to spot stereotypes makes it better at spotting bias. The two harms overlap in language models, especially in moderation and decision systems. The team built StereoBias, a dataset labeled for both bias and stereotypes across religion, gender, class, race, profession, and other categories. Experiments compared encoder-only models with fine-tuned decoder models trained efficiently by QLoRA.

Joint training on both tasks improved bias detection clearly over training each task alone. A control experiment with sentiment analysis confirmed the gain comes from the real kinship between bias and stereotypes, not from multi-task training itself. Encoder models performed strongly, and decoder models stayed competitive. The authors argue detection systems should be designed around such task relationships. Fairer automated moderation, they conclude, may come less from bigger models than from teaching related judgments together, where each sharpens the other.

Catalog record

CREATORAditya Tomar, Rudra Murthy, Pushpak Bhattacharyya
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2507-01715

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Stereotype Detection as a Catalyst for Enhanced Bias Detection: A Multi-Task Learning Approach Aditya Tomar, Rudra Murthy, Pushpak Bhattacharyya Abstract Warning: The examples might be offensive. Bias and stereotypes in language models can cause harm, especially in sensitive areas like content moderation and decision-making. This paper addresses bias and stereotype detection by exploring how jointly learning these tasks enhances model performance. We introduce StereoBias 1 1 1 Dataset and Code can be found here: https://github.com/aditya20t/StereotypeAsCatalystForBias , a unique dataset labeled for bias and stereotype detection across five categories: religion, gender, socio-economic status, race, profession, and others, enabling a deeper study of their relationship. Our experiments compare encoder-only models and fine-tuned decoder-only models using QLoRA. While encoder-only models perform well, decoder-only models also show competitive results. Crucially, joint training on bias and stereotype detection significantly improves bias detection compared to training them separately. Additional experiments with sentiment analysis confirm that the improvements stem from the connection between bias and stereotypes, not multi-task learning alone. These findings highlight the value of leveraging stereotype information to build fairer and more effective AI systems. Figure 1: Example showing how incorporating stereotype information can help in bias detection inferred on Llama-3.3-70B-Instruct model. Figure 2: Distribution of non-stereotypical/stereotypical and unbiased/biased sentences in StereoBias Dataset. 1 Introduction As AI models become more advanced, they are increasingly applied in various fields, achieving impressive results. However, these models are often trained on large datasets that contain real-world biases and stereotypes, which can lead to biased behavior ( Kurita et al. 2019 ; Tal et al. 2022 ). Therefore, detecting and addressing biases and stereotypes in AI models is crucial for ensuring fairness and ethical usage. " Stereotypes are beliefs about the characteristics, attributes, and behaviors of members of certain groups" Hilton and von Hippel 1996 , such as the assumption that "Asians are good at Math" . In contrast, " Bias can be defined as discrimination for, or against, a person or group, or a set of ideas or beliefs, in a way that is prejudicial or unfair" Webster et al. 2022 , such as the statement "We should hire him as a software engineer because he is from India" . Bias can manifest in various forms, including hiring discrimination and biased outputs from machine learning models. Both bias and stereotypes can have harmful effects, especially for marginalized communities, leading to unfair treatment and reinforcing negative societal norms ( Sheng et al. 2019 ; Sheng et al. 2021 ). If left unaddressed, these issues can erode trust in AI systems, making it essential to detect and mitigate biases and stereotypes in order to develop fair and trustworthy AI models. Motivation: Detecting bias can be challenging, as it is often intertwined with societal stereotypes. Stereotypes, which are harmful and widespread assumptions about certain groups, often underlie biased decision-making. We hypothesize that detecting stereotypes can improve a model’s ability to identify biased language, as shown in Figure 1 . We propose framing bias and stereotype detection as a multi-task learning (MTL) problem, where a model learns to handle both tasks simultaneously. MTL helps improve generalization by allowing the model to leverage shared patterns that are useful for both tasks. By learning to detect stereotypes alongside bias, the model can better capture subtle forms of bias that might be overlooked when treated as a separate task. Our contributions are: 1. The novel dataset StereoBias , comprising 5012 sentences, is labeled for both bias and stereotype across five categories: religion, gender, socio-economic status, race, and profession, with the remaining types of bias labeled as ‘Others’ (§ 4 ). 2. Demonstration that joint learning of bias and stereotype detection improves bias detection performance.(§ 3 ). 3. Evaluation of bias and stereotype detection models, including comparisons between encoder-only and decoder-only models, is conducted (§ 4 ). The findings demonstrate that incorporating stereotype detection into the training process improves the F1 score for bias detection, with a maximum improvement of up to \sim 13.92% (§ 5 ). 2 Related Work AI models, trained on vast amounts of real-world text, often inherit societal biases and stereotypes. This can result in harmful consequences in critical areas like hiring, law enforcement, and healthcare, where biased decisions may perpetuate inequality and discrimination ( Bender et al. 2021 ; Shrawgi et al. 2024 ). Efforts to detect stereotypes in AI systems have gained traction due to their impact on marginalized communities and societal norms. Benchmark datasets such as StereoSet Nadeem et al. 2021 and SeeGULL Jha et al. 2023 assess a model’s ability to identify and mitigate stereotypes. Similarly, bias detection has been explored through datasets like CrowS-Pairs Nangia et al. 2020 , ToxicBias Sahoo et al. 2022 , and IndiBias Sahoo et al. 2024 , focusing on forms like hate speech and abusive language. MTL has shown promise in enhancing related tasks. For example, Badathala et al. 2023 improved metaphor and hyperbole recognition using MTL, while Chauhan et al. 2020 integrated sentiment and emotion analysis to boost sarcasm detection. In this study, we leverage MTL to jointly address bias and stereotype detection. However, it is important to note that MTL does not always guarantee improvements for all tasks. As shown by Joshi et al. 2019 , the benefits of MTL depend on the type of shared layers and the relationship between the tasks involved. Task Model Bias (Macro-F1) Stereotype (Macro-F1) STL roberta-large 0.7409 0.8956 albert-xxlarge-v2 0.7226 0.8863 bert-large-uncased 0.7391 0.8814 Shared-MTL roberta-large 0.7742 \uparrow 0.8908 albert-xxlarge-v2 0.7401 \uparrow 0.8750 bert-large-uncased 0.7507 0.8929 Full-MTL roberta-large 0.7471 0.8973 albert-xxlarge-v2 0.7419 \uparrow 0.8813 bert-large-uncased 0.7520 \uparrow 0.8789 Table 1: Macro-F1 scores for encoder-only models on the StereoBias dataset. \uparrow denotes statistically significant ( p<0.05 ) increment. Task Model Bias (Macro-F1) Stereotype (Macro-F1) STL Llama-3.1-8b 0.7298 0.8572 Gemma-7b 0.7409 0.8488 Mistral-7b-v0.3 0.7198 0.8609 Shared-MTL Llama-3.1-8b 0.7434 \uparrow 0.8745 \uparrow Gemma-7b 0.7338 0.8319 Mistral-7b-v0.3 0.7560 \uparrow 0.8953 \uparrow Full-MTL Llama-3.1-8b 0.7493 \uparrow 0.8110 Gemma-7b 0.7501 0.8688 Mistral-7b-v0.3 0.7536 \uparrow 0.8877 \uparrow Table 2: Macro-F1 scores for decoder-only models on the StereoBias dataset. \uparrow denotes statistically significant ( p<0.05 ) increment. 3 Methodology In this section, we will describe our approach to detect bias and stereotypes in the single-task learning setup. Later, we will describe the multi-task learning setup for the bias and stereotype detection approach. 3.1 Single-Task Learning (STL) Sequence classification via fine-tuning of pre-trained language models has become the standard for various Natural Language (NL) tasks Devlin et al. 2019 . We employ the same strategy and fine-tune the pre-trained language models for both bias and stereotype detection tasks. The input sentence post-tokenization is passed as input to the transformer model. We use the [CLS] representation obtained from the last layer of the transformer encoder and pass it through a classification head to obtain the probabilities for the individual classes for encoder models. We take the average of all token representations from the last layer for decoder-only models and pass it through a classification head. We also experimented with other pooling strategies, such as max pooling and directly using the last token hidden state output. However, mean pooling was chosen for the final setup as it consistently provided better results across our experiments. We train the model using cross-entropy loss. In the case of

Read the complete text