MiJaBench: Revealing Minority Biases in Large Language Models via Hate Speech Jailbreaking Warning: this paper discusses and contains content that can be offensive.

Iago A. Brito, Walcy S. R. Rios, Julia S. Dollis, Diogo F. C. Silva, Arlindo R. Galvão Filho · 2026

Read MiJaBench: Revealing Minority Biases in Large Language Models via Hate Speech Jailbreaking Warning: this paper discusses and contains content that can be offensive. by Iago A. Brito, Walcy S. R. Rios, Julia S. Dollis, Diogo F. C. Silva, Arlindo R. Galvão Filho (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-04389.txt.

Introduction

Iago Alves Brito and four co-authors expose a blind spot in how language model safety is measured, in a 2026 arXiv paper. Safety scores are usually averaged under broad headings like identity hate, which can hide a pattern they name the Selective Safety Trap. A model may guard some communities fiercely while leaving others exposed to the very same attacks.

Their audit tool is MiJaBench, a bilingual English-Portuguese benchmark of nearly forty-four thousand controlled jailbreak prompts aimed at sixteen minority groups. Testing fourteen leading models produced over six hundred thousand prompt-response pairs. defence rates swung by more than forty points within a single model depending only on which group was targeted; bigger models were not fairer. Finetuning a small model with preference optimization on their data, though, generalized surprisingly well to unseen groups and attack styles.

Catalog record

CREATORIago A. Brito, Walcy S. R. Rios, Julia S. Dollis, Diogo F. C. Silva, Arlindo R. Galvão Filho
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE59 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-04389

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

MiJaBench: Revealing Minority Biases in Large Language Models via Hate Speech Jailbreaking Warning: this paper discusses and contains content that can be offensive. Iago A. Brito, Walcy S. R. Rios, Julia S. Dollis, Diogo F. C. Silva, Arlindo R. Galvão Filho Abstract Current safety evaluations of large language models (LLMs) create a dangerous illusion of universality, aggregating "Identity Hate" into scalar scores that mask systemic vulnerabilities against specific populations. To expose this selective safety , we introduce MiJaBench , a bilingual (English and Portuguese) adversarial benchmark comprising 44,000 prompts across 16 minority groups. By generating 528,000 prompt-response pairs from 12 state-of-the-art LLMs, we curate MiJaBench-Align , revealing that safety alignment is not a generalized semantic capability but a demographic hierarchy: defense rates fluctuate by up to 33% within the same model solely based on the target group. Crucially, we demonstrate that model scaling exacerbates these disparities , suggesting that current alignment techniques do not create principle of non-discrimination but reinforces memorized refusal boundaries only for specific groups, challenging the current scaling laws of security. We release all datasets and scripts to encourage research into granular demographic alignment at GitHub . 1 Introduction The scaling of large language models (LLMs) has been driven by the immense scale of text corpora, granting these systems unprecedented linguistic capabilities 20 ; 19 . However, while this reliance on huge amount of data provides semantic breadth, it also implants systemic prejudices deeply present in online discourse into model parameters 16 . Recent alignment techniques that attempt to mitigate these toxic behaviors often induce a false sense of universal safety, robustly protecting specific populations while leaving other communities vulnerable to abuse. Thus, the challenge in modern alignment is no longer merely asking if a model is safe, but rigorously determining for whom it is safe. Figure 1: Selective Safety. Changing only the minority in the jailbreaking attack makes the model agree to generate hateful content. Existing efforts to measure fairness in LLMs have primarily focused on quantifying representational biases. For instance, StereoSet 17 measures stereotypical associations across broad categories like gender and race by analyzing token probability distributions in multiple-choice scenarios, while 18 diagnose similar disparities within question answering domain. Despite several studies demonstrating the fragility of LLMs to generate offensive texts against marginalized communities 12 ; 2 ; 28 , current benchmarks are limited to measuring the model’s passive tendency to stereotype, and do not address its hate speech generation safeguards. To evaluate fragilities in LLMs text generation, the field has increasingly relied on jailbreaking and adversarial benchmarks 15 ; 8 ; 13 ; 10 . Although these datasets effectively curate prompts designed to circumvent safety filters across different taxonomies of risk (e.g., Regulated Substances , Harassment ), they structurally fail to audit vulnerabilities across different demographics individually. By aggregating malicious queries towards distinct minority groups under generic labels such as Identity Hate , they do not measure whether current safety alignment protects all communities equally, or if it is merely overfitted to specific minorities dominant in the training data distribution, leaving the long tail of underrepresented groups vulnerable to identical attack vectors. In this work we introduce the Minority Jailbreaking Benchmark (MiJaBench) , a controlled bilingual dataset comprising 44,000 synthetic jailbreaking attacks across 16 distinct minority groups. Using Portuguese as a non-Anglocentric language control, each entry is built upon a hate speech text to extract the harmful intent, a contextual scenario to introduce high-entropy, and a jailbreaking strategy defining the attack policy. In Figure 1 we exemplify the critical failure mode revealed by our analysis: even when an architecture possesses the capability to recognize and refuse a jailbreak targeting one group (e.g., Black people ), it frequently fails to transfer this safety behavior to other communities (e.g., people with disabilities ), indicating that while models possess the latent capacity for robust defense, their safety alignment is critically selective. By executing MiJaBench across three distinct model families and four parameter scales, we curate MiJaBench-Align , a massive corpus containing 528,000 prompt-response pairs with approximately 80% successful jailbreaks, serving as a dense repository of hard negatives and a valuable resource for robust alignment training. Crucially, this benchmark exposes the magnitude of the safety hierarchy, with defense rates shifting by up to 33% solely based on the demographic target, even within identical model configurations. Such disparities reveal how aggregate safety metrics create an illusion of security, masking systemic vulnerabilities between neglected communities. In summary, our contributions are: • Minority Jailbreaking Benchmark: We open-source MiJaBench (44k adversarial prompts) and MiJaBench-Align (528k prompt-response interactions pairs). Unlike prior work that aggregates targets, we explicitly stratify attacks across 16 groups to enable granular demographic alignment auditing. • Identification of Safety Bias: We demonstrate that different models exhibit the same semantic blind spots, revealing a consistent hierarchy of vulnerability that transcends language, architecture, and training recipes. This suggests that demographic safety bias is deeply entrenched in the pre-training data distribution. • Model Scaling Effects. We reveal that scaling model parameters exacerbates safety disparities. While larger models are generally safer, this improvement is disproportionately driven by dominant groups, increasing the safety gap for underrepresented minorities. Figure 2: Pipeline to generate MiJaBench. 2 Related Work 2.1 From Representational Bias to Behavioral Safety The evaluation of social biases has traditionally focused on representational harms , measuring the intrinsic probability of a model to generate stereotypes. Early works analyzed static word embedding subspaces 1 , later evolving into context-dependent benchmarks like StereoSet 17 , which utilizes 16,995 samples to quantify bias via next-token probabilities, and BBQ 18 , which employs 58k multiple-choice questions to probe ambiguity resolution in QA tasks. While foundational for detecting cognitive biases, these intrinsic benchmarks fail to evaluate safety alignment in deployed systems. A model may successfully identify the correct anti-stereotypical answer in a forced-choice format while remaining highly susceptible to generating toxic content when explicitly instructed. 2.2 Adversarial Jailbreaking and Safety Benchmarks To audit these guardrails in free generation, recent frameworks have adopted dynamic adversarial testing (Red Teaming). HarmBench 15 and WildGuard 10 standardize the evaluation of automated attacks against broad taxonomies of forbidden behaviors. Similarly, BeaverTails 13 contributes a massive scale of 330k prompt-response pairs to align models. However, these benchmarks structurally prioritize the taxonomy of harm (the "What", e.g., fraud, violence, bomb-making) while neglecting the taxonomy of targets (the "Who"). By aggregating all identity-based attacks under monolithic labels like "Hate Speech", they produce scalar safety scores that mask severe disparities between protected and unprotected groups. Recent works such as CLEAR-Bias 4 attempt to bridge this gap by using jailbreaking to elicit bias across different minority groups. However, CLEAR-Bias relies on a limited set of 4,400 samples covering seven distinct groups derived from fixed templates. This rigid structure fails to emulate the diversity of real-world adversarial interactions, often allowing models to recognize the attack pattern rather than the harmful semantic payload. In contrast, MiJaBench leverages a stochastic adversarial rewriter to generate 44,000 unique adversarial prompts across 16 minority groups, verifying safety robustness against complex jailbreaks at a scale significantly larger than prior intersectional works. 2.3 Multilingual Safety and Cultural Alignment Parallel research highlights a language barrier in safety alignment, where models exhibit significantly higher robustness in English than in low-resource

Read the complete text