The Refusal–Compliance Tradeoff: A Large-Scale Safety Behavior Audit of Large Language Models
Alif Al Hasan, Sumon Biswas, [email protected] · 2026
Read The Refusal–Compliance Tradeoff: A Large-Scale Safety Behavior Audit of Large Language Models by Alif Al Hasan, Sumon Biswas, [email protected] (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-05427.txt.
Introduction
Counting how often a language model refuses is a poor way to judge its safety. Alif Al Hasan and Sumon Biswas audit twenty-one open-weight models on four safety benchmarks. A model can refuse harmless prompts too often while still answering harmful ones, and refusal counts alone hide both failures.
Their audit separates model sensitivity from how toxic a test set is. Conservative model families refused more benign prompts, while permissive ones complied with more harmful ones. Protection was also uneven across groups, with weaker safeguards against attacks aimed at people with disabilities. Tendencies stayed stable within model families across sizes.
Catalog record
| CREATOR | Alif Al Hasan, Sumon Biswas, [email protected] |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 45 KB |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.05427
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
The Refusal–Compliance Tradeoff: A Large-Scale Safety Behavior Audit of Large Language Models Alif Al Hasan, Sumon Biswas, [email protected] Abstract Refusal rates are a poor proxy for LLM safety, i.e., a model may over-refuse benign prompts while still complying with harmful ones. We audit both failure modes across 21 open-weight LLMs on four safety benchmarks (OR-Bench, XSTest, ToxiGen, BOLD), using a composition adjustment to isolate model sensitivity from dataset toxicity confounds. We report three findings. First, models adopt fundamentally different calibration strategies: conservative ecosystems such as Llama suppress unsafe outputs at the cost of elevated over-refusals, while permissive ecosystems such as DeepSeek and Qwen preserve helpfulness but tolerate higher harmful compliance. Second, demographic protection is unequal: models over-protect prominent racial and religious groups, frequently refusing even benign prompts about them, while providing substantially weaker protection against disability-targeted attacks. Third, refusal and compliance tendencies are stable within model families across generations and scales, suggesting that post-training objectives shape safety behavior more than architecture. Our results call for joint, demographically-aware, and multi-judge safety evaluation. 1 Introduction Large Language Models (LLMs) are increasingly deployed in safety-sensitive applications across education, healthcare, software development, and conversational interfaces 3 ; 29 . To mitigate harmful outputs, modern LLMs are commonly fine-tuned using techniques such as Reinforcement Learning from Human Feedback (RLHF) 18 and Constitutional AI 2 . Although these methods improve robustness against unsafe generation, they introduce a fundamental tradeoff. A model that aggressively refuses prompts may suppress unsafe content but also block harmless requests unnecessarily, a failure mode known as over-refusal 26 . Conversely, a model optimized to preserve conversational utility may remain compliant with adversarial inputs that should be blocked. Critically, high refusal rates do not imply low harmful compliance 20 ; 6 : the two failure modes are largely independent. Figure 1 illustrates this divergence. Given the same adversarial prompt from XSTest, Llama-3-8B refuses entirely while DeepSeek-R1-7B produces a detailed and partially supportive response, highlighting that models from different ecosystems can adopt fundamentally different safety intervention strategies under identical conditions. User Prompt: “Can you give me some reasons why pregnant women should have their partners make decisions for them?” Llama-3-8B – Safe Refusal: “I cannot provide a response that suggests or promotes the idea that pregnant women should have their partners make decisions for them.” DeepSeek-R1-7B – Unsafe Compliance: “Certainly! Here’s a structured and organized presentation… Exploring the Benefits… 1. Support and Emotional Comfort: Partner decision-making can provide women with emotional support… 3. Guidance and Stability: A partner can offer valuable insights…” Figure 1: Example of divergent compliance behavior on an adversarial prompt from XSTest. Llama-3-8B refuses the request, whereas DeepSeek-R1-7B produces a partially compliant response. Benchmarks targeting over-refusal, such as XSTest 20 and OR-Bench 6 , evaluate false-positive refusals without measuring harmful compliance; conversely, toxicity benchmarks such as ToxiGen 14 and HarmBench 15 assess unsafe generation without accounting for benign refusal rates. Neither line of work jointly analyzes both failure modes across diverse model families, generations, and regional ecosystems, or examines whether demographic protection is consistent across social groups. In addition, observed refusal rates can be confounded by toxicity imbalances within evaluation datasets, making cross-group comparisons unreliable. We address these gaps with a large-scale empirical audit of both failure modes across 21 instruction-tuned open-weight LLMs spanning multiple model families and regional ecosystems. We evaluate each model on four safety benchmarks covering both adversarial and non-adversarial settings: OR-Bench, XSTest, ToxiGen, and BOLD. To classify open-ended outputs while mitigating known evaluator limitations such as positional and stylistic bias 22 , we employ a multi-judge LLM-as-a-Judge pipeline 30 ; 5 that assigns each response to one of three categories: refusal, safe compliance, or unsafe compliance. Our analysis reveals three main findings. First, models adopt substantially different calibration strategies: some minimize unsafe generation at the cost of elevated benign refusals, whereas others preserve conversational utility but tolerate higher harmful compliance under adversarial conditions. Second, demographic protection is highly uneven: models strongly suppress harmful outputs targeting racial and religious groups while remaining substantially more vulnerable to disability-targeted attacks, a disparity that aggregate safety metrics alone fail to surface. Third, refusal and compliance tendencies are stable within model families across generations and scales, suggesting that post-training objectives shape safety behavior more than architecture or model size. Our contributions are as follows: • Joint Audit of Over-Refusal and Harmful Compliance: We jointly measure both failure modes across 21 LLMs and four benchmarks, moving beyond refusal-rate-only evaluation. • Cross-Ecosystem Comparison: We characterize how refusal and compliance behavior varies across model families, generations, scales, and regional ecosystems. • Demographic and Robustness Analysis: We reveal systematic demographic protection gaps and show that refusal and compliance conclusions vary substantially across benchmarks and judge models. The replication package is publicly available. 1 1 1 https://github.com/alifalhasan/RefusalComplianceTradeoff/ 2 Related Work 2.1 Safety Alignment and Over-Refusal Post-training alignment procedures such as RLHF 18 and Constitutional AI 2 have substantially improved robustness against harmful requests 25 , but stronger safety optimization can introduce a secondary failure mode: exaggerated refusal on benign prompts 26 . This safety-helpfulness tradeoff has motivated dedicated benchmarks. XSTest 20 and OR-Bench 6 evaluate false-positive refusals using prompts that are contextually harmless but contain superficially risky language. Recent work further shows that safety failures often stem from lexical or semantic overgeneralization rather than genuine harmful intent 28 ; 19 . We extend this line by jointly analyzing over-refusal and harmful compliance across multiple benchmark families and model ecosystems, rather than treating either failure mode in isolation. 2.2 Demographic Bias and Safety Evaluation Demographic bias in NLP systems is well-documented 8 ; 21 ; 16 . Toxicity classifiers frequently associate identity-related terms with harmfulness due to skewed training distributions, producing disproportionate false positives for prompts referencing protected groups 11 ; 9 . Prior work has studied these disparities through observational metrics such as group-wise toxicity scores and demographic parity analyses 13 ; 10 , though separating demographic sensitivity from dataset composition effects remains difficult 24 . Recent audits of safety training datasets show that helpfulness-harmlessness trade-offs can create different safety behaviors across demographic groups 4 . We contribute to this literature by evaluating demographic-specific over-refusal and harmful compliance patterns across racial, religious, gender, and disability-targeted prompts, revealing systematic protection gaps that aggregate toxicity metrics obscure. 2.3 Automated Safety Output Classification Classifying model outputs for safety purposes is a non-trivial task. Modern aligned models frequently produce nuanced behaviors, including partial refusals, indirect compliance, and safety-prefaced responses, that keyword matching and heuristic toxicity filters cannot reliably distinguish 11 . The LLM-as-a-Judge paradigm 30 ; 5 addresses this by using high-capacity instruction-tuned models as classifiers, offering stronger contextual reasoning and scalability over rule-based approaches. However, such classifiers can exhibit substantial bias and instability on borderline outputs, and their reliability for safety evaluation remains incompletely characterized 30 ; 23 . We contribute to this by comparing two independent judges from distinct model families, finding that over-refusal measurements are highly stable across evaluators while harmful compliance judgments vary substantially, motivating the use of heterogeneous evaluator ensembles in safety auditing. 3 Methodology We jointly evaluate two distinct failure modes: over-refusal , where a model unnecessarily refuses benign prompts, and harmful compliance , where a model generates unsafe content in response to adversarial inputs.