When Prohibitions Become Permissions: Auditing Negation Sensitivity in Language Models DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Computing methodologies Na

Katherine Elkins, Jon Chun · 2026

Read When Prohibitions Become Permissions: Auditing Negation Sensitivity in Language Models DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Computing methodologies Na by Katherine Elkins, Jon Chun (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21433.txt.

Introduction

Katherine Elkins and Jon Chun audit how language models handle instructions that say what not to do. When a user states that someone should not act, a model should treat that as a ban. The audit finds that many models do the reverse and read the ban as approval.

The team tested many models across a set of ethical scenes. Open models endorsed banned acts at high rates, worse under layered wording. Paid models did better but still swung widely with phrasing. The results expose a basic reading failure with real safety stakes, since guardrails often rest on plain negations.

Catalog record

CREATORKatherine Elkins, Jon Chun
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE60 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-21433

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

When Prohibitions Become Permissions: Auditing Negation Sensitivity in Language Models DOI: XXXXXXX.XXXXXXX Conference: Make sure to enter the correct conference title from your rights confirmation email; June 03–05, 2018; Woodstock, NY ISBN: 978-1-4503-XXXX-X/2018/06 CCS: Computing methodologies Natural language processing CCS: Computing methodologies Supervised learning CCS: Social and professional topics Governmental regulations CCS: Human-centered computing Empirical studies in HCI Katherine Elkins, Jon Chun Abstract . When a user tells an AI system that someone should not take an action, the system ought to treat this as a prohibition. Yet many large language models do the opposite: they interpret negated instructions as affirmations. We audited 16 models across 14 ethical scenarios and found that open-source models endorse prohibited actions 77% of the time under simple negation and 100% under compound negation—a 317% increase over affirmative framing. Commercial models fare better but still show swings of 19-128%. Agreement between models drops from 74% on affirmative prompts to 62% on negated ones, and financial scenarios prove twice as fragile as medical ones. These patterns hold under deterministic decoding, ruling out sampling noise. We present case studies showing how these failures play out in practice, propose the Negation Sensitivity Index (NSI) as a governance metric, and outline a tiered certification framework with domain-specific thresholds. The findings point to a gap between what current alignment techniques achieve and what safe deployment requires: models that cannot reliably distinguish “do X” from “do not X” should not be making autonomous decisions in high-stakes contexts. 1. Introduction 1.1. The Problem of Compositional Semantics AI audits typically evaluate whether systems produce correct outputs, but correctness presupposes that systems understand what they are being asked. When a user tells an AI system that someone should not take an action, the system ought to treat this as a prohibition. Negation is compositional: it takes a proposition and inverts its truth value. A system that processes "should X" correctly but fails on "should not X" does not understand what it is being asked to do. It is pattern-matching on surface features rather than parsing meaning. Recent work has established that this failure mode is widespread. Truong et al. ( 33 ) provide comprehensive evaluation of GPT-style models on negation benchmarks, documenting systematic insensitivity to negation operators, and Hosseini et al. ( 18 ) construct a large-scale benchmark demonstrating sizable performance drops under diverse negation patterns. Thunder-NUBench ( 32 ) introduces logically grounded evaluation where models must distinguish true negation from surface-similar distractors, finding that models often react to surface cues rather than inverting truth conditions. Research on prompt sensitivity has further documented that LLM outputs shift with formatting changes, instruction order, and example selection ( 29 ; 38 ) , with framing effects persisting from human cognition into LLMs ( 2 ) . All of this work has focused on semantic comprehension in situations like question answering or truth-value judgment. Whether negation failures persist when models make ethically consequential decisions, and whether those failures vary by domain in ways that matter for deployment, remain open questions. 1.2. Why This Matters for Accountability Prohibitions are fundamental to how organizations constrain behavior. Credit policies specify which applicants must not be approved, and medical protocols identify contraindicated treatments. Safety guidelines often enumerate actions that operators must not take. When AI systems assist with such decisions, they encounter prohibitions constantly, and they must process them correctly for the overall system to function as intended. The problem is that accountability infrastructure assumes semantic stability. An audit log recording that a system was instructed to “deny applications lacking documentation” is only useful if the system actually denies such applications. A human reviewer checking that appropriate constraints were applied can only do their job if the constraints, once applied, persist through the system’s reasoning. Contestability mechanisms that allow affected individuals to challenge decisions based on stated criteria ( 35 ) become meaningless if stated criteria do not reliably govern outputs. Negation sensitivity breaks this chain at its foundation. If a model processes "do not approve" as functionally equivalent to "approve" some fraction of the time, no amount of downstream oversight can compensate. The logged instruction and the actual behavior diverge, and neither auditors nor affected individuals can detect the gap without re-running the model under both polarities. This is not a subtle interpretive problem or a borderline case. Rather, it is a failure to execute the instruction that was given. Previous research has documented how aggregate metrics can obscure deployment-relevant failures ( 30 ) , and how benchmark performance fails to predict real-world behavior ( 3 ) . Negation sensitivity represents a specific instance of this: a model can demonstrate robust outputs under formatting changes, instruction reordering, and paraphrase variation while still inverting the meaning of explicit prohibitions. Standard robustness evaluations would not catch this because they rarely test polarity-paired framings head to head. 1.3. The Audit We Conducted We tested 16 models: 8 US commercial (GPT-5 series \times 3, Claude 4.5 series \times 2, Gemini-3-Flash, Grok-4.1 \times 2), 4 Chinese commercial (DeepSeek-V3, GLM-4, Kimi-K2, Qwen3), and 4 open-source (LLaMA 3.2, Gemma 3, Granite 3.3, Phi-4). Each model responded to 14 ethical scenarios under four systematically varied framings that differ only in polarity structure. The key methodological insight is that agreeing with "should X" and disagreeing with "should not X" both endorse the action. A model that processes negation correctly should show mirror-image agreement rates across polarity pairs, and any deviation represents a failure to appropriately invert meaning. We formalize this through normalization, which maps responses to a common action-endorsement scale, and define the Negation Sensitivity Index as the maximum endorsement swing across polarity-paired framings. Our scenarios span seven domains with two dilemmas each: medical, financial, legal, military, business, education, and science. Each presents genuine ethical tension without obvious correct answers, ensuring that baseline response variation reflects moral uncertainty rather than factual error. With 30 samples per condition at temperature 0.7, plus deterministic runs for ablation, we collected approximately 27,000 valid decisions after quality filtering. 1.4. Summary of Findings Three patterns emerge from the data. Open-source models show extreme negation sensitivity, with 77% action endorsement under simple negation (up from 24% under affirmative framing) and 100% under compound negation. Commercial models vary considerably, with some showing appropriate directional movement under simple negation while others exhibit outright inversion. The gap matters for deployment, because commercial models show polarity swings of 19-128% depending on the system, while open-source models swing by 317%. Even commercial models that handle simple negation reasonably struggle with compound constructions. Domain also matters substantially. Financial and business scenarios show mean sensitivity indices of 0.64-0.65, while medical scenarios average 0.34, roughly half as fragile. This significant gap suggests that some domains benefit from clearer training signal, perhaps Hippocratic principles and established protocols in medicine, while others involve murkier tradeoffs that leave models more susceptible to surface cues. The failures, moreover, are structural, not stochastic, as demonstrated by ablation studies. Temperature ablation at T=0.0 (fully deterministic) actually increases mean sensitivity by 16% compared to T=0.7. This means that stochastic sampling masks the problem by averaging across response modes, whereas deterministic decoding exposes the sharp decision boundaries underneath. Reasoning-enabled model variants often show meaningful improvements (52% reduction for Grok-4.1-reasoning versus non-reasoning),

Read the complete text