Deontological Keyword Bias: The Impact of Modal Expressions on Normative Judgments of Language Models

Bumjin Park, Jinsil Lee, Jaesik Choi · 2025

Read Deontological Keyword Bias: The Impact of Modal Expressions on Normative Judgments of Language Models by Bumjin Park, Jinsil Lee, Jaesik Choi (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-11068.txt.

Introduction

Bumjin Park, Jinsil Lee, and Jaesik Choi uncover a bias in how language models judge duties. Their 2025 paper studies models that are asked to reason about morals and obligations. Adding modal words, the words that express duty or necessity, strongly skewed the models' verdicts.

With such words present, models called almost all everyday scenarios duties, even when they were not. The pattern held across model families, question types, and answer formats. The authors name this deontological keyword bias. Their fix mixes a few worked examples with prompts that ask for reasoning, which eased the bias. The finding warns builders that surface wording, not just moral content, can drive a model's ethical calls.

Catalog record

CREATORBumjin Park, Jinsil Lee, Jaesik Choi
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE61 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2506-11068

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Deontological Keyword Bias: The Impact of Modal Expressions on Normative Judgments of Language Models Bumjin Park, Jinsil Lee, Jaesik Choi Abstract Large language models (LLMs) are increasingly engaging in moral and ethical reasoning, where criteria for judgment are often unclear, even for humans. While LLM alignment studies cover many areas, one important yet underexplored area is how LLMs make judgments about obligations. This work reveals a strong tendency in LLMs to judge non-obligatory contexts as obligations when prompts are augmented with modal expressions such as must or ought to . We introduce this phenomenon as Deontological Keyword Bias (DKB). We find that LLMs judge over 90% of commonsense scenarios as obligations when modal expressions are present. This tendency is consist across various LLM families, question types, and answer formats. To mitigate DKB, we propose a judgment strategy that integrates few-shot examples with reasoning prompts. This study sheds light on how modal expressions, as a form of linguistic framing, influence the normative decisions of LLMs and underscores the importance of addressing such biases to ensure judgment alignment. 1 Introduction As large language models (LLMs) continue to advance, their societal influence grows accordingly. At the same time, concerns have emerged regarding biases across a wide range of domains, including gender, age, and nationality Gallegos et al. 2024 ; Yeh et al. 2023 ; Fang et al. 2024 . In this work, we explore another crucial dimension: the normative judgment of LLMs, which depends on the broader norms and values of society Sachdeva and van Nuenen 2025 . Specifically, we evaluate obligatory judgments made by LLMs, which are crucial for determining the obligation of their actions. Humans learn normative judgments through real-world interactions and explicit imagination of the outcomes of their actions Bandura 1969 ; Gray et al. 2012 . Certain linguistic elements serve as strong anchors for learning normative semantics, particularly modal expressions (MEs) of obligation, such as must and ought to Von Wright 1951 ; Palmer 2001 . On the other hand, LLMs acquire normative judgment through semantic concepts formed during pre-training and fine-tuning on specific datasets Petroni et al. 2019 . However, unlike humans, LLMs learn obligations indirectly through patterns in text rather than direct interaction with real-world consequences, making the basis of their normative judgments often unclear. We conjecture that the judgment of LLMs is primarily influenced by modal expressions of obligation, even in situations where such obligations are not strictly required. We term this phenomenon Deontological Keyword Bias (see Figure 1 ). For example, LLMs might infer that having an umbrella is an obligation if the training data only includes the statement, “You should have an umbrella when it rains.” While carrying an umbrella might be reasonable advice, it does not constitute a valid obligation in the real world, as it lacks moral or legal necessity. Figure 1: Graphical illustration of the Deontological Keyword Bias. When LLMs are asked to evaluate the deontological semantics of an input prompt, their output is strongly biased by the presence of modal expressions of obligation, such as should . Deontology Commonsense Modal Expression Condition Human GPT-4o Human GPT-4o With Modal Expression 4.17 (0.50) 4.95 (0.25 ) 3.33 (1.84) 4.90 (0.10) Without Modal Expression 3.11 (1.44) 0.30 (0.05) 1.90 (1.05) 0.10 (0.10) Table 1: Human and GPT-4o obligation judgments (mean and variance) across Deontology and Commonsense datasets, with and without modal expressions. Scores range from 0 (no obligation) to 5 (clear obligation). LLMs tend to express stronger obligation judgments than humans in commonsense contexts when modal expressions are present(GPT-4o: 4.90 vs. Human: 3.33). See Appendix D for details. Humans and LLMs both tend to judge a sentence as expressing obligation when modal expressions (MEs) are included (see Table 1 ). However, LLMs exhibit a markedly stronger dependence on the presence of MEs, showing a high correlation between their inclusion and elevated obligation scores, along with low variance in their responses. This pattern suggests that LLMs rely less on contextual reasoning compared to humans. Such reliance on modal expressions is particularly concerning as LLMs increasingly operate as real-world agents, making normative decisions that can impact society’s understanding of right and wrong Weidinger et al. 2021 ; Solaiman et al. 2019 . To systematically verify the existence of DKB, we explore the impact of various factors, including modal expression types, question formats, and answer formats. We also demonstrate that training-free debiasing techniques, utilizing few-shot examples and reasoning, can effectively mitigate deontological keyword bias. This paper presents a structured evaluation of LLMs for obligation judgment, contributing to a deeper understanding of normative AI by analyzing deontological judgment biases. 2 Related Work 2.1 Deontic inference Deontology, an ethical theory concerning duty and moral rules, was first developed by Kant in his categorical imperative Paton 1971 . Early inference mechanisms were based on symbolic deontic logic, as constructed by Von Wright 1951 . Symbol-based reasoning provided a foundational framework and enabled inference over various propositions. However, deontic logic has often been subject to logical paradoxes, including Ross’s paradox Ross 1944 , where, for instance, if the proposition paying tax is obligatory, then so is paying tax \lor robbing a bank , by the property of logical disjunction, which preserves truth when at least one operand is true. Additionally, deontic logic faces challenges in semantic parsing, particularly in capturing contextual dependencies. In detail, symbol-based reasoning struggles to account for such nuances, limiting its practical application in real-world scenarios. A key limitation is its difficulty in distinguishing between personal obligations, which are assigned to specific agents (e.g., “You must submit the report”), and impersonal obligations, which are expressed more generally without a clear subject (e.g., “Taxes must be paid”). It also struggles to clarify who is permitted to act and under what conditions, leading to persistent ambiguities in the interpretation of permission statements Hintikka 1971 . As an alternative, Normative multi-agent systems incorporate context into agents’ obligations and facilitate conflict resolution in distributed settings Boella et al. 2006 . Unlike traditional symbolic deontic logic, which struggles with paradoxes and lacks adaptability to real-world scenarios, Normative multi-agent systems aim to provide a structured approach to reasoning about obligations, permissions, and prohibitions in dynamic environments. A temporal logic for normative systems has been proposed to allow obligations to evolve over time and to enable more flexible decision-making in temporal contexts Ågotnes et al. 2009 . In addition, a framework for norm-compliant reinforcement learning in deontic logic has been introduced, enabling artificial agents to learn and adapt to normative constraints through interaction rather than relying solely on predefined logical rules Kasenberg and Scheutz 2018 . To better capture the semantics of text, several studies utilize machine learning and artificial intelligence. RNN-based models have been used to detect contractual obligations and prohibitions, focusing on indicative tokens via self-attention and leveraging a hierarchical BiLSTM for improved discourse awareness Chalkidis et al. 2018 . BERT has been utilized to predict deontic modality in regulations and contracts Joshi et al. 2021 . More recently, DeonticBERT has been proposed to enhance BERT’s understanding of deontic logic by converting classification into a masked language model task through a template function, which maps the predicted deontic keywords back to deontic labels Sun et al. 2023 . More recent studies utilize

Read the complete text