Are Language Models Sensitive to Morally Irrelevant Distractors?

Andrew Shaw ♡ Christina Hahn ♡ Catherine Rasgaitis ♢ Yash Mishra ♡ · 2026

Read Are Language Models Sensitive to Morally Irrelevant Distractors? by Andrew Shaw ♡ Christina Hahn ♡ Catherine Rasgaitis ♢ Yash Mishra ♡ (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-09416.txt.

Description

Moral benchmarks often assume language models hold stable moral preferences, but human moral judgment bends with irrelevant context, from ambient smells to background noise. Andrew Shaw and seven co-authors test whether models bend the same way. Their 2026 study builds a multimodal set of sixty moral distractors, emotionally charged images and narratives with no moral bearing on the scenario at hand, then injects them into existing moral benchmarks.

The distractors shift model moral judgments by more than thirty percent, even in scenarios designed to be unambiguous. That instability challenges benchmarks that read off stable values from single prompts. The authors argue alignment work needs more contextual approaches, ones that account for situational sway rather than assuming fixed moral stances. The dataset itself offers a tool for probing that sway systematically.

Catalog record

CREATORAndrew Shaw ♡ Christina Hahn ♡ Catherine Rasgaitis ♢ Yash Mishra ♡
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE42 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-09416

Browse the full library · About the Tower of Babel