Moral Sensitivity in LLMs: A Tiered Evaluation of Contextual Bias via Behavioral Profiling and Mechanistic Interpretability

Yash Aggarwal Atmika Gorti Vinija Jain Aman Chadha Krishnaprasad Thirunarayan Manas Gaur University of Maryland, College Park Purdue University Google Apple Wright State University University of Maryland, Baltimore County · 2026

Read Moral Sensitivity in LLMs: A Tiered Evaluation of Contextual Bias via Behavioral Profiling and Mechanistic Interpretability by Yash Aggarwal Atmika Gorti Vinija Jain Aman Chadha Krishnaprasad Thirunarayan Manas Gaur University of Maryland, College Park Purdue University Google Apple Wright State University University of Maryland, Baltimore County (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-03217.txt.

Description

Yash Aggarwal, Atmika Gorti, Vinija Jain, Aman Chadha, Krishnaprasad Thirunarayan, and Manas Gaur measure moral sensitivity in language models as a graded trait, not a yes-or-no bias label. Bias often grows with context pressure, so binary tests miss how it actually emerges.

Their Moral Sensitivity Index scores biased output across seven tiers, from abstract numbers to settings rooted in historic injustice. Four leading models showed distinct profiles shaped by their alignment design. Circuit-level checks on criminal-bias cases then found a U-shaped pattern: small models biased, tuned models clean, and reasoning-distilled models biased again, with matching circuits across stages.

Catalog record

CREATORYash Aggarwal Atmika Gorti Vinija Jain Aman Chadha Krishnaprasad Thirunarayan Manas Gaur University of Maryland, College Park Purdue University Google Apple Wright State University University of Maryland, Baltimore County
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.03217

Browse the full library · About the Tower of Babel