Normative Evaluation of Large Language Models with Everyday Moral Dilemmas

Pratik S. Sachdeva, Tom van Nuenen · 2025

Read Normative Evaluation of Large Language Models with Everyday Moral Dilemmas by Pratik S. Sachdeva, Tom van Nuenen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-18081.txt.

Description

Pratik S Sachdeva and Tom van Nuenen present a 2025 paper judging large language models against messy, everyday moral conflicts rather than tidy survey questions. Most moral audits ask models abstract items, which flattens the nuance of real disputes. The authors instead drew dilemmas from a popular forum where people post quarrels and ask strangers who was wrong.

They prompted seven language models to assign blame in these stories and compared their verdicts with the community's. Judging models along richer axes of human interaction, they argue, better reveals how the systems may sway real beliefs and behaviour. The study pushes moral evaluation from slogans toward situations.

Catalog record

CREATORPratik S. Sachdeva, Tom van Nuenen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE62 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-18081

Browse the full library · About the Tower of Babel