Normative Evaluation of Large Language Models with Everyday Moral Dilemmas
Pratik S. Sachdeva, Tom van Nuenen · 2025
Read Normative Evaluation of Large Language Models with Everyday Moral Dilemmas by Pratik S. Sachdeva, Tom van Nuenen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-18081.txt.
Description
Pratik S Sachdeva and Tom van Nuenen present a 2025 paper judging large language models against messy, everyday moral conflicts rather than tidy survey questions. Most moral audits ask models abstract items, which flattens the nuance of real disputes. The authors instead drew dilemmas from a popular forum where people post quarrels and ask strangers who was wrong.
They prompted seven language models to assign blame in these stories and compared their verdicts with the community's. Judging models along richer axes of human interaction, they argue, better reveals how the systems may sway real beliefs and behaviour. The study pushes moral evaluation from slogans toward situations.
Catalog record
| CREATOR | Pratik S. Sachdeva, Tom van Nuenen |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 62 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-18081