Building Interpretable Models for Moral Decision-Making

Mayank Goel, Aritra Das, Paras Chopra · 2026

Read Building Interpretable Models for Moral Decision-Making by Mayank Goel, Aritra Das, Paras Chopra (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-03351.txt.

Description

A tiny transformer that makes moral decisions is built for inspection by Mayank Goel, with 2 co-authors. Their custom model processes trolley-style dilemmas as ordered scenarios. Embeddings encode who is affected, how many people are involved, and which outcome each person belongs to. That lets the authors trace how those factors drive a choice. They need not read free text loosely for moral cues.

The two-layer architecture reaches solid score on Moral Machine data while staying small enough for detailed analysis. Interpretability techniques then uncover how moral thinking distributes across the network. Among other findings, biases localize to distinct computational stages. Keeping the model deliberately small is the point, trading raw results for a system whose moral decision process can actually be examined.

Catalog record

CREATORMayank Goel, Aritra Das, Paras Chopra
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE20 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-03351

Browse the full library · About the Tower of Babel