Where Norms and References Collide: Evaluating LLMs on Normative Reasoning
Mitchell Abrams, Kaveh Eskandari Miandoab, Felix Gervits, Vasanth Sarathy, Matthias Scheutz · 2026
Read Where Norms and References Collide: Evaluating LLMs on Normative Reasoning by Mitchell Abrams, Kaveh Eskandari Miandoab, Felix Gervits, Vasanth Sarathy, Matthias Scheutz (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-02975.txt.
Introduction
Robots and other embodied agents must understand social norms to communicate well, and Mitchell Abrams and 4 co-authors test whether language models can do that reasoning in a 2026 paper. Understanding a phrase like a pronoun or description often requires knowing what actions are appropriate in context. That skill is called norm-based reference resolution.
The authors built SNIC, a human-validated testbed of situated norms. Its cases involve everyday tasks such as cleaning, tidying, and serving, where physical and social expectations meet. Even the strongest models tested struggled. They identified and applied norms inconsistently, especially when norms were implicit, underspecified, or in conflict. The results expose a blind spot for language systems deployed in social, embodied settings.
Catalog record
| CREATOR | Mitchell Abrams, Kaveh Eskandari Miandoab, Felix Gervits, Vasanth Sarathy, Matthias Scheutz |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 36 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-02975
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Where Norms and References Collide: Evaluating LLMs on Normative Reasoning Mitchell Abrams, Kaveh Eskandari Miandoab, Felix Gervits, Vasanth Sarathy, Matthias Scheutz Abstract Embodied agents, such as robots, will need to interact in situated environments where successful communication often depends on reasoning over social norms: shared expectations that constrain what actions are appropriate in context. A key capability in such settings is norm-based reference resolution (NBRR), where interpreting referential expressions requires inferring implicit normative expectations grounded in physical and social context. Yet it remains unclear whether Large Language Models (LLMs) can support this kind of reasoning. In this work, we introduce SNIC ( Situated Norms in Context ), a human-validated diagnostic testbed designed to probe how well state-of-the-art LLMs can extract and utilize normative principles relevant to NBRR. SNIC emphasizes physically grounded norms that arise in everyday tasks such as cleaning, tidying, and serving. Across a range of controlled evaluations, we find that even the strongest LLMs struggle to consistently identify and apply social norms—particularly when norms are implicit, underspecified, or in conflict. These findings reveal a blind spot in current LLMs and highlight a key challenge for deploying language-based systems in socially situated, embodied settings. Code and Dataset — https://github.com/TheSittingCat/SNIC Introduction Reference resolution is a critical aspect of dialogue processing that contributes to natural language understanding by linking language to real-world entities. This process is not always straightforward or sufficiently achievable through language alone. It requires interpreting language within a situated context, often consisting of social norms that are activated by objects in a scene, tasks, locations, or social roles. Prior work has shown that social norms, irrespective of language, can influence the interpretation of a referent ( Abrams and Scheutz 2022 ) . Consider an example where a human asks an assistant in a communal kitchen: Human: “Can you pass me a mug?” Assistant: “Okay.” There are three mugs nearby—one clean and two with leftover coffee. Without additional linguistic cues, the request may seem ambiguous. However, given the context, the intended referent is likely the clean mug because, normatively , people avoid drinking from used mugs that are not their own or dirty. The underlying norm applied to this situation is: you should use clean items when drinking or serving beverages . If the context instead involved cleaning up after an event, then the request might be understood as referring to the dirty mugs. Without normative reasoning, this interpretation could be lost. Embodied agents or AI systems must incorporate social norms into reference resolution as they operate in social environments. In interactive situations, social norms serve as powerful constraints because they consist of shared expectations that people rely on to coordinate behavior. Norms function similarly to language in that they provide a type of social grammar ( Bicchieri 2005 ) , guiding interlocutors in resolving referential ambiguity. However, normative reasoning for reference resolution is a challenging task; norms are highly contextual and range from abstract (e.g., show respect ) to very specific and physically grounded (e.g., you should pick up your glass by the stairs so nobody knocks it over ). Norms also vary in how strongly they should be followed or violated 1 1 1 referred to as deontic force , which is particularly relevant in norm conflicts where some norms may need to be violated to satisfy stronger norms ( Malle, Bello, and Scheutz 2019 ) . For reference resolution, norms must be identified from both language and context, then reasoned with to resolve a referent. Large Language Models (LLMs) provide a promising solution for norm identification and reasoning since they implicitly encode world knowledge and perform well on question-answering tasks ( Brown et al. 2020 ) . However, norms may be difficult to learn through exposure to large amounts of text, as they are often implicit rather than explicitly stated. It is an open question whether LLMs can perform reference resolution that requires normative reasoning. To investigate this challenge, we introduce SNIC, a human-validated diagnostic testbed designed to represent the prescriptive and prohibitive social norms that guide referential interpretation in everyday contexts. Unlike prior norm datasets that focus on abstract moral judgments ( Forbes et al. 2020 ) , SNIC emphasizes physically grounded norms embedded in real-world tasks that humans and agents would engage in (e.g., cleaning, serving, tidying). Rather than proposing SNIC as a definitive benchmark, we use it as a controlled environment to probe how LLMs handle normative ambiguity, prioritize between conflicting norms, and respond to implicit expectations when resolving ambiguous referential expressions. Across a series of evaluations, we find that models exhibit inconsistencies; not only across different scenarios but even within near-identical scenes under slightly varied conditions. These findings expose a critical but unexplored weakness in contemporary language models: their ability to consistently reason about physically situated social norms. Background Social norms function as a form of social grammar, shaping expectations for behavior in different contexts ( Bicchieri 2005 ) . This is because social norms consist of both empirical expectations (beliefs about what others do) and normative expectations (beliefs about what others expect us to do) ( Malle, Bello, and Scheutz 2019 ) . Their power to guide behavior has been attractive to the AI community. Normative reasoning has been studied in AI and the NMAS (normative multi-agent systems) community through formal representations that encode norms using deontic logic and contextual activation conditions ( Malle, Bello, and Scheutz 2019 ; Sarathy et al. 2017 ; Malle et al. 2020 ) . These studies have explored how norms are triggered by environmental and linguistic cues, but their application to reference resolution remains unexplored. To our knowledge, no existing dataset explicitly evaluates norm-based reference resolution (NBRR). There has been NLP work in anaphora and coreference resolution that requires external commonsense knowledge for interpretation: reference resolution tasks, such as the Winograd Schema Challenge ( Levesque, Davis, and Morgenstern 2012 ) , Winogrande ( Sakaguchi et al. 2021 ) (a reference resolution task that requires common-sense knowledge to resolve ambiguous references), and CommonsenseQA ( Talmor et al. 2018 ) , test common-sense reasoning but do not isolate normative constraints. We follow this tradition and extend the idea that reference and co-reference resolution require not only commonsense knowledge, but even normative knowledge. We also treat text-based vignettes as a reasonable proxy for physical scenarios, as in prior work like TextWorld ( Côté et al. 2019 ) , though our focus remains on evaluating norms in text form. In social norm modeling, NLP systems such as Delphi and the Neural Norm Transformer have been trained on datasets like Social Chemistry 101 ( Forbes et al. 2020 ) . However, these models primarily capture norms related to moral judgments and social etiquette, lacking the physical and situational grounding needed for norm-based reference resolution. This gap motivates the development of new testbeds and evaluation methods tailored to NBRR This dataset, for instance, consists of situations from online forums (e.g., ”Asking my boyfriend to stop being friends with his ex” ) and associated moral rules of thumb (e.g., ”It’s okay to ask your significant other to stop doing something you’re uncomfortable with” ) This gap motivates the development of new benchmarks and evaluation methods tailored to NBRR. LLMs offer a potential