When Contextual Inference Fails: Cancelability in Interactive Instruction Following
Natalia Bila, Kata Naszádi, Alexandra Mayn, Christof Monz · 2026
Read When Contextual Inference Fails: Cancelability in Interactive Instruction Following by Natalia Bila, Kata Naszádi, Alexandra Mayn, Christof Monz (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-19997.txt.
Introduction
Bila and co-authors test whether language models adjust to unreliable partners in a building task. Their Build What I Mean benchmark adapts a psycholinguistic setup for two speakers. One speaker cooperates in spirit, while the other is only literally reliable. Instructions are underspecified, so models must infer meaning or ask for clarification at a small cost. Models did spot unreliability when asked to rate their confidence. Yet they failed to act on that awareness in the task. They either asked too many blind questions or guessed when unsure.
Catalog record
| CREATOR | Natalia Bila, Kata Naszádi, Alexandra Mayn, Christof Monz |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31763 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.19997
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
When Contextual Inference Fails: Cancelability in Interactive Instruction Following Natalia Bila, Kata Naszádi, Alexandra Mayn, Christof Monz Abstract We investigate the separation of literal interpretation from contextual inference in a collaborative block-building task where a builder must resolve underspecified instructions using contextual inferences. Building on an existing two-speaker psycholinguistic paradigm—which contrasts a pragmatically cooperative speaker with one who is only literally reliable—we introduce Build What I Mean (BWIM), an interactive benchmark for contextual meaning construction. In BWIM, models must resolve ambiguity by either performing a contextual inference or requesting clarification at a small communication cost. Evaluating several state-of-the-art LLMs, we find a dissociation between judgment and action: while models detect speaker unreliability in explicit confidence ratings, they fail to exploit this information to guide efficient clarification behavior. Instead, we observe suboptimal strategies, such as partner-blind over-clarification and question-averse guessing under uncertainty. 1 Introduction Many linguistic theories posit that human language processing relies on a two-tier system consisting of a more general literal meaning and pragmatics – the latter being responsible for a flexible contextual meaning creation building on top of literal meaning 11 ; 26 ; 5 . To what extent is such a two-tier system beneficial for artificial conversational agents? And are literal and pragmatic processing already represented in conversational systems? This paper investigates these questions through a recently introduced task designed to test whether an agent can distinguish between literal meaning and contextual inference. A standard diagnostic for distinguishing literal meaning from pragmatic inference is cancellability: contextual inferences are defeasible and may fail in contexts where the literal content remains reliable ( 5 ; 10 ) . In repeated interaction, this defeasibility can be revealed implicitly, as interlocutors learn that drawing contextual inferences with a given partner often leads to incorrect interpretations, whereas reliance on literal meaning does not. The task used in this paper leverages this asymmetry by testing whether conversational agents adapt their interpretations over time, selectively discounting contextual inferences while preserving literal content. The task involves a building scenario where an agent interacts with two distinct speakers. • Speaker A expects the agent to draw standard contextual inferences. • Speaker B is "literal-only"; their instructions can only be trusted at the level of literal content, and drawing inferences might lead to errors (Figure 1 ). Figure 1: The builder receives feedback in the literal speaker condition about the fact that the pragmatic inference about continuing with the same color failed. Through repeated interaction, the agent must learn to trust or cancel inferences based on the speaker’s identity. This setup allows us to observe whether the agent maintains a representation of what was literally said versus what was inferred based on the context. A further goal of this work is methodological. Much prior work on pragmatic competence in language models relies on explicit metalinguistic judgments, e.g., asking models to select or explain the intended interpretation of an utterance ( 7 ; 33 ; 27 ; 28 ) . While informative, such evaluations probe pragmatic knowledge in isolation rather than its use in situated actions. In contrast, our task evaluates the ability to contextualize meaning implicitly, through task success and information-seeking behavior in an interactive setting. This allows us to assess whether models can deploy pragmatic inferences appropriately when they matter for achieving goals, rather than merely articulating them when prompted. We evaluate three state-of-the-art LLMs on this task, comparing their performance against human benchmarks. Our evaluation proceeds in two stages. In the first, agents report confidence ratings after each trial, allowing us to track adaptation as shifts in subjective certainty and to assess whether models distinguish literal from contextually enriched interpretations. In the second, we introduce Build What I Mean (BWIM) , a new interactive benchmark that reframes the task as a multi-turn dialogue in which agents may seek clarification at a cost, allowing us to examine whether models translate uncertainty into effective information-seeking behavior. We observe dissociation between explicit and implicit uncertainty management: models that detect speaker unreliability in their confidence ratings nonetheless fail to exploit this signal to create an efficient information-seeking strategy. Our experiment design allows us to assess not just whether models draw pragmatic inferences, but whether they can selectively cancel them in response to partner-specific evidence — and whether that internal sensitivity surfaces in action, not only in judgment. 2 The adaptation task Condition Example Instruction Underspecified (number) Stack three green blocks behind the existing green block. Build a yellow stack to the right of the green one. Underspecified (color) Stack three blue blocks in front of the existing blue blocks. Then stack two blocks to the left of the tower you just built. Fully-specified Stack three red blocks in the bottom right corner. Put two yellow blocks on top of the red stack you just built. Table 1: Example items for the two experimental conditions: fully-specified and underspecified instructions. Fully-specified instructions include information about the color and number of building blocks. In the underspecified condition , either color, or number of blocks is omitted, requiring models to infer the intended information. The setup used to test whether agents are aware of contextual inferences involves two speaker profiles in a block-building game. The task is to construct simple structures on a 3D grid that satisfy instructions given by two types of agents: Literal Lisa or Pragmatic Pia. Instructions from both speakers are sometimes underspecified, omitting the color or the number of blocks to be used (Table 1 ). Pragmatic Pia shortens her utterances only when the missing information can be recovered from context, whereas Literal Lisa occasionally makes errors by omitting information even when the contextual inference leads to an incorrect interpretation (see Figure 1 ). The relevant contextual inference is that, if not stated otherwise, the color and size of a structure should match those of the most recently built one. This inference has been observed in previous dialog-based block-building games ( 18 ; 8 ; 16 ) , see Figure 2 for an excerpt from a dialog where this particular inference is canceled. Moreover, computational models trained on these datasets have been shown to reproduce this inference 19 . It was also shown in a the human study with the same stimuli that participants draw these inferences spontaneously without prior exposure to the task ( 20 ) . The builder agent can learn about the partner’s reliability from feedback obtained during repeated interactions with the same speaker. After each structure is submitted, the builder receives feedback indicating the target structure that the speaker intended to communicate. As illustrated in Figure 1 , a human participant inferred the intended color, assuming the speaker was pragmatic, but the contextual inference was revealed to be wrong in the feedback. Example interaction between humans in the Minecraft Dialog Corpus Architect: aight that row is also done Architect: next row only has one block, and it floats above the purple block all the way to the right of row 3 Builder: (places a purple block at X:-3, Y:4, Z:0) Architect: my bad, the floating block should be red Figure 2: Example of contextual enrichment and cancellation in the Minecraft dialog corpus ( 18 ) . Throughout this paper, we use pragmatic competence in a