Beneath the Surface: Investigating LLMs’ Capabilities for Communicating with Subtext

Kabir Ahuja, Yuxuan Li †, Andrew Kyle Lampinen † · 2026

Read Beneath the Surface: Investigating LLMs’ Capabilities for Communicating with Subtext by Kabir Ahuja, Yuxuan Li †, Andrew Kyle Lampinen † (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-05273.txt.

Introduction

Ahuja, Li, and Lampinen study whether language models can use subtext, meaning beyond literal content, introducing four suites. Settings range from allegories to games inspired by Dixit. Models bias toward overly literal communication, failing nuanced constraints; even the best generate literal clues 60 percent of times in Visual Allusions. Some models use common ground for subtext, cutting overly literal clues by 30 to 50 percent, but struggle to infer it when unstated. Paratextual and persona conditions shift allegory interpretation. The work quantifies subtext and reveals weaknesses of current models.

Catalog record

CREATORKabir Ahuja, Yuxuan Li †, Andrew Kyle Lampinen †
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE121630
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2604.05273

Browse the full library · About the Tower of Babel