Distributed Partial Information Puzzles: Examining Common Ground Construction Under Epistemic Asymmetry

2026

Read Distributed Partial Information Puzzles: Examining Common Ground Construction Under Epistemic Asymmetry (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-05450.txt.

Introduction

Yifan Zhu and the rest of the team present the Distributed Partial Information Puzzle. Establishing common ground, shared beliefs and mutually recognized facts, underpins collaboration, yet challenges current AI systems. The authors present a mixed data set, annotated and aligned across speech, gesture, and action. They test two common-ground models: large language models inferring shared beliefs, and an axiomatic Dynamic Epistemic Logic pipeline performing the same task incrementally. Annotated DPIP results challenge modern large language models tracking task progression and belief state.

Catalog record

YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE41852
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.05450

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Distributed Partial Information Puzzles: Examining Common Ground Construction Under Epistemic Asymmetry Abstract Establishing common ground , a shared set of beliefs and mutually recognized facts, is fundamental to collaboration, yet remains a challenge for current AI systems, especially in multimodal, multiparty settings, where the collaborators bring different information to the table. We introduce the Distributed Partial Information Puzzle (DPIP) , a collaborative construction task that elicits rich multimodal communication under epistemic asymmetry. We present a multimodal dataset of these interactions, annotated and temporally aligned across speech, gesture, and action modalities to support reasoning over propositional content and belief dynamics. We then evaluate two paradigms for modeling common ground (CG): (1) state-of-the-art large language models (LLMs), prompted to infer shared beliefs from multimodal updates, and (2) an axiomatic pipeline grounded in Dynamic Epistemic Logic (DEL) that incrementally performs the same task. Results on the annotated DPIP data indicate that it poses a challenge to modern LLMs’ abilities to track both task progression and belief state. Keywords: common ground, collaborative tasks, multimodality Distributed Partial Information Puzzles: Examining Common Ground Construction Under Epistemic Asymmetry Yifan Zhu 1 , Mariah Bradford 2 , Kenneth Lai 1 , Timothy Obiso 1 Videep Venkatesha 2 , James Pustejovsky 1 , and Nikhil Krishnaswamy 2 1 Brandeis University, 2 Colorado State University 415 South St, Waltham, MA 02453, Fort Collins, CO 80523 {zhuyifan, jamesp}@brandeis.edu, [email protected], [email protected] Abstract content 1. Introduction Effective collaboration between humans depends on establishing common ground —a set of shared beliefs and agreed-upon facts in a task context. Doing so enables them to align perspectives, coordinate actions, and achieve joint goals 14 ; 62 ; 2 ; 17 . However, humans rarely begin a task with the exact same background, perspective, or information, meaning that construction of common ground requires them to resolve epistemic asymmetry 77 and effectively communicate and make inferences about partial or privately-held information that their interlocutors may have. These complexities are amplified in co-situated interaction , which involves significant multimodal components, as humans communicate through both verbal cues (speech) and non-verbal cues such as gestures and actions in context 10 ; 68 ; 21 ; 33 ; 41 ; 55 . The challenges are multiplied further when collaborations involve more than just two parties, as in this case each individual has to integrate and coordinate with multiple information sources. Common ground, dialogue state tracking, collaboration, theory of mind, and related issues have been the objects of intense study and interest within dialogue research, NLP, and AI more generally. However, data that enables the robust study of these topics in multiparty, co-situated, epistemic-asymmetric collaboration, and illuminates the challenges it poses to state-of-the-art (SOTA) AI systems remains sparse. In this paper, we introduce a task we call a “Distributed Partial Information Puzzle” (DPIP), which is realized as a type of collaborative construction task. In the task, three “directors” are each given individual partial information about a goal structure and must collaboratively instruct one “builder” to construct a single contiguous structure that is that consistent with all three pieces of individual information (Fig. 1 ). We present a dataset of DPIP interactions annotated with speech transcriptions, gestures, and actions in context, as well as the propositional information communicated through each of these modalities. Further, we investigate the ability of SOTA LLMs to track and reason about information exchange in this context, to establish the challenges this type of task and domain poses to SOTA AI systems. Our annotated data and evaluation code, including prompts, are available through https://doi.org/10.5281/zenodo.18626419 , and will be a continually updated community resource. Figure 1: A builder and 3 directors participating in the DPIP task with a partially-completed structure on the table. Director 1 (second from left) is indicating the position of a block using a gesture as well as a speech act. 2. Related Work Common ground has long been studied in linguistics, philosophy, and computational dialogue research as the process by which interlocutors establish shared understanding through communicative acts 14 ; 62 . Later work formalizes its role within discourse structure and collaborative learning 2 ; 17 , viewing common ground as an evolving set of shared beliefs that enable coordination and joint action. Because human communication is inherently multimodal, grounding extends beyond speech. Prosody conveys intention beyond propositional content 56 ; 13 , gaze signals attentional focus and shared reference 19 ; 26 , and gesture complements or substitutes for verbal acts to enrich meaning 32 ; 7 . Together these modalities form the substrate through which common ground dynamically emerges. Situated language understanding has been explored previously in physical and virtual environments 74 ; 35 ; 50 ; 37 ; 5 ; 12 ; 59 ; 34 ; 36 ; 61 . Related work models how interlocutors infer intentions and beliefs 11 ; 27 , track dialogue state 71 , and display theory-of-mind–like reasoning 54 ; 65 ; 45 ; 57 . However, few datasets capture all three challenges—multiparty interaction, co-situatedness, and epistemic asymmetry—simultaneously. Among existing corpora, the HCRC Map Task 1 and EGGNOG 69 model two-party co-situated collaboration; MindCraft 3 introduces partial observability in a virtual world; and DeliData 28 provides multiparty deliberation but no embodied action. The Weights Task 29 ; 31 ; 30 ; 67 combines gesture and action in a co-situated setting, yet its full observability constrains the epistemic richness of belief negotiation. Our DPIP task complements these efforts by uniting all three aspects—multimodality, multi-party interaction, and asymmetric knowledge—within a collaborative construction domain. Work on competitive or deceptive multi-agent settings also examines reasoning under partial information. For example, 76 develop Werewolf agents that infer hidden roles and intentions, extending theory-of-mind frameworks 4 ; 23 ; 51 . In contrast, the DPIP task is cooperative: participants integrate truthful but partial evidence to build a shared representation of a physical goal. While 76 emphasize emotional and deceptive cues, our focus is on task-oriented multimodal grounding , where gesture and action encode propositional information central to problem-solving. Complementary work by 58 employs Dynamic Epistemic Logic (DEL) to evaluate theory-of-mind reasoning in text-based scenarios. Our approach extends this logic-driven perspective to a co-situated multimodal setting, where updates to belief states must be inferred jointly from speech, gesture, and action. Large language models (LLMs) show strong results in discourse reasoning and implicit inference 20 ; 46 ; 75 , yet to our knowledge, no prior study has systematically evaluated whether LLMs can infer and track common ground in collaborative, multimodal, and partially-observable environments such as DPIP. 3. Task Description and Dataset 3.1. Distributed Partial Information Puzzle The Distributed Partial Information Puzzle (DPIP), is a collaborative problem-solving paradigm in which essential information is distributed among participants, making communication a requirement for task success. Unlike traditional shared-information tasks, DPIPs deliberately prevent any single participant from solving the puzzle independently, thereby enforcing communication as the primary means of coordination. Our DPIP task is a collaborative construction task, performed in groups of four, wherein each of three “directors” is given different partial information about a structure and have to collaboratively instruct one “builder” to build a single contiguous structure out of large Lego blocks, that is consistent with all pieces of information. See Fig. 1 . The task is complete

Read the complete text