Learning to Communicate Across Modalities: Perceptual Heterogeneity in Multi-Agent Systems

Naomi Pitzer, Daniela Mihai · 2026

Read Learning to Communicate Across Modalities: Perceptual Heterogeneity in Multi-Agent Systems by Naomi Pitzer, Daniela Mihai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22041.txt.

Description

Naomi Pitzer and Daniela Mihai study how artificial agents invent ways to communicate when their senses differ. Research on emergent communication shows how agents develop shared, structured signals. Most studies, though, assume agents share the same modality or aligned representations of the world.

Real settings are messier. The authors study a multi-step binary communication game where agents differ in modality and lack perceptual grounding in a shared world. One agent's signal must cross into another's different way of sensing. Their 2026 preprint asks what shared structure can still emerge. The results speak to multi-agent systems deployed in the wild, where cameras, microphones, and other sensors rarely give matching views.

Catalog record

CREATORNaomi Pitzer, Daniela Mihai
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE26 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-22041

Browse the full library · About the Tower of Babel