Learning to Communicate Across Modalities: Perceptual Heterogeneity in Multi-Agent Systems
Naomi Pitzer, Daniela Mihai · 2026
Read Learning to Communicate Across Modalities: Perceptual Heterogeneity in Multi-Agent Systems by Naomi Pitzer, Daniela Mihai (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-22041.txt.
Description
Naomi Pitzer and Daniela Mihai study how artificial agents invent ways to communicate when their senses differ. Research on emergent communication shows how agents develop shared, structured signals. Most studies, though, assume agents share the same modality or aligned representations of the world.
Real settings are messier. The authors study a multi-step binary communication game where agents differ in modality and lack perceptual grounding in a shared world. One agent's signal must cross into another's different way of sensing. Their 2026 preprint asks what shared structure can still emerge. The results speak to multi-agent systems deployed in the wild, where cameras, microphones, and other sensors rarely give matching views.
Catalog record
| CREATOR | Naomi Pitzer, Daniela Mihai |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 26 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2601-22041