A Compressive-Expressive Communication Framework for Compositional Representations
Rafael Elberg, Felipe del Rio, Mircea Petrache, Denis Parra · 2025
Read A Compressive-Expressive Communication Framework for Compositional Representations by Rafael Elberg, Felipe del Rio, Mircea Petrache, Denis Parra (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-19182.txt.
Description
Rafael Elberg and co-authors teach artificial agents to invent a structured language. Their 2025 paper targets compositionality: building complex meanings from simple parts. Neural nets still learn this trait unreliably. Their framework, CELEBI, plays a game where a sender describes a scene in symbols and a receiver rebuilds it.
Three tricks shape the language toward compact yet rich codes. The receiver must rebuild partial scenes after each symbol, which rewards stepwise sense. New agent generations copy rebuilds, not raw messages, squeezing the code. A spread rule pushes messages apart, tied to entropy gains. On two 3D shape data sets, the method beat prior systems on rebuild accuracy and structure match. The work links simple biases to orderly invented languages.
Catalog record
| CREATOR | Rafael Elberg, Felipe del Rio, Mircea Petrache, Denis Parra |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 84 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-19182