Minimal symbol grounding through language statistics: An information theoretic approach quantifying uncertainty

Max M. Louwerse · 2026

Read Minimal symbol grounding through language statistics: An information theoretic approach quantifying uncertainty by Max M. Louwerse (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/pmc-13529850.txt.

Description

Max M Louwerse asks how much of a word's emotional tone can be recovered from language patterns alone. The symbol grounding problem asks how words get meaning at all, rather than by reference to other words. His 2026 study turns the question into a measurement using Shannon's information theory.

Starting with a small model lexicon, then a full one, he computes the uncertainty about a word's valence under three conditions: no grounding, a few grounded seed words, and full grounding. Sounds and frequency alone shaved off a little uncertainty. Word embeddings spread through the word network helped much more once a few seeds were pinned down. A pinch of grounding plus rich statistics resolves most of the doubt.

Catalog record

CREATORMax M. Louwerse
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE43 KB
VERSION1.0
LICENSECC BY 4.0
RIGHTSCC BY
SOURCEEurope PMC

Source: https://europepmc.org/articles/PMC13529850

Browse the full library · About the Tower of Babel