How does fine-tuning improve sensorimotor representations in large language models?
Minghua Wu, Javier Conde, Pedro Reviriego, Marc Brysbaert · 2026
Read How does fine-tuning improve sensorimotor representations in large language models? by Minghua Wu, Javier Conde, Pedro Reviriego, Marc Brysbaert (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-03313.txt.
Description
Minghua Wu and three colleagues probe a weakness of large language models called the embodiment gap. Models learn from text, so their sense of how words feel, move, or sound often drifts from human bodily experience. The 2026 study asks whether focused fine-tuning with human ratings can pull those internal representations closer to human ones.
Using similarity analysis across concepts, the team finds fine-tuning reorganizes the model's semantic space in a targeted way rather than lifting everything evenly. Which base model started best barely predicts which tuned model ends best. Gains carry across languages and related senses, yet fail to transfer when the task format changes sharply. The results show model representations stay surprisingly flexible under the right supervision.
Catalog record
| CREATOR | Minghua Wu, Javier Conde, Pedro Reviriego, Marc Brysbaert |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34639 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.03313