“ Yeah Right! ” - Do LLMs Exhibit Multimodal Feature Transfer
Benjamin Reichman, Kartik Talamadupula · 2025
Read “ Yeah Right! ” - Do LLMs Exhibit Multimodal Feature Transfer by Benjamin Reichman, Kartik Talamadupula (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-04138.txt.
Description
Benjamin Reichman and Kartik Talamadupula ask, in twenty twenty-five, whether language models can transfer social reading skills across modes. Human talk mixes words with tone and intent. People first learn to read intent, such as sarcasm, in speech. They then carry that skill to writing. The authors test if speech-plus-text models and text models do the same. Their test task is to spot covert deceptive talk, where the surface words hide the real intent.
With no special prompting, speech-plus-text models beat text-only models on the task. Text models trained on human-to-human chat also had an edge. The authors say both findings mirror how humans learn to read between the lines.
Catalog record
| CREATOR | Benjamin Reichman, Kartik Talamadupula |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 37 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2501-04138