“ Yeah Right! ” - Do LLMs Exhibit Multimodal Feature Transfer

Benjamin Reichman, Kartik Talamadupula · 2025

Read “ Yeah Right! ” - Do LLMs Exhibit Multimodal Feature Transfer by Benjamin Reichman, Kartik Talamadupula (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2501-04138.txt.

Description

Benjamin Reichman and Kartik Talamadupula ask, in twenty twenty-five, whether language models can transfer social reading skills across modes. Human talk mixes words with tone and intent. People first learn to read intent, such as sarcasm, in speech. They then carry that skill to writing. The authors test if speech-plus-text models and text models do the same. Their test task is to spot covert deceptive talk, where the surface words hide the real intent.

With no special prompting, speech-plus-text models beat text-only models on the task. Text models trained on human-to-human chat also had an edge. The authors say both findings mirror how humans learn to read between the lines.

Catalog record

CREATORBenjamin Reichman, Kartik Talamadupula
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2501-04138

Browse the full library · About the Tower of Babel