I Came, I Saw, I Explained: Benchmarking Multimodal LLMs on Figurative Meaning in Memes
2026
Read I Came, I Saw, I Explained: Benchmarking Multimodal LLMs on Figurative Meaning in Memes (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-23229.txt.
Description
Zhou and three co-authors test how well multimodal language models read figurative meaning in memes. Memes blend text and images to carry layered, often nonliteral messages. The team runs eight leading generative models on three datasets. The models must spot and explain six types of figurative meaning. Human raters then check whether each explanation backs its label and stays true to the meme. All models lean toward seeing figurative meaning even when none is there. Right labels also often come with unfaithful explanations.
Catalog record
| YEAR | 2026 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52155 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.23229