I Came, I Saw, I Explained: Benchmarking Multimodal LLMs on Figurative Meaning in Memes

2026

Read I Came, I Saw, I Explained: Benchmarking Multimodal LLMs on Figurative Meaning in Memes (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-23229.txt.

Description

Zhou and three co-authors test how well multimodal language models read figurative meaning in memes. Memes blend text and images to carry layered, often nonliteral messages. The team runs eight leading generative models on three datasets. The models must spot and explain six types of figurative meaning. Human raters then check whether each explanation backs its label and stays true to the meme. All models lean toward seeing figurative meaning even when none is there. Right labels also often come with unfaithful explanations.

Catalog record

YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE52155
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2603.23229

Browse the full library · About the Tower of Babel