IRONIC : Coherence-Aware Reasoning Chains for Multi-Modal Sarcasm Detection
Aashish Anantha Ramakrishnan, Aadarsh Anantha Ramakrishnan, Dongwon Lee · 2025
Read IRONIC : Coherence-Aware Reasoning Chains for Multi-Modal Sarcasm Detection by Aashish Anantha Ramakrishnan, Aadarsh Anantha Ramakrishnan, Dongwon Lee (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-16258.txt.
Introduction
Aashish Anantha Ramakrishnan and co-authors presented IRONIC in this 2025 paper on spotting sarcasm in posts that mix images and text. Sarcasm is hard for machines because the words often mean the opposite of what they say. Most current tools need heavy task-specific training to catch it.
IRONIC instead reasons in steps about how the image and text relate, checking reference, analogy, and tone. It learns from examples in the prompt rather than from retraining. Across several baselines, the method reached the best scores yet on zero-shot sarcasm spotting. The authors argue that borrowing ideas from language and mind research makes machine reasoning stronger.
Catalog record
| CREATOR | Aashish Anantha Ramakrishnan, Aadarsh Anantha Ramakrishnan, Dongwon Lee |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 22 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-16258
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
IRONIC : Coherence-Aware Reasoning Chains for Multi-Modal Sarcasm Detection Aashish Anantha Ramakrishnan, Aadarsh Anantha Ramakrishnan, Dongwon Lee Abstract Interpreting figurative language such as sarcasm across multi-modal inputs presents unique challenges, often requiring task-specific fine-tuning and extensive reasoning steps. However, current Chain-of-Thought approaches do not efficiently leverage the same cognitive processes that enable humans to identify sarcasm. We present IRONIC , an in-context learning framework that leverages Multi-modal Coherence Relations to analyze referential, analogical and pragmatic image-text linkages. Our experiments show that IRONIC achieves state-of-the-art performance on zero-shot Multi-modal Sarcasm Detection across different baselines. This demonstrates the need for incorporating linguistic and cognitive insights into the design of multi-modal reasoning strategies. Our code is available at: https://github.com/aashish2000/IRONIC 1 Introduction Figure 1: Overview of the IRONIC proposed framework Sarcasm can be defined as a form of verbal irony where the goal is to mock or convey contempt while the literal meaning of the words is different, often opposite to the intended meaning Camp 2012 . Multi-modal sarcasm utilizes the interplay between these visual and text cues to convey these intents. The task of multi-modal sarcasm detection is helpful for various applications, including social media analysis, sentiment analysis, and human-computer interaction Pang and Lee 2008 . With traditional supervised learning approaches demonstrating limited success in this domain, recent research has focused on leveraging Multi-modal Large Language Models (MLLMs) to improve performance Tang et al. 2024 . These models have shown promise even in Zero-Shot settings, where they can generalize to new tasks without explicit training data. The complexity of multi-modal sarcasm detection stems from the fact that it incorporates a combination of semantic, pragmatic, and analogical cues, which are not aligned with the logical and sequential nature of traditional reasoning strategies of language models Yao et al. 2025 ; Kumar et al. 2022 . This leads to models taking shortcuts such as over-reliance on uni-modal cues and failing to discern sarcasm from other forms of figurative language Liang et al. 2022 ; Qin et al. 2023 . Existing approaches for prompt-based reasoning in MLLMs have focused on leveraging different varieties of logical chains, such as Chain-of-Thought (CoT) prompting Wei et al. 2022 . Inspired by the success of text-only cognition-aware and linguistics-based reasoning strategies Wang and Zhao 2024 ; Lee et al. 2025 , we propose IRONIC (expl I cit R easoning with c O herence relatio N s as cogn I tive stru C tures). IRONIC leverages multi-modal Coherence Relations Anantha Ramakrishnan et al. 2025a ; Alikhani et al. 2020 to provide a structured reasoning pathway for MLLMs to follow while identifying image-text incongruencies. Coherence Relations (CR) are a formal theory of discourse Hobbs 1978 that provides a formal framework for understanding how different communicative components relate to each other Hobbs 1978 . As a task-independent framework, CR-based reasoning can help generate informative rationales for multi-modal sarcasm detection. We analyze the capabilities of both proprietary (GPT-4o) and open-source models (InternVL3) in using Coherence Relations for reasoning Zhu et al. 2025 ; OpenAI et al. 2024 . Our findings on two different datasets: MMSD2.0 Qin et al. 2023 and RedEval Tang et al. 2024 show that the higher-order reasoning abilities of MLLMs play a crucial role in how they leverage CRs. IRONIC enables more pragmatically-aware models such as GPT-4o OpenAI et al. 2024 to achieve state-of-the-art performance on zero-shot multi-modal sarcasm detection tasks. The contributions of this work can be summarized as follows: • We present IRONIC , a coherence-aware in-context reasoning framework that leverages Multi-modal Discourse Coherence Relations for effectively analyzing image-text incongruencies. • IRONIC enables MLLMs with emergent higher-order reasoning capabilities to outperform existing multi-step reasoning strategies such as CoT in zero-shot settings across different datasets. • Our results demonstrate the importance of leveraging linguistic and cognitive insights into the design of multi-modal reasoning chains, improving the performance of MLLMs on pragmatic and analogical comprehension tasks. 2 Related Work 2.1 Multi-Modal Sarcasm Detection Initial approaches for multi-modal sarcasm detection utilized supervised deep learning models to incorporate image and text features Schifanella et al. 2016 ; Das and Clark 2018 . Attention mechanisms further improved their abilities to associate image-text features across modalities Pan et al. 2020 ; Wu et al. 2021 . This led to the incorporation of more modalities such as audio, video, and facial expressions Castro et al. 2019 ; Ray et al. 2022 . However, models still struggled to comprehend complex relationships between image-text modalities required for sarcasm understanding. With the popularity of pre-training architectures such as CLIP Radford et al. 2021 and MLLMs, the capabilities of these models in identifying sarcastic content expanded further Jia et al. 2024 . Prompting-based approaches gained prominence due to their ability to generalize across domains without task-specific fine-tuning Wang et al. 2024 ; Zhang et al. 2025b . Relations Referential Pragmatic Analogical Insertion • ✓ • Concretization ✓ ✓ • Projection • ✓ ✓ Restatement ✓ • • Extension • ✓ ✓ Table 1: Classification of CRs by type of cognitive reasoning. Green checkmarks indicate the presence of each reasoning type, while dots indicate absence. 2.2 Image-Text Relation Understanding Traditional multi-modal models worked solely on the assumption that information across modalities is highly correlated with each other Radford et al. 2021 , with tasks such as image captioning and image generation leveraging their strong semantic overlap Mahajan and Roth 2020 ; Liu et al. 2021 . However, as these multi-modal models expanded their applications across different task domains such as news Anantha Ramakrishnan et al. 2024 and social media Xu et al. 2022 ; Vempala and Preoţiuc-Pietro 2019 , the need for enhanced reasoning beyond semantic overlap became clear. Coherence Relations offer a cohesive framework for connecting different types of reasoning across multiple modalities and have improved model comprehension capabilities across different domains Alikhani et al. 2020 ; Alikhani et al. 2022 ; Xu et al. 2022 ; Sosea et al. 2021 . Motivated by these insights, we analyze the incorporation of CRs as a cognitive reasoning scaffold for multi-modal sarcasm detection. 3 Methodology The proposed IRONIC framework, as shown in Figure 1 , constructs a reasoning chain with 2 main components: (1) Relation Extraction (2) Interpretative Reasoning. The predicted CR distributions and specific prompts are shown in the Appendix Sections A & C . 3.1 Relation Extraction The Relation Extraction step analyzes each image-text pair and predicts the most applicable CR along with a rationale to justify its selection. As depicted in Table 1 , we utilize CRs that provide coverage of referential, analogical, and pragmatic reasoning types with varying levels of granularity. The selection of these CRs is supported by their applicability to analyzing image-text pairs from social media domains Xu et al. 2022 , ensuring strong generalizability with the datasets utilized for multi-modal sarcasm detection. The outputs of this step include the predicted CRs and their supporting rationales for each sample. Our framework incorporates 5 distinct CRs: • Insertion : The reader must infer the referent object or entity from the visual concept with no explicit mentions in the text. • Concretization : Identifies explicit referential alignment between image and text along with implied communicative intents. • Projection : Presents an analogical mapping between topics discussed in the