ProCrit: Self-Elicited Multi-Perspective Reasoning with Critic-Guided Revision for Multimodal Sarcasm Detection

Yingjia Xu, Jiulong Wu, Bowen Zhang, Baokui Guo, Siyuan Chai, Min Cao · 2026

Read ProCrit: Self-Elicited Multi-Perspective Reasoning with Critic-Guided Revision for Multimodal Sarcasm Detection by Yingjia Xu, Jiulong Wu, Bowen Zhang, Baokui Guo, Siyuan Chai, Min Cao (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-20867.txt.

Introduction

Yingjia Xu and five colleagues propose ProCrit, a proposal-critic design for multimodal sarcasm spotting. Sarcasm spotting needs reasoning over gaps between literal expression and intended meaning, yet needed perspectives vary by sample. Recent methods use fixed, predefined perspectives under hand-crafted routing rules, operating independently. ProCrit instead lets a proposal agent make the views each sample needs, while a critic agent checks externally and guides focused revision.

Catalog record

CREATORYingjia Xu, Jiulong Wu, Bowen Zhang, Baokui Guo, Siyuan Chai, Min Cao
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE64680
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.20867

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

ProCrit: Self-Elicited Multi-Perspective Reasoning with Critic-Guided Revision for Multimodal Sarcasm Detection Yingjia Xu, Jiulong Wu, Bowen Zhang, Baokui Guo, Siyuan Chai, Min Cao Abstract Multimodal sarcasm detection requires reasoning over cross-modal incongruities between literal expression and intended meaning, yet the specific analytical perspectives needed vary across samples due to the diversity of sarcastic mechanisms. While recent methods make this analytical process explicit, they still rely on fixed, predefined perspectives that operate independently under hand-crafted routing rules. We argue that multimodal sarcasm detection instead calls for self-elicited multi-perspective reasoning , where a model autonomously generates the perspectives needed for each sample and progressively integrates them into a coherent analysis. To realize this goal, we propose ProCrit , a Pro posal– Crit ic two-agent framework with a proposal agent for multi-perspective reasoning and a critic agent for external evaluation and targeted revision guidance. First, to overcome the lack of process-level supervision in existing sarcasm datasets, ProCrit synthesizes process-level reasoning annotations through a dynamic-role agentic rollout : a strong vision-language model sequentially spawns analytical roles within a shared context, and the resulting multi-role trajectories are flattened into sequences that preserve cross-perspective dependencies while enabling efficient autoregressive generation. Second, to improve reasoning reliability, ProCrit adopts a draft–critique–revise paradigm in which an independent critic identifies reasoning deficiencies and provides targeted natural-language feedback for directed revision. Finally, we develop a mutual-refinement training framework that jointly optimizes proposal drafting and feedback-guided revision via dual-stage reinforcement learning, while refining the critic agent according to the actual effectiveness of its feedback. Experiments on three widely used benchmarks demonstrate the effectiveness of ProCrit. 1 Introduction Multimodal sarcasm detection, determining whether an image-text pair conveys sarcastic intent, has attracted growing interest due to its importance in content moderation, sentiment analysis, and emotionally aware dialogue systems [ 13 , 24 , 1 ] . Sarcasm fundamentally relies on incongruities between literal expression and intended meaning, and in the multimodal setting these incongruities often span modalities, e.g., a caption reading “what a perfect day” paired with a photo of a traffic jam in a downpour. Detecting such incongruities is challenging because sarcasm arises from diverse mechanisms—verbal irony, hyperbole, rhetorical questions, cultural allusion, among others. Exposing the underlying incongruity requires examining the sample from multiple analytical perspectives —distinct angles of inspection such as probing a cultural reference, decoding exaggerated expressions, or evaluating scene plausibility against commonsense expectations, as illustrated in Fig. 6 . Which perspectives are needed and how they should be combined varies across samples, as different instances of sarcasm rely on distinct mechanisms and distribute critical cues across text and image in different ways. To address this challenge, early works [ 4 , 19 , 18 ] have explored increasingly sophisticated cross-modal fusion strategies through attention, graph-based, and contrastive learning mechanisms, in an effort to capture the diverse signals that underlie sarcastic intent. Recent methods explicitly model the analytical reasoning process by prompting Large Language Models (LLMs) or Vision–Language Models (VLMs) with a fixed, predefined set of analytical perspectives, each operating independently under hand-crafted routing rules. Although promising, these methods overlook that the analytical perspectives needed are inherently sample-specific, and thus the fixed, predefined set can hardly cover the diverse reasoning demands across samples; and that effective multi-perspective analysis should be progressive: the exploration of each subsequent perspective should be informed by insights gleaned from prior analytical steps. This calls for self-elicited multi-perspective reasoning in which the model autonomously explores and integrates different analytical perspectives on its own and progressively builds a sample-adaptive, coherent analysis. In this work, we make the first attempt to equip multimodal sarcasm detection with self-elicited multi-perspective reasoning , a capability that enables the model to dynamically generate the analytical perspectives required for each input sample and progressively integrate them into a coherent analysis, where each perspective builds upon evidence uncovered by preceding analyses. Nevertheless, achieving this goal raises two considerations. ❶ Absence of process-level supervision. Internalizing the self-elicited multi-perspective reasoning capability in a single model requires training with explicit supervision over the reasoning process, yet existing sarcasm datasets [ 26 , 6 ] provide only binary labels or brief explanation of the intended meaning, with no annotations capturing the underlying analytical process. ❷ Reasoning reliability under subtle cues. Because sarcastic intent often depends on subtle, implicit, and cross-modal cues, a model equipped with self-elicited multi-perspective reasoning capability may still leave important aspects unaddressed, misinterpret weak signals, or fail to resolve the underlying incongruity, making the resulting reasoning incomplete or flawed. In view of these, we present ProCrit , a Pro posal– Crit ic two-agent framework comprising a proposal agent that performs multi-perspective reasoning and a critic agent that provides external evaluation and targeted revision guidance, building on three components. ❶ Process-level reasoning annotation synthesis . To provide process-level training supervision, we synthesize reasoning annotations through a dynamic-role agentic rollout , where a strong vision-language model sequentially spawns analytical roles, each contributing a distinct perspective within a shared context. Each role has full visibility of all preceding analyses and autonomously determines what perspective is still needed and when analysis is sufficient. The resulting multi-role collaborative dynamics is then flattened into a unified reasoning sequence and distilled into a student model, effectively transforming explicit cross-role context propagation into implicit information flow, eliminating the need to re-encode prior context and yielding rich process-level supervision. ❷ Draft–critique–revise paradigm . To improve reasoning reliability, we introduce a draft–critique–revise paradigm that decouples generation from evaluation rather than relying on self-correction, which prior work shows can be unreliable without external signals [ 11 , 14 , 33 , 41 , 17 , 2 ] : the proposal agent first drafts an initial multi-perspective reasoning; the independent critic agent then evaluates it and provides targeted natural-language feedback that points out specific deficiencies; the proposal agent revises its reasoning from scratch under this feedback, enabling directed improvement rather than uninformed retry. ❸ Mutual-refinement training strategy . We further develop a mutual-refinement training strategy where the two agents are alternately optimized through reciprocal training signals: the proposal agent’s drafting and revision abilities are jointly optimized via dual-stage reinforcement learning using the critic agent’s feedback as training signal, while the proposal’s revision outcomes reciprocally refine the critic—grounding its feedback quality in actual revision effectiveness. Our contributions are summarized as follows: • We introduce ProCrit , a two-agent framework that reformulates multimodal sarcasm detection from manually prescribing perspectives to self-elicited multi-perspective reasoning, where analytical perspectives are generated adaptively and integrated progressively. • We introduce a process-level reasoning annotation synthesis strategy based on dynamic-role agentic rollout , which generates progressive, sample-specific analytical trajectories. • We propose a critic-guided draft–critique–revise paradigm with mutual-refinement training strategy , which improves reasoning reliability through external critique while optimizing revision and critique quality in a reciprocal optimization process. 2 Method We develop ProCrit , a Proposal-Critic two-agent framework for multi-perspective reasoning in multimodal sarcasm detection, comprising a proposal agent that drafts and revises multi-perspective reasoning and a critic agent that provides external evaluation and targeted revision guidance. The framework contains three components: (1) process-level reasoning annotation synthesis uses a dynamic-role agentic rollout to dynamically generate analytical roles based on the findings established by preceding analyses and the remaining unaddressed aspects; (2) a draft–critique–revise paradigm improves

Read the complete text