OmniVerifier-M1: Multimodal Meta-Verifier with Explicit Structured Recalibration
2026
Read OmniVerifier-M1: Multimodal Meta-Verifier with Explicit Structured Recalibration (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-28805.txt.
Introduction
Xinchen Zhang and nine colleagues train OmniVerifier-M1, a broad visual verifier using symbolic meta-verification and split reward learning. Visual outcomes matter now for multi-input language models, making solid fine-grained checking essential for scaling broad base models. Boxed outputs like bounding boxes beat textual notes as meta-check reasons, giving fast rule-based reward signals without model-based rewards from helper judge models. Splitting reward goals for binary judgment and meta-verification beats joint reward tuning, since output shape and learning flow differ deeply.
Catalog record
| YEAR | 2026 |
|---|---|
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 53875 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.28805
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
OmniVerifier-M1: Multimodal Meta-Verifier with Explicit Structured Recalibration Abstract Visual outcomes are increasingly central to multimodal large language models, making reliable and fine-grained verification essential for scaling generalist foundation models. In this work, we investigate multimodal meta-verification , which leverages verifier-generated rationales rather than decision-only signals, and explore how to effectively incorporate meta-verification feedback into multimodal verifier training. We identify two key findings. First, symbolic verifier outputs (e.g., bounding boxes) outperform textual explanations as meta-verification rationales, enabling efficient rule-based reinforcement learning rewards while avoiding reliance on model-based rewards from auxiliary judge models. Second, decoupling reinforcement learning objectives for binary judgment and meta-verification substantially outperforms joint reward optimization, due to intrinsic differences in output structure and learning dynamics. Based on these insights, we train OmniVerifier-M1 , a generalist visual verifier leveraging symbolic meta-verification and decoupled reinforcement learning. OmniVerifier-M1 provides robust verification and fine-grained error localization, and further enables M1-TTS , a verifier-driven agentic generation system achieving dynamic region-level self-correction. This approach paves the way for more reliable, interpretable, and fine-grained multimodal verification, supporting safer and more controllable foundation model deployment. 1 Introduction Current multimodal large language models (MLLMs) demonstrate powerful reasoning and generative capabilities in a variety of inference scenarios and reasoning modes ( 11 ; 27 ; 6 ; 48 ) . Visual outcomes serve as a crucial bridge connecting multimodal understanding and generation, whether they are produced via agentic tool-use ( 23 ; 49 ) or through native generative processes ( 18 ; 9 ; 8 ) . In interleaved multimodal reasoning and interactive systems, enabling precise, fine-grained, and reliably evaluable verification of visual outcomes is a key requirement for scaling unified multimodal models and advancing generative intelligence. Universal verification of visual outcomes remains at an early stage. Most existing image reward models ( 36 ; 47 ) , such as RewardDance ( 35 ) and UnifiedReward ( 30 ) , focus primarily on training and evaluation in traditional text-to-image generation scenarios. OmniVerifier ( 48 ) marks an important step toward more general, world-modeling-oriented visual verification by leveraging reinforcement learning with binary (True/False) judgments of visual outcomes. However, feedback limited to binary decisions without supervision from detailed generative critiques can be coarse and uninformative, reducing the granularity needed for precise and effective judge model improvment ( 28 ; 32 ) . In this work, we move beyond binary verifier judgments and examine the reliability of verifier-generated rationales and explanations, a process referred to as meta-verification ( 28 ; 32 ) . Instead of relying on decision-level signals, meta-verification operates at the level of explanations to guide the learning objective, yielding more informative and more restrictive feedback. In the investigation of how to improve multimodal verifier training by integrating meta-verification feedback, this work identifies two core findings: Finding 1: Symbolic verifier outputs beat textual ones in meta-verification, enabling scalable and reliable rule-based RL rewards. Motivated by the highly structured and spatial nature of visual representations, we use symbolic outputs (e.g., bounding boxes or points) as rationales for meta-verification feedback when training the verifier, instead of relying on textual explanations. Textual rationales require additional judge models for evaluation, which slows down meta-verification feedback and increases the risk of reward hacking. In contrast, symbolic rationales provide a structured approximation of explanatory intent that can be directly assessed with explicit rules. Experiments show that in meta-verification training, symbolic rationales consistently match or outperform textual explanations, allowing rule-based feedback to replace model-based rewards, improving training efficiency while inherently preventing reward hacking. Finding 2: Decoupling RL rewards for binary judgment and meta-verification outperforms joint training in leveraging meta-verification feedback. In exploring how to better leverage meta-verification feedback for training the verifier, we find that combining binary judgment accuracy and meta-verification reward into a single joint reward for each sample offers little improvement in judgement accuracy. This is due to intrinsic differences in task structure and difficulty: binary judgments operate in a highly discrete output space, allowing the model to occasionally score well by chance, whereas meta-verification provides continuous, stronger supervision that effectively constrains such random behavior. To address this, we design a decoupling strategy that treats binary judgment and meta-verification as separate tasks with distinct reward systems for mixed data. Both empirical results and theoretical analysis confirm the superiority of decoupled training over joint training in the using of meta-verification. Based on these observations, we train OmniVerifier-M1 , a multimodal verifier adaptable to diverse multimodal foundation models ( 7 ; 3 ) . We adopt a decoupled training paradigm that leverages meta-verification feedback derived from symbolic outputs, enabling more effective and stable verifier optimization. Beyond serving as a multimodal visual verifier, OmniVerifier-M1 functions as a fine-grained multimodal optimizer that can precisely localize erroneous regions and provide actionable correction guidance. Building on this capability, we further develop a fine-grained multimodal agentic generation system, M1-TTS , in which verifier-driven decisions are expressed as heterogeneous, tool-level actions, including symbolic region localization and structured textual edit operations, and are iteratively coordinated through replanning to guide a unified foundation model toward region-level self-correction. Experimental results show that M1-TTS substantially outperforms conventional global-level multi-turn editing methods in correction effectiveness. Our contributions can be summarized as follows: • Multimodal Meta-Verification Paradigm: We bring meta-verification to multimodal setting, enabling fine-grained verifier feedback beyond binary judgment. • Symbolic Meta-Verification Rationales: We show that symbolic verifier outputs outperform textual explanations as meta-verification rationales, supporting efficient rule-based RL without reward hacking. • Decoupled Meta-Verification Training: We theoretically and empirically demonstrate that decoupling reinforcement learning objectives for binary judgment and meta-verification substantially outperforms joint reward optimization. • Generalist Verifier and Agentic Correction System: We develop OmniVerifier-M1 and M1-TTS , a generalist multimodal verifier and an agentic correction system that support robust visual verification and effective region-level self-correction across diverse generative foundation models. 2 Related Work Generative Veirifer or Reward Models. Unlike traditional reward models that only output a scalar reward ( 24 ; 45 ; 37 ; 21 ; 20 ) , generative verifiers provide interpretable, generative critiques, offering immense potential for scaling test-time computation or reinforcement learning ( 48 ; 19 ; 32 ; 42 ) . LLM- or VLM-as-a-Judge ( 50 ; 5 ; 4 ) methods leverage the reasoning capabilities of large models to make evaluations more transparent and accurate, pioneering the use of foundation models as evaluators. DeepSeekMath-V2 ( 28 ) introduces meta-verification to assesses whether issues identified by the verifier indeed exist, which enhance verifier training by providing strict supervision. OmniVerifier ( 48 ) identifies three fundamental atomic capabilities for verifying visual outcomes, marking a first step toward a general-purpose mutlimodal verifier for universal scenarios. However, exploration of multimodal verifiers is still in an early stage. Starting from the essence of visual representations, we develop a robust multimodal verifier training paradigm based on symbolic outputs with decoupled reinforcement learning. Iterative Refinement for Visual Generation. As we move towards more general visual generation scenarios, especially complex compositional generation ( 46 ; 41 ; 39 ) or world-knowledge reasoning tasks ( 31 ; 12 ; 40 ) , it is difficult to achieve perfect results in a single attempt. Many approaches address this by combining a visual verifier with a generative model, employing a generate-reflect-refine loop to progressively improve generated images ( 25 ; 16