OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipe

Kaichen Zhang, Keming Wu, Zuhao Yang, Kairui Hu, Bin Wang, Ziwei Liu, Xingxuan Li, Lidong Bing · 2025

Read OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipe by Kaichen Zhang, Keming Wu, Zuhao Yang, Kairui Hu, Bin Wang, Ziwei Liu, Xingxuan Li, Lidong Bing (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-16334.txt.

Introduction

Kaichen Zhang and eight co-authors release OpenMMReasoner, a fully open recipe for training models that reason across images and text. Progress in multimodal reasoning has been hard to reproduce because the data curation and training choices behind strong results are usually kept private.

The recipe has two stages. A supervised stage trains on a cold-start set of about 874,000 samples, each with checked step-by-step reasoning. A reinforcement learning stage then refines the model on about 74,000 samples drawn from varied domains. The result improved on the Qwen2.5-VL-7B-Instruct baseline by 11.6 percent across nine multimodal reasoning benchmarks. All code, pipelines, and data are public, giving other groups a solid base to build on.

Catalog record

CREATORKaichen Zhang, Keming Wu, Zuhao Yang, Kairui Hu, Bin Wang, Ziwei Liu, Xingxuan Li, Lidong Bing
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE51 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-16334

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

OpenMMReasoner: Pushing the Frontiers for Multimodal Reasoning with an Open and General Recipe Kaichen Zhang, Keming Wu, Zuhao Yang, Kairui Hu, Bin Wang, Ziwei Liu, Xingxuan Li, Lidong Bing Abstract Recent advancements in large reasoning models have fueled growing interest in extending such capabilities to multimodal domains. However, despite notable progress in visual reasoning, the lack of transparent and reproducible data curation and training strategies remains a major barrier to scalable research. In this work, we introduce OpenMMReasoner , a fully transparent two-stage recipe for multimodal reasoning spanning supervised fine-tuning (SFT) and reinforcement learning (RL). In the SFT stage, we construct an 874K-sample cold-start dataset with rigorous step-by-step validation, providing a strong foundation for reasoning capabilities. The subsequent RL stage leverages a 74K-sample dataset across diverse domains to further sharpen and stabilize these abilities, resulting in a more robust and efficient learning process. Extensive evaluations demonstrate that our training recipe not only surpasses strong baselines but also highlights the critical role of data quality and training design in shaping multimodal reasoning performance. Notably, our method achieves a 11.6% improvement over the Qwen2.5-VL-7B-Instruct baseline across nine multimodal reasoning benchmarks, establishing a solid empirical foundation for future large-scale multimodal reasoning research. We open-sourced all our codes, pipeline, and data at https://github.com/EvolvingLMMs-Lab/OpenMMReasoner . https://evolvinglmms-lab.github.io/OpenMMReasoner/ Figure 1 : Performance Comparison with State-of-the-Art Large Multimodal Reasoning Models across Various Benchmarks. Our proposed OpenMMReasoner consistently outperforms competing methods, highlighting its effectiveness in complex reasoning tasks. 1 1 footnotetext: Equal contribution. ✉ Corresponding author. 1 Introduction With the rapid progress of reinforcement learning with verifiable rewards (RLVR), leading models such as DeepSeek-R1 ( 11 ) and OpenAI o3 ( 26 ) have demonstrated strong reasoning capabilities across mathematics, programming, and scientific tasks. These advancements highlight RLVR as an effective paradigm for improving structured reasoning in large language models (LLMs). Motivated by this progress, researchers have increasingly explored RL-enhanced reasoning from LLMs to large multimodal models (LMMs). Recent studies ( 25 ; 4 ; 8 ; 39 ) push the boundaries of multimodal reasoning, showing that reinforcement learning (RL) can strengthen fine-grained visual understanding and complex cross-modal problem-solving. These developments suggest that the benefits of RLVR can transfer beyond text, offering a scalable path toward more capable and reliable multimodal reasoning systems. Despite these advancements, transparency across the training pipeline remains limited. While numerous studies investigate the supervised-finetuning (SFT) and RL stages ( 3 ; 26 ; 7 ) , few provide details of their data curation processes or conduct comprehensive ablation analyses. This lack of openness restricts reproducibility and obscures a deeper understanding of how reasoning-capable LMMs are actually built and how their training dynamics evolve. Recent efforts such as ThinkLite-VL ( 36 ) and MM-Eureka ( 25 ) propose clearer methodologies for RL data construction and offer useful insights for algorithm design. Other work, including Open Vision Reasoner (OVR) ( 39 ) , attempts to address both SFT and RL, but does not provide a scalable, unified recipe that generalizes across tasks and modalities. Similarly, LLM-focused efforts ( 10 ) emphasize SFT while offering limited discussion of RL or multimodal extensions. Collectively, these limitations point to a critical gap: the lack of a transparent, scalable, and training recipe that unifies SFT and RL for building multimodal reasoning systems. In this work, we present a comprehensive and scalable empirical study on training Large Multimodal Reasoning Models (LMRMs) from open-source LMMs (e.g., Qwen2.5-VL ( 3 ) ). Through extensive experimentation, we develop simple yet effective data pipelines for constructing high-quality SFT and RL datasets, enabling reliable cold-start training of a strong LMRM. Our analysis provides detailed insights into which components most effectively contribute at each stage, revealing practical principles for building robust, generalizable, and efficient multimodal reasoning systems. Furthermore, we explore how to maximize scaling efficiency across both SFT and RL phases and summarize key lessons learned throughout the process. Building on these insights, we introduce OpenMMReasoner , a fully transparent training recipe for multimodal reasoning. It features (1) a high-quality 874k-sample SFT dataset that establishes a strong reasoning foundation prior to RL, and (2) a 74k-sample RL dataset accompanied by detailed analysis of diverse designs and optimization strategies, which further sharpens and stabilizes these capabilities. As shown in Fig. 1 , our recipe yields a highly capable LMRM that consistently outperforms state-of-the-art methods such as OVR across a wide range of multimodal reasoning benchmarks, demonstrating both the effectiveness and scalability of our approach. The complete pipeline, spanning both the SFT and RL phases, is illustrated in Fig. 2 . As summarized in Table 1 , all components of our workflow are fully open and transparent, providing a comprehensive and reproducible view of the entire data curation and training process. To summarize, our contributions are threefold: (1) Comprehensive Data Curation Insights. We present the first systematic study on curating high-quality SFT and RL data for multimodal reasoning, supported by extensive and rigorous experiments across diverse modalities and reasoning types. We found that scaling data diversity is a critical factor for curating high-quality datasets. While diversity in data sources is important, diversity in answers represents an additional essential axis for improvement. (2) A Strong SFT Recipe for Reasoning. We present a robust and reproducible SFT recipe that effectively equips LMMs with strong reasoning capabilities. Our approach incorporates step-by-step validation and offers practical insights for scaling a high-quality data pipeline focused on reasoning. By carefully selecting an appropriate teacher model for rejection sampling, and incorporating cross-domain data sources, we construct a cold-start dataset that exhibits both high diversity and quality, forming a solid reasoning foundation for subsequent RL. (3) An Advanced RL Recipe for Reasoning Enhancement. We conduct a comprehensive comparative analysis of multiple RL strategies, including GSPO ( 53 ) , GRPO ( 31 ) , and DAPO ( 45 ) , to evaluate their stability, efficiency, and scaling behavior. By selecting the most suitable algorithm, we establish a robust RL pipeline that further sharpens and stabilizes reasoning abilities, delivering both high stability and superior performance. Method Data Pipeline SFT Data RL Data Model Qwen2.5-VL-7B-Instruct ( 3 ) ✗ ✗ ✗ ✓ M2-Reasoning ( 2 ) ✗ ✗ ✗ ✓ MiMo-VL ( 33 ) ✗ ✗ ✗ ✓ OpenVisionReasoner ( 39 ) ✗ ✓ ✗ ✓ OpenMMReasoner (ours) ✓ ✓ ✓ ✓ Table 1 : Comparison of Extent of Open-Sourcing across Existing LMRMs. OpenMMReasoner is the first study to fully open-source its data pipeline, SFT/RL datasets, model weights, enabling fully transparent reproduction. Figure 2 : Data Pipelines of OpenMMReasoner. We propose two training recipes covering both the SFT and RL phases. The pipeline begins by collecting diverse data sources and selecting teacher models to generate new answer traces. During the RL phase, we explore different algorithm choices and filtering strategies, leading to our final optimized recipe. 2 Related Work RL has emerged as a powerful approach for enhancing reasoning in LLMs. Recent systems such as OpenAI’s o1 ( 27 ) and DeepSeek-R1 ( 11 ) have shown that multi-step reasoning and self-verification can emerge purely from large-scale RL. Building on these advances, recent works ( 25 ; 8 ; 39 ; 4 ; 18 ; 29 ; 41 ; 46 ; 43 ) extend RL-enhanced reasoning to multimodal models,

Read the complete text