SVSR: A Self-Verification and Self-Rectification Paradigm for Multimodal Reasoning
Zhe Qian, Nianbing Su, Zhonghua Wang, Hebei Li, Zhongxing Xu, Yueying Li Fei Luo Zhuohan Ouyang Yanbiao Ma · 2026
Read SVSR: A Self-Verification and Self-Rectification Paradigm for Multimodal Reasoning by Zhe Qian, Nianbing Su, Zhonghua Wang, Hebei Li, Zhongxing Xu, Yueying Li Fei Luo Zhuohan Ouyang Yanbiao Ma (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-10228.txt.
Introduction
Qian and eight colleagues tackle shallow reasoning in multimodal models with SVSR, a framework that builds self-checking and self-fixing into thought. Training runs in three stages: a unified preference data set refined from thought traces, forward and backward, and cold-start fine-tuning for structured multi-step thought. Semi-online preference tuning then keeps adding teacher-picked traces. The trained model improves, extends to unseen tasks and question types, and even reasons well when no traces are given.
Catalog record
| CREATOR | Zhe Qian, Nianbing Su, Zhonghua Wang, Hebei Li, Zhongxing Xu, Yueying Li Fei Luo Zhuohan Ouyang Yanbiao Ma |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 50215 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.10228
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
SVSR: A Self-Verification and Self-Rectification Paradigm for Multimodal Reasoning Zhe Qian, Nianbing Su, Zhonghua Wang, Hebei Li, Zhongxing Xu, Yueying Li Fei Luo Zhuohan Ouyang Yanbiao Ma Abstract Current multimodal models often suffer from shallow reasoning, leading to errors caused by incomplete or inconsistent thought processes. To address this limitation, we propose Self-Verification and Self-Rectification (SVSR), a unified framework that explicitly integrates self-verification and self-rectification into the model’s reasoning pipeline, substantially improving robustness and reliability in complex visual understanding and multimodal reasoning tasks. SVSR is built on a novel three-stage training paradigm. First, we construct a high-quality unified preference dataset by refining reasoning traces from pre-trained vision-language models, incorporating both forward and backward reasoning to embed self-reflective signals. Second, we perform cold-start supervised fine-tuning on this dataset to learn structured, multi-step reasoning behaviors. Third, we apply a Semi-online Direct Preference Optimization (Semi-online DPO) process, continuously augmenting the training corpus with high-quality, model-generated reasoning traces filtered by a powerful teacher VLM. This pipeline enables the model to learn, elicit, and refine its ability to self-verify and self-rectify. Extensive experiments across diverse benchmarks demonstrate that SVSR improves reasoning accuracy and enables stronger generalization to unseen tasks and question types. Notably, once trained with explicit self-reflective reasoning, the model also exhibits improved implicit reasoning ability, outperforming strong baselines even when no explicit reasoning traces are provided. These results highlight the potential of SVSR for building more dependable, introspective, and cognitively aligned multimodal systems. 1 Introduction The latest advancements in Vision-Language Models (VLMs) suggest a paradigm shift from scaling up computation during training to scaling up computation at test time 30 ; 14 ; 27 . OpenAI’s o1 25 illustrates the effectiveness of extending test-time computation by demonstrating robust reasoning abilities through performing deep and thorough thinking, and incorporating fundamental skills such as self-checking, self-verification, self-correction, and self-exploration into the model’s inference process. This paradigm not only enhances reasoning capabilities in fields like mathematics and science but also provides new insights for improving the generalization, usefulness, and safety of VLMs in various general-purpose tasks 25 ; 10 . In recent years, many studies have attempted to replicate the success of o1. These efforts include using large-scale Monte Carlo Tree Search (MCTS) to construct long chain-of-thought (longCoT) training data, or scaling up test-time reasoning to improve the performance of current models 9 ; constructing high-quality long-CoT data for effective imitation learning; and exploring reinforcement learning to enhance the thinking abilities of VLMs on large training data and models 10 ; 31 ; 6 . Recently, DeepSeek R1 10 demonstrated that large-scale reinforcement learning can incentivize deep thinking abilities in models, with the R1 series showing the immense potential of long-thought reasoning. However, these methods typically require significant resources to enhance a model’s thinking abilities, including large datasets, extensive training compute, and considerable labor and time costs. Meanwhile, for smaller or less capable VLMs, how to incentivize effective thinking, beyond distilling knowledge from more powerful models, remains unclear. In this study, we propose SVSR, an efficient alternative designed to enhance the thinking abilities of VLMs, especially for smaller or lower-performing VLMs. Unlike having VLMs mimic the thought processes of larger, more powerful models, SVSR focuses on teaching VLMs to think deeply by iteratively employing two critical thinking skills: self-verification and self-vectification.We define correction as the combination of verification and rectification. By acquiring these two abilities, VLMs can continuously re-evaluate their solutions, identify errors during the solution exploration process, and refine previous solutions after self-checking. This paradigm also allows for flexible allocation of test-time computation to different levels of difficulty. Our results demonstrate that, using only 5k training samples, Qwen2.5-VL-7B-Instruct 2 gains significant benefits from learning self-verification and self-rectification behaviors, as supported by experimental data and comparisons with Chain-of-Thought (CoT) methods. The overall SVSR approach, detailed in Section 3 , involves a three-stage training pipeline (illustrated in Figure 1 ): (1) constructing a dataset of self-correction trajectories, (2) supervised fine-tuning (SFT) for learning the reflective reasoning format, and (3) semi-online Direct Preference Optimization (semi-online DPO) for enhancing self-verification and self-rectification capabilities. More importantly, the semi-online DPO stage in SVSR employs outcome-oriented Reinforcement Learning (RL) to further enhance these abilities. Using only a uniform preference-based dataset, RL improves the effectiveness of the self-verification and self-rectification process, enabling the model to perform more flexible and effective test-time expansion through a self-guided trial-and-error process. We used data generated by the model itself and data fused from external VLMs, and continuously iterated the dataset. By comparing fully offline and semi-online DPO, we found that semi-online DPO is not only better able to align model preferences but also ensures that the noise in the data remains within a tolerable range, thereby promoting the continuous improvement of the foundation model’s reasoning abilities. Figure 1: Impact of the Self-Verification and Self-Rectification (SVSR) framework. (a) Qualitative Case Study: Qualitative Example: Demonstrates SVSR’s ability to identify and correct an initially incorrect answer (720°) in a visual math problem, ultimately producing the correct solution (1080°) through self-verification and self-rectification.. (b) Quantitative Comparison Results: Reports accuracy improvements across benchmarks (e.g., MathVista, DynaMath) as the model progresses from the base model, through Cold Start SFT, to the final SVSR model with reinforcement fine-tuning. We conducted extensive experiments on Qwen2.5-VL-7B-Instruct across three mathematical reasoning benchmarks. The experiments demonstrate that SVSR outperforms competitive baselines in mathematical reasoning, including recently released example enumeration models. We also found that SVSR can be generalized to out-of-domain general tasks, such as AI2D, highlighting the effectiveness of the learned self-verification and self-rectification abilities. Furthermore, we conducted a series of analysis experiments to better showcase the reasoning mechanisms of the obtained models and provide insights for performing semi-online DPO reinforcement learning training to enhance the reasoning of large language models. 2 Related Work 2.1 Self-verification and Self-rectification Enabling effective self-verification and self-correction in models is a promising solution for achieving robust reasoning in Vision-Language Models (VLMs) 20 , and these capabilities are crucial for performing deep reasoning. Previous research suggests that directly prompting models for self-verification and self-correction is often not the optimal approach 14 . Consequently, recent studies have explored various methods to enhance these abilities during post-training 29 . These methods highlight the potential of using human-annotated or model-generated data to equip models with self-verification or self-correction capabilities 19 , while also indicating that behavior models alone are insufficient for effective self-verification or self-correction through supervised fine-tuning 14 . In this work, we propose effective methods to enhance the self-verification and self-correction abilities of VLMs through reinforcement learning (RL) training, by fusing the model’s own data with high-quality data, and we demonstrate the effectiveness of our methods through in-depth analysis. 2.2 Reinforcement Learning for VLM Reasoning Reinforcement learning has proven effective in enhancing the performance of VLMs across various tasks 16 . Recently, some studies have shown that incorporating the concept of "online" into DPO training can also effectively enhance model reasoning 26 . Recent advancements in improving models’ deep thinking further leverage real-time DPO to continuously enhance the effectiveness of VLM reasoning 26 ; 28 . In this work, we also demonstrate that high-quality datasets and RL frameworks can effectively improve VLM reasoning. 2.3 Scaling Test-time Computation Recently, expanding test-time computation for VLM reasoning