Does Seeing More Mean Knowing More? Mono-Anchored Advantage Normalization for Multi-Source Visual Reasoning
Fanhu Zeng Zhicong Luo Zefan Wang You Li Chi Chen Maosong Sun · 2026
Read Does Seeing More Mean Knowing More? Mono-Anchored Advantage Normalization for Multi-Source Visual Reasoning by Fanhu Zeng Zhicong Luo Zefan Wang You Li Chi Chen Maosong Sun (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-25437.txt.
Introduction
Fanhu Zeng and colleagues improve visual reasoning when several input sources, like infrared and depth, must be combined. Current methods treat extra sources as pure accumulation, missing whether fusion adds information or interference. Their MARS framework treats each modality as its own source and anchors advantage normalization on single-source rewards. That design rewards genuine information gain, encourages sources to promote each other, and suppresses noise and conflict. Tests show gains of 3.2 percent on one training method and 4.9 percent on another, across varied datasets.
Catalog record
| CREATOR | Fanhu Zeng Zhicong Luo Zefan Wang You Li Chi Chen Maosong Sun |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 34732 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.25437
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Does Seeing More Mean Knowing More? Mono-Anchored Advantage Normalization for Multi-Source Visual Reasoning Fanhu Zeng Zhicong Luo Zefan Wang You Li Chi Chen Maosong Sun Abstract Visual reasoning through reinforcement learning with verifiable rewards (RLVR) has achieved remarkable progress. However, when dealing with multi-source inputs, existing approaches tend to treat them as a mere accumulation of information, lacking explicit mechanisms to distinguish whether integrating additional sources yields information gain or introduces interference. Therefore, they struggle to effectively model dynamic interaction when integrating multiple sources, particularly when they differ significantly in physical properties and semantics, e.g . , infrared and depth, leading to inferior performance to mono-source reasoning when a certain source holds the dominant signal. To address this issue, we propose MARS, a novel mono-anchored multi-source reasoning framework that models each visual modality as an independent information source. Specifically, by treating mono-source rewards as dynamic anchors, our method explicitly incorporates the information gain introduced by multi-source fusion into advantage normalization and adaptively emphasizes mutual promotion between sources while suppressing potential noise or conflicts during RLVR. From theoretical analysis, our method effectively quantifies information gain introduced by multi-source integration in gradient estimation, enabling consistent modality regulation. Empirical results also show impressive 3.2% and 4.9% performance gains on GRPO and DAPO across diverse datasets, confirming effectiveness of our method. Code is available here . 1 Introduction Recent advances in multimodal large language models (MLLMs), which align representations across vision and language modalities 2 , have demonstrated strong capabilities in multimodal perception and understanding 15 . More recently, visual reasoning 14 ; 21 has been introduced to encourage deeper thinking through reinforcement learning with verifiable rewards (RLVR), allowing models to generate structured responses with self-reflection through explicit reasoning rather than direct prediction, thereby fostering the emergence of chain-of-thought (CoT) reasoning 20 and enhancing the ability of complex understanding, multi-step reasoning, and logical consistency. Despite the progress of visual reasoning, current methods largely optimize for aligned representations, and the complementary strengths of different sources are often assumed and overutilized, i.e . , seeing more means knowing more, but potential interference or conflicts are seldom explicitly explored. In particular, existing RLVR frameworks optimize multi-source rewards directly, without explicitly assessing whether integrating additional sources yields positive information gain or instead introduces interference relative to strong mono-source reasoning, especially when their attributes and semantics have significant differences, such as medical imaging 1 , autonomous driving 7 , remote sensing 28 , and so on. In these scenarios, naively integrating multiple sources can even lead to performance inferior to strong mono-source reasoning , when a specific source contains the dominant and reliable signal. As shown in Fig. 1 , in tasks where inherent physical limitations and degradation are caused by illumination variation, occlusion, and adverse weather conditions, relying solely on RGB imagery or the relationship between sources is often inadequate. In contrast, different sources such as infrared, depth, or multi-view can provide crucial and robust information with more reliable scene understanding, which requires handling multi-source data in a comprehensive manner. Figure 1: Illustration of multi-source visual reasoning. (a) Existing methods struggle to model dynamic interaction in multi-source data; (b) Our method explicitly uses mono-source rewards as anchors to measure the information gain from multi-source integration, enhancing reasoning and prediction. In this paper, we aim to enhance the ability of visual reasoning when dealing with multi-source data. Based on the analysis, we uncover that a core reason for this limitation lies in the way current visual reasoning frameworks handle source integration. Specifically, they fail to explicitly model the performance interactions between specific source and multi-source data. From an optimization perspective, these interactions correspond to whether multi-source reasoning improves or degrades performance relative to mono-source baselines, a distinction that remains invisible to advantage estimation in existing RLVR frameworks. This gap motivates the need for a general approach that can dynamically regulate contributions from a certain source. To this end, we propose MARS, a novel multi-source reasoning framework that explicitly incorporates each visual modality as an individual information source and models the information gain introduced by multi-source integration. Concretely, by treating mono-source rewards as the anchors, it computes advantages based on information gains between multi-source and mono-source 1 1 1 They specifically describe features of different visual modalities that differ in physical properties and semantics. rewards. We theoretically analyze that our method guarantees and enables dynamic optimization that emphasizes promotion while suppressing noisy or conflicting information during training by maximizing multi-source information gain. Notably, our algorithm enhances multi-source utilization from inherent capability without architectural redesign, offering a general and effective solution for improving visual reasoning performance. We conduct experiments on various multi-source tasks, including depth, infrared, multi-view and text-rich understanding. Extensive results with notable 3.2% and 4.9% improvements on GRPO and DAPO and in-depth analyses strongly validate the effectiveness and generalizability of our method. Our contributions are summarized as follows: • We reveal that existing multi-source visual reasoning can systematically degrade performance, and identify relative information gain over mono-source reasoning as the key factor for effective multi-source integration from theoretical derivation. • We design a novel visual reasoning method that introduces mono-source rewards as anchors to quantitatively measure multi-source information gain from integration in advantage normalization, enabling adaptive regulation of different sources during RLVR training. • We conduct extensive experiments on various multi-source visual reasoning tasks, and the consistent and significant performance improvements on different RL algorithms validate the effectiveness and generality of our approach. 2 Related Work Reinforcement Learning with Verifiable Rewards has made substantial progress in recent years, with pioneering systems such as DeepSeek-R1 10 and Kimi 19 demonstrating that complex reasoning patterns can emerge through optimization with verifiable rewards, where outcome reward signals are used to guide the learning of long reasoning chains. Within this paradigm, some approaches focus on enhanced optimization strategies 31 ; 30 , such as regularization, stabilized policy updates, and refined reward designs, to improve consistency and robustness. Building on these foundations, visual reasoning incorporates images into reasoning by coordinating linguistic reasoning with perceptual states. It achieves strong performance in vision-centric tasks such as grounding 4 and image understanding 23 , highlighting it as a promising paradigm for complex multimodal understanding and deduction. In this paper, we focus on the capability of visual reasoning with multi-source data. Multi-Source Visual Reasoning refers to tasks that require a joint understanding of images from multiple sources, potentially captured from different sensors, times or viewpoints 29 . This is crucial for real-world intelligent systems, where a single source is often insufficient for achieving completeness and reliable decisions in complex environments. Early studies focus on multi-source fusion 6 ; 26 , where extracted features from different cameras are explicitly fused to enhance robustness and geometric consistency. More recently, multimodal large language models have reframed multi-image reasoning as unified and aligned comprehension with implicit correspondences and shared representations. Nevertheless, current attention is paid to general domain enhancement and evaluation 9 ; 25 , which overlooks the complementarity and contradictions of multi-source data in the reasoning process. 3 Methodology 3.1 Motivation Visual reasoning has exhibited strong understanding capabilities under multi-image inputs. However, we observe a consistent and non-trivial phenomenon: as depicted in Fig. 1 , when handling images from multiple sources,