CAVE: A Structured Credit Assignment Approach for Fragmented Visual Evidence Reasoning

Tengda Guo 1,∗ Jie Leng 1,∗ Hanlei Li 1,∗ Yaoyuan Liang 1 Qingyue Zhang 1 Dian Yang 1 Mingyu Zhang 2 Yuhua Fu 3 Shao-Lun Huang 1,† 1 Tsinghua University 2 Peking University 3 Zhejiang University of Technology ∗ Equal contribution. † Corresponding author. · 2026

Read CAVE: A Structured Credit Assignment Approach for Fragmented Visual Evidence Reasoning by Tengda Guo 1,∗ Jie Leng 1,∗ Hanlei Li 1,∗ Yaoyuan Liang 1 Qingyue Zhang 1 Dian Yang 1 Mingyu Zhang 2 Yuhua Fu 3 Shao-Lun Huang 1,† 1 Tsinghua University 2 Peking University 3 Zhejiang University of Technology ∗ Equal contribution. † Corresponding author. (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-16416.txt.

Introduction

Guo and eight others propose CAVE, a process reward method based on GRPO for visual tasks in vision-language models. Vision-language models handle reasoning well yet struggle with fragmented reasoning, integrating nonlocal information for semantically underdetermined tasks. CAVE scores each step at the action level through belief update, evidence acquisition, and adaptive focus control. The authors also build TRACER-Bench, spanning four nonlocal, semantically confusable dimensions. Experiments show CAVE improves fragmented-evidence tasks on public benchmarks and TRACER-Bench while retaining general performance.

Catalog record

CREATORTengda Guo 1,∗ Jie Leng 1,∗ Hanlei Li 1,∗ Yaoyuan Liang 1 Qingyue Zhang 1 Dian Yang 1 Mingyu Zhang 2 Yuhua Fu 3 Shao-Lun Huang 1,† 1 Tsinghua University 2 Peking University 3 Zhejiang University of Technology ∗ Equal contribution. † Corresponding author.
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68481
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.16416

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

CAVE: A Structured Credit Assignment Approach for Fragmented Visual Evidence Reasoning Tengda Guo 1,∗ Jie Leng 1,∗ Hanlei Li 1,∗ Yaoyuan Liang 1 Qingyue Zhang 1 Dian Yang 1 Mingyu Zhang 2 Yuhua Fu 3 Shao-Lun Huang 1,† 1 Tsinghua University 2 Peking University 3 Zhejiang University of Technology ∗ Equal contribution. † Corresponding author. Abstract Vision-Language Models (VLMs) have achieved strong performance on general multimodal reasoning, yet remain challenged in integrating nonlocal visual information to support semantically underdetermined visual reasoning. We describe this challenge as Fragmented Visual Reasoning. To this end, we propose Credit Assignment for Visual Evidence (CAVE), a structured process-reward method based on GRPO for interleaved visual reasoning. Specifically, CAVE evaluates the contribution of intermediate steps at the action level via three complementary reasoning process signals: belief update, evidence acquisition, and adaptive focus control, thereby guiding the model to optimize each reasoning action and learn more reliable visual reasoning strategies. Meanwhile, we construct TRACER-Bench, which covers four nonlocal and semantically confusable reasoning dimensions and provides key intermediate evidence to supervise reasoning paths. Experiments demonstrate that CAVE substantially improves performance on tasks requiring fragmented visual evidence integration, covering both public benchmarks and our newly introduced TRACER-Bench, while retaining competitive performance on general multimodal evaluations. Further analyses reveal that CAVE effectively improves the visual reasoning capacity and exhibits stronger robustness under longer-range and deeper cross-region dependencies. 1 Introduction Vision-Language Models (VLMs) have made substantial progress in multimodal reasoning tasks [ 1 , 2 , 3 , 4 ] , largely benefiting from the semantic priors accumulated through large-scale pretraining and the chain-of-thought capabilities of language models [ 5 , 6 ] . However, when tasks primarily rely on basic visual capabilities with low language priors, existing VLMs still exhibit clear brittleness. Representative tasks in Tunnel Vision [ 7 , 8 ] provide a concrete example: even simple human-solvable problems can require chaining evidence across multiple, potentially distant image regions, where current VLMs perform poorly. Building on this observation, we study a broader setting in which task-critical evidence is spatially fragmented and semantically weakly separable across regions. We refer to this challenge as Fragmented Visual Reasoning (FVR). As illustrated in Figure 1 (a), FVR creates a reasoning dilemma: if VLMs rely only on coarse global visual perception, their vision-side representations often fail to robustly capture long-range dependencies and subtle local differences, thereby biasing reasoning paths toward a verbalized subset of visual evidence. As a result, models may produce coherent but visually ungrounded reasoning chains, leading to error propagation in subsequent reasoning steps. This challenge naturally connects to recent interleaved multimodal reasoning methods, which introduce a “Think–with–Image” paradigm, enabling models to progressively acquire visual information through localized re-observation and providing a more natural solution form for such tasks [ 9 , 10 , 11 , 12 ] . However, even though existing process-reward methods attempt to alleviate sparse feedback in long-trajectory training [ 13 , 14 ] , they usually evaluate intermediate steps from the perspective of final-answer improvement or overall trajectory quality, failing to provide action-specific process supervision and thus leaving models without targeted guidance to learn reliable strategies for each distinct reasoning behavior in visual evidence exploration, as shown in Figure 1 (b) left. Figure 1 : (a) Samples of Fragmented Visual Reasoning. The examples cover Geometry, Geography, Route, and Remote-Sensing tasks. Samples 1–3 require organizing confusable and subtle evidence across separate regions, while Sample 4 requires matching nonlocal relations in a noisier real image. (b) Comparison between existing process-reward methods and CAVE. Existing methods usually rely on trajectory-level or answer-side optimization, whereas CAVE assigns action-level structured credits according to the reasoning contributions of intermediate visual-evidence reasoning steps. To address this, we propose Credit Assignment for Visual Evidence (CAVE), which performs action-level structured credit assignment over multi-round reasoning trajectories for visual evidence exploration [ 15 ] , as shown in Figure 1 (b) right. CAVE evaluates intermediate reasoning with three complementary signals: belief update, evidence acquisition, and adaptive focus control. These signals respectively assess progress toward the correct answer, recovery of task-critical visual details, and the appropriateness of visual region focusing, thereby explicitly guiding the model to learn more reliable evidence discovery, reasoning state updating, and goal-directed exploration behaviors. To enable controlled evaluation and process-level analysis, we construct TRACER-Bench, which covers three abstract scenarios and one real-world scenario: Rule-Switching Navigation, Nonsemantic Tracing, Embedded Matching, and Remote-Sensing Subimage Matching. These scenarios require cross-regional evidence with low semantic separability, and TRACER-Bench provides corresponding key evidence for offline analysis. In summary, our main contributions are as follows: 1) We introduce Fragmented Visual Reasoning, a challenging task characterized by low semantic separability across multiple visual regions, together with TRACER-Bench for systematic evaluation across diverse scenarios with verifiable explicit visual-evidence chains. 2) We propose CAVE, a structured credit assignment process-reward method based on GRPO for interleaved visual reasoning. 3) Experiments show that CAVE effectively improves model performance on benchmarks with fragmented vision, achieves competitive results on general multimodal evaluations, and effectively improves the visual reasoning capacity. 2 Related work VLMs visual reasoning and interleaved visual reasoning. VLMs have achieved significant progress on general multimodal reasoning tasks. Representative works such as Flamingo and LLaVA have advanced the development of general-purpose VLMs through interleaved image-text modeling and related techniques [ 1 , 2 , 3 , 4 , 16 , 17 ] . However, existing VLMs remain fragile in tasks requiring detailed discrimination and nonlocal evidence. Tunnel Vision, BabyVision, and related benchmarks reveal this issue from the perspectives of long-range region association and basic visual cognition, respectively [ 7 , 8 , 18 , 19 , 20 ] . To improve reasoning capability, methods such as DDCoT and LLaVA-CoT introduce staged or visually grounded intermediate reasoning [ 21 , 22 , 6 , 23 , 24 ] . Furthermore, Visual Sketchpad, VisProg, ViperGPT, DeepEyes, and related works extend VLMs reasoning into a multi-round “reasoning–observing–reasoning” process through tool use or adaptive zooming [ 9 , 25 , 26 , 10 , 11 , 12 ] . However, these methods mainly focus on intermediate reasoning or local observation mechanisms, while still lacking dedicated modeling of how observations serve as accumulated visual states for subsequent cross-region dependency progression. GRPO and process rewards. GRPO/R1-style reinforcement learning shows that rule-based or final-answer rewards can elicit long-chain reasoning capabilities in large models [ 15 , 27 ] , and has been extended to Vision-Language Models by works such as VLM-R1, R1-VL, and OpenVLThinker [ 28 , 29 , 30 ] . However, existing GRPO-style VLMs training usually relies on final answers, format constraints, or general rule-based rewards, making it difficult to characterize the process-level contributions of observation, evidence acquisition, and region transition in multi-round visual reasoning. To alleviate reward sparsity in long-trajectory training, VisualPRM, StepSearch, GiGPO, and IGPO explore process rewards, step-level feedback, trajectory comparison, and information-gain signals [ 13 , 31 , 32 , 14 ] . However, such process signals usually focus more on the overall contribution of states to final task utility or answer formation, and do not explicitly distinguish different types of evidence progression in multi-round visual reasoning. In contrast, CAVE targets visual evidence progression and structurally decomposes intermediate contributions into three types of process credit: belief update,

Read the complete text