Attend to Evidence: Evidence-Anchored Spatial Attention Supervision for Multimodal RLVR
Ruina Hu, Chen Wang, Lai Wei, Jionghao Bai, Bin Yu, Weiran Huang, Kai Wang, Yue Wang · 2026
Read Attend to Evidence: Evidence-Anchored Spatial Attention Supervision for Multimodal RLVR by Ruina Hu, Chen Wang, Lai Wei, Jionghao Bai, Bin Yu, Weiran Huang, Kai Wang, Yue Wang (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-30912.txt.
Introduction
Hu and colleagues teach vision-language models to look at the right image parts, not just land answers. Outcome-only rewards cannot tell a grounded answer from a lucky guess or a language shortcut. Their EASE method turns evidence regions into a visual-token target and steers attention toward it during training, but only on high-reward paths. At test time, only image and question are needed. Across three models, EASE lifts scores over a baseline by two to three points across perception, hallucination, visual math and reasoning.
Catalog record
| CREATOR | Ruina Hu, Chen Wang, Lai Wei, Jionghao Bai, Bin Yu, Weiran Huang, Kai Wang, Yue Wang |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 52144 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.30912
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Attend to Evidence: Evidence-Anchored Spatial Attention Supervision for Multimodal RLVR Ruina Hu, Chen Wang, Lai Wei, Jionghao Bai, Bin Yu, Weiran Huang, Kai Wang, Yue Wang Abstract Reinforcement learning with verifiable rewards (RLVR) improves vision-language models (VLMs) by optimizing outcome rewards derived from final answers. However, such outcome-only rewards do not tell the model which image regions justify an answer. For questions that require visual grounding, these rewards cannot distinguish responses supported by relevant visual evidence from those produced by language-prior shortcuts or lucky guesses. We introduce EASE (Evidence-Anchored Spatial Attention), which augments multimodal RLVR with visual-evidence process supervision. EASE converts annotated evidence regions into a smoothed visual-token target and uses it to guide response-to-image attention during RL training, but only on high-reward trajectories. The annotations are used solely as privileged training labels, while inference requires only the original image and question. Across Qwen2.5-VL-7B, Qwen3-VL-4B, and Qwen3-VL-8B, EASE raises average scores over DAPO by 2.5 to 3.1 points on perception, hallucination, visual math, and multimodal reasoning benchmarks. Diagnostics and ablations show that EASE better aligns visual attention with annotated evidence regions. * * footnotetext: Equal corresponding authors. Figure 1: From outcome rewards to evidence acquisition. Standard RLVR may answer correctly while attending weakly to the key evidence region. EASE encourages stronger attention to the supporting region. 1 Introduction Reinforcement learning with verifiable rewards (RLVR) has become a common way to improve language-model reasoning and is increasingly used in vision-language model (VLM) post-training ( 30 ; 52 ; 48 ; 22 ; 33 ) . Outcome rewards are attractive in multimodal tasks because many answers can be checked automatically. Recent VLM systems show that these verifiable outcome signals can improve multimodal reasoning ( 38 ; 36 ; 24 ; 21 ; 40 ; 13 ; 39 ; 5 ; 25 ) . However, outcome-only reward does not tell the model where the answer should come from in the image. A VLM may need to find a small object, compare two regions, or combine clues across separated regions before it can answer reliably. If this evidence-acquisition step is left unsupervised, RL can reward a correct answer without knowing whether the model actually used the relevant visual evidence rather than a shortcut. This limitation creates a perception credit assignment problem. An outcome reward tells the policy whether the response is correct, but not which image regions supported that response. A correct answer may reflect relevant visual evidence, but it may also come from language priors, dataset bias, a label-correlated shortcut, or guessing. An incorrect answer is also ambiguous because the model may have looked at the wrong region, or it may have found the right evidence and then reasoned incorrectly. This ambiguity matters most for fine-grained and multi-evidence questions that require object comparison, counting, localized attributes, spatial relations, or clues from separated regions. Without acquiring these regions, a model can produce plausible text while remaining weakly grounded and vulnerable to hallucination ( 18 ; 11 ; 1 ; 31 ; 47 ; 9 ) . Process supervision can reduce this ambiguity by making visual evidence acquisition part of the training signal. Evidence boxes and human attention annotations in visual question answering data indicate which image regions support an answer and can serve as training-only labels for where the model should look ( 14 ; 8 ) . Such supervision has been used to improve grounding in VLMs ( 29 ) . In RL, the same idea can be used to check more than the outcome. A high-reward response should also be supported by the visual evidence that justifies it. Recent multimodal RL and visual-thinking methods use stronger rollouts, perturbation objectives, visual-dependency signals, or textual traces augmented with grounding tags and spatial coordinates ( 21 ; 13 ; 53 ; 49 ; 57 ) . EASE instead uses evidence boxes only to supervise internal attention during training, leaving the VLM’s inference format unchanged. We propose EASE ( E vidence- A nchored S patial Att E ntion), a framework that adds visual evidence-anchored process supervision to multimodal RLVR. Figure 1 shows the intended contrast. Outcome-only RL may answer correctly while attending weakly to the image region that justifies the answer, whereas EASE encourages the model to keep the answer correct and place more attention on the supporting visual evidence. EASE maps annotated evidence regions to a smoothed target distribution over visual tokens. During RL training, this target guides where generated response tokens attend within the image. The guidance is applied only to trajectories that receive high verifier rewards, since low-reward responses can have unreliable attention patterns. The evidence annotations are used only as privileged training labels, and inference uses the same image-question pathway as the underlying VLM without evidence metadata. The training data includes both examples with one supporting region and examples with multiple supporting regions, so the model learns to focus on a local cue when one region is sufficient and to cover several regions when the answer depends on multiple clues. Empirically, EASE consistently improves outcome-only RL baselines across Qwen2.5-VL-7B, Qwen3-VL-4B, and Qwen3-VL-8B. When trained and evaluated under the same protocol as DAPO, EASE improves the average score by 2.9, 3.1, and 2.5 points on these backbones, respectively, with gains on perception-heavy reasoning, hallucination robustness, visual math, and logic benchmarks. EASE is also competitive with recent 7B-scale multimodal RL methods on shared benchmarks. Diagnostics and ablations link these gains to stronger evidence-aligned visual attention, reward-aware gating, the smoothed target, and mixed single-/multi-evidence training setup. Our contributions are summarized as follows. \bullet We identify visual evidence acquisition as a missing process signal in multimodal RLVR and introduce EASE, which adds visual evidence-anchored process supervision without requiring evidence metadata at inference. \bullet We map annotated evidence regions to a smoothed target distribution over visual tokens and apply this guidance only to high-reward trajectories. \bullet We validate EASE across multiple VLM backbones and benchmarks for perception-heavy reasoning, hallucination robustness, visual math, and multimodal reasoning, with diagnostics showing better alignment between visual attention and annotated evidence regions. Figure 2: Overview of EASE. During RL training, EASE maps dataset evidence boxes to a smoothed spatial target over visual tokens. The auxiliary objective guides response-to-vision attention on high-reward trajectories toward this target, and inference uses the standard image and question inputs. 2 Related Work RLVR for multimodal reasoning. RLVR has become a common VLM post-training paradigm, improving multimodal reasoning through task verifiers, rollout refinement, reflection training, chart-specific verifiable rewards, and policy optimization ( 48 ; 38 ; 36 ; 24 ; 32 ; 56 ; 22 ; 33 ) . However, the main training signal remains answer-level. It does not specify how the response should acquire supporting image regions. Visual perception signals in multimodal RL. Several multimodal RL methods introduce perception-oriented signals, such as clean and noisy image rollouts ( 21 ) , perception-aware objectives ( 40 ) , visual dependency or focus measures ( 13 ; 39 ) , perceptual evidence checklists ( 54 ) , and grounded traces or pointing supervision ( 5 ; 25 ) . These signals encourage visual reliance through perturbations, reward-derived proxies, checklist verification, textual traces, or point-level targets, but they do not directly match response-to-vision attention to localized answer evidence. EASE instead