Thinking with Images as Continuous Actions: Numerical Visual Chain-of-Thought Kesen Zhao, Beier Zhu, Junbao Zhou, Xingyu Zhu, Zhongqi Yue, Hanwang Zhang Abstract Recent multimodal large language models (MLLMs) increasingly rely on visual chain-of-thought to perform region-grounded reasoning over images. However, existing approaches ground regions via either textified coordinates—causing modality mismatch and semantic fragmentation—or fixed-granularity patches that both limit precise region selection and often require non-trivial architectural changes. In this paper, we propose N umerical V isual C hain-of- T hought ( NV-CoT ), a framework that enables MLLMs to reason over images using continuous numerical coordinates. NV-CoT expands the MLLM action space from discrete vocabulary tokens to a continuous Euclidean space, allowing models to directly generate bounding-box coordinates as actions with only minimal architectural modification. The framework supports both supervised fine-tuning and reinforcement learning. In particular, we replace categorical token policies with a Gaussian (or Laplace) policy over coordinates and introduce stochasticity via reparameterized sampling, making NV-CoT fully compatible with GRPO-style policy optimization. Extensive experiments on three benchmarks against eight representative visual reasoning baselines demonstrate that NV-CoT significantly improves localization precision and final answer accuracy, while also accelerating training convergence, validating the effectiveness of continuous-action visual reasoning in MLLMs. The code is available in https://github.com/kesenzhao/NV-CoT . 1 Introduction Recent advances in multimodal large language models (MLLMs) have enabled deeper reasoning over visual inputs via “thinking with images” ( i.e. , visual chain-of-thought) ( 43 ; 26 ; 42 ; 12 ; 30 ) . In this paradigm, models first localize task-relevant image regions aligned with the textual query. They then conduct multi-step reasoning by explicitly grounding intermediate inferences on these detected regions. Such region-grounded visual reasoning is a fundamental capability for MLLMs and underpins a broad range of downstream applications. Figure 1 : Our NV-CoT outperforms text-based visual CoT models (Vis-CoT ( 26 ) and DeepEyes ( 43 ) ) in localization precision , answer accuracy , and convergence speed across both SFT and RL. SFT-based models are evaluated on the Vis-CoT-363K dataset ( 26 ) , where ground-truth bounding boxes are available, while RL-based models are evaluated on the DeepEyes-47K dataset ( 43 ) . We only replace the text-space discrete coordinate objective with our Euclidean-space continuous one, while keeping all other training configurations unchanged for a fair comparison. Figure 2 : Comparison of different paradigms for thinking with images. (a) Text-based approaches represent localized regions as discrete coordinate tokens, leading to modality mismatch and fragmented semantics. (b) Patch-based approaches reason directly over fine-grained visual tokens but are constrained by the fixed spatial granularity of the vision backbone. (c) Our NV-CoT predicts region coordinates in continuous space, enabling flexible and precise localization. To align with the text-based output interface, many existing MLLMs ( 20 ; 2 ; 44 ) serialize localized regions as bounding-box coordinates in text , e.g. , [\text{``}x_{1}\text{''},\text{``}y_{1}\text{''},\text{``}x_{2}\text{''},\text{``}y_{2}\text{''}] , and then invoke a cropping tool to extract the corresponding patch ( Figure 2 (a)). Despite its simplicity, this design faces two fundamental issues. (1) Modality mismatch: coordinates are continuous in the visual world but are predicted as discrete text tokens and typically trained with cross-entropy, which ignores geometric proximity ( e.g. , predicting x_{1}{=}\text{``}3.2\text{''} may be penalized similarly to x_{1}{=}\text{``}4.1\text{''} when the target is x_{1}^{\ast}{=}\text{``}3.1\text{''} , since both predictions differ from the target by only a single discrete token under token-level cross-entropy). (2) Semantic fragmentation: numbers are tokenized into multiple unrelated sub-tokens, making numerical comparison and reasoning brittle and prone to hallucination ( e.g. , confusing whether \text{``}3.11\text{''} or \text{``}3.9\text{''} is larger). Several recent works attempt to alleviate these issues by enabling MLLMs to operate directly on fine-grained visual patches ( Figure 2 (b)). For example, LVR ( 10 ) performs reasoning in the visual embedding space, while PaDT ( 29 ) generates indices corresponding to original visual patch embeddings. Nevertheless, these approaches are fundamentally constrained by the fixed granularity of the vision backbone, as the predefined patch partitioning limits flexible and precise region selection. In addition, patch-generation or patch-indexing mechanisms often require non-trivial architectural changes, which weakens modularity and limits general applicability across MLLMs. To avoid brittle textified coordinates with only minimal architectural changes, we propose N umerical V isual C hain- o f- T hought ( NV-CoT ), which expands the MLLM action space from discrete vocabulary tokens to a continuous Euclidean space, enabling the model to directly generate numerical bounding box coordinates as actions ( Figure 2 (c)). Specifically, we extend the standard LLM head with four coordinate outputs that directly predict the numerical bounding-box coordinates ( e.g. , [x_{1},y_{1},x_{2},y_{2}] 1 1 1 We write text-based coordinates as [\text{``}x_{1}\text{''},\text{``}y_{1}\text{''},\text{``}x_{2}\text{''},\text{``}y_{2}\text{''}] and numerical coordinates as [x_{1},y_{1},x_{2},y_{2}] . ). Notably, NV-CoT is applicable to both supervised fine-tuning (SFT) and reinforcement learning (RL) stages. In the SFT stage, we replace token-level cross-entropy with a regression loss to supervise continuous bounding-box coordinates. However, extending this idea to the RL stage is non-trivial. Most LLM-oriented policy optimization methods parameterize the policy as a token-level categorical distribution over the vocabulary, which naturally supports discrete actions but does not directly accommodate continuous coordinate outputs. Furthermore, deterministic coordinate prediction lacks the stochasticity required by GRPO-style algorithms for advantage estimation and policy exploration. To address these challenges, we replace the categorical policy with a Gaussian policy that explicitly models continuous coordinate regression. Stochasticity is introduced via the reparameterization trick, where the model predicts both the mean and standard deviation of the bounding box distribution and samples coordinates accordingly. This design enables efficient exploration and stable gradient propagation, while also providing closed-form likelihoods for computing importance ratios and KL regularization, making NV-CoT compatible with GRPO-style RL frameworks. Finally, we also provide a Laplace-policy variant of NV-CoT , motivated by the empirical robustness and favorable performance of \ell_{1} -type losses for localization; it serves as a drop-in replacement for the Gaussian policy under the same GRPO pipeline. Extensive experiments on V^{*} Bench ( 38 ) , HR-Bench 4K ( 36 ) , and HR-Bench 8K ( 36 ) demonstrate that NV-CoT consistently improves visual reasoning performance. For example, on V^{*} Bench, NV-CoT-7B outperforms LVR-7B (patch-based visual CoT) and DeepEyes-7B (text-based visual CoT) by 9.5\% and 2.7\% , respectively ( Table 1 ). In Figure 1 , we plot bounding-box precision (IoU under the SFT setting with ground-truth coordinates) and final answer accuracy over the course of training. The results show that NV-CoT consistently improves localization accuracy , final answer accuracy , and convergence speed . Our contributions are threefold: • We propose NV-CoT , which expands the action space of MLLMs from discrete vocabulary tokens to a continuous Euclidean space, enabling the direct generation of numerical bounding box coordinates as actions. • We develop Gaussian/Laplace coordinate policies with reparameterized sampling and analytic importance ratios, making continuous localization compatible with mainstream RL algorithms ( e.g. , GRPO-style methods). • We conduct experiments on three benchmarks against eight baseline models (including text-based and patch-based, as well as SFT-based and RL-based, “thinking with images” methods), demonstrating that NV-CoT significantly improves localization accuracy, final answer accuracy, and convergence speed. 2 Related Work Multimodal large language models. By integrating language modeling capabilities with visual understanding, MLLMs enable complex vision-language tasks. Representative early models such as BLIP-2 ( 14 ) and LLaVA ( 18 ; 17 ) align vision and language by projecting image into the latent space of a frozen LLM via a query transformer or a lightweight projector. Subsequent strong open-source models, including the LLaVA family ( 19 ; 6 ; 40 ; 16 ; 13 ; 11 ) , Qwen-VL ( 1 ; 35 ; 2 ) , and InternVL ( 3 ; 21 ) , further improve visual resolution handling and scalability. However, despite their strong perception and alignment capabilities, these models generally lack explicit reasoning mechanisms such as visual Chain-of-Thought (CoT). Thinking with Images (visual CoT). Incorporating CoT reasoning to enhance visual understanding has been actively explored in recent MLLMs ( 33 ; 41 ) . Early text-based approaches ( 20 ; 2 ; 44 ) serialize localized image regions as bounding-box coordinates in text, and subsequently invoke cropping tools to extract the corresponding visual patches. While effective, this paradigm suffers from modality mismatch and semantic fragmentation. More recent patch-based methods ( 10 ; 29 ; 7 ) instead operate directly on fine-grained visual patches, avoiding explicit textual serialization. However, these approaches are fundamentally constrained by the fixed spatial granularity of the vision backbone, limiting their flexibility in region selection and reasoning precision. In contrast, NV-CoT expands the MLLM action space from discrete vocabulary tokens to a continuous Euclidean space, enabling the model to directly predict numerical bounding-box coordinates as continuous actions. This design naturally bridges visual perception and reasoning, without relying on textual discretization or fixed patch partitions. To incorporate CoT to MLLMs, existing methods adopt either supervised fine-tuning ( 39 ; 34 ; 4 ; 26 ) or reinforcement learning ( 41 ; 30 ; 43 ; 42 ) . Our approach is compatible with both paradigms, providing a unified framework for learning continuous visual actions. 3 Method Given a query q and an image I_{0} , a visual CoT MLLM \pi_{\theta} performs region-grounded reasoning by selecting a region of interest and invoking a zoom-in function for fine-grained inspection. Existing visual-CoT methods localize regions by generating text-form box coordinates and then cropping the image for feedback. We instead cast localization as a continuous-action problem in Euclidean space: the MLLM directly outputs numerical coordinates . Our method proceeds in three steps. First, we expand the MLLM vocabulary with a continuous coordinate action space ( Section 3.1 ), enabling numerical box generation. Second, we instantiate NV-CoT for SFT with coordinate regression when box supervision is available ( Section 3.2 ). Third, we extend NV-CoT to GRPO by introducing a stochastic Gaussian policy with closed-form importance ratios and KL regularization ( Section 3.3 ). Finally, we provide a Laplace-policy variant as a drop-in replacement, motivated by the empirical preference of \ell_{1} -type losses for localization ( Section 3.4 ). 3.1 Expanded Actions for Continuous Coordinates To enable numerical coordinate prediction, we augment the standard LLM output head over the vocabulary \mathcal{V} with a continuous action space \mathcal{A}=\mathbb{R}^{4}\times\mathbb{R}_{+} : four coordinate heads parameterized by W=[\mathbf{w}_{x_{1}},\mathbf{w}_{y_{1}},\mathbf{w}_{x_{2}},\mathbf{w}_{y_{2}}]^{\top}\in\mathbb{R}^{4\times D} to predict the Gaussian mean, and a fifth head \mathbf{w}_{\sigma}\in\mathbb{R}^{D} to predict a shared standard deviation, yielding a Gaussian policy for continuous localization. Let \mathbf{h}\in\mathbb{R}^{D} denote the final hidden representation before the coordinate decoding step. We obtain the mean as \bm{\mu}=[x_{1},y_{1},x_{2},y_{2}]^{\top}=W\mathbf{h}, (1) and predict a shared standard deviation as \sigma=\mathrm{max}(\mathbf{w}_{\sigma}^{\top}\mathbf{h},\varepsilon), (2) where \varepsilon>0 is a small positive offset to ensure \sigma>0 . This forms a Gaussian policy \mathcal{N}(\bm{\mu},\sigma^{2}I) . Accordingly, we augment the parameter set as \theta\leftarrow\theta\cup\{W,\mathbf{w}_{\sigma}\} . The introduction of \sigma is crucial: while deterministic coordinate suffices for SFT, GRPO-style RL requires stochastic policies to enable sampling and exploration. Note that our modification to the MLLM is minimal, as we only introduce five lightweight linear heads, in contrast to patch-based visual CoT methods that require more architectural changes. 3.2 NV-CoT for Supervised Fine-Tuning We begin by applying our NV-CoT to supervised fine-tuning, where intermediate bounding-box coordinates in the reasoning process are available ( 4 ; 26 ) . Let \mathbf{b^{\ast}}=[x_{1}^{\ast},y_{1}^{\ast},x_{2}^{\ast},y_{2}^{\ast}]^{\top} denote the ground-truth bounding box for a zoom-in step. During SFT, we supervise the coordinate outputs in \mathcal{A} using an \ell_{2}^{2} regression loss, while optimizing the discrete token outputs in the original LLM head \mathcal{V} with the standard cross-entropy loss. \displaystyle\mathcal{L}_{\mathsf{SFT}}(\theta) \displaystyle=\sum_{t\in\mathcal{T}_{\mathcal{V}}}\!\!\Big(-\log\pi_{\theta}(o_{t}\mid o_{0 is a hyperparameter; \sigma is not supervised in SFT and is only used for RL. 3.3 NV-CoT for Reinforcement Learning Bounding-box annotations for SFT are costly and often unavailable at scale. As a result, visual-CoT models are commonly trained with RL (GRPO 27 ) using task-level feedback ( e.g. , final answer) as the reward signal, without requiring box-level supervision. Extending NV-CoT from SFT to this RL setting, however, is non-trivial: RL needs stochastic sampling and well-defined importance ratios, whereas standard LLM policies are token-level categorical distributions that do not accommodate continuous coordinate actions. To this end, we formulate continuous region localization as a Gaussian policy over the action space \mathcal{A} . Rollouts. GRPO samples a group of G trajectories per prompt. With our Gaussian policy, we draw coordinate actions independently as \mathbf{b}^{(i)}\sim\mathcal{N}(\bm{\mu},\sigma^{2}I),\;i=1,\ldots,G, implemented via the reparameterization trick, \mathbf{b}^{(i)}=\bm{\mu}+\sigma\bm{\epsilon}^{(i)},\quad\bm{\epsilon}^{(i)}\sim\mathcal{N}(\mathbf{0},I), (4) which enables low-variance gradient estimation. We then use \mathbf{b}^{(i)} to crop into the image for the i -th trajectory. Importance ratio. GRPO optimizes the policy via an importance ratio between the current policy \pi_{\theta} and a reference policy \pi_{\theta_{\mathsf{old}}} . For each output o^{(i)}_{t} , the ratio is defined as r^{(i)}_{t}(\theta)=\frac{\pi_{\theta}(o^{(i)}_{t}\mid q,I_{0},o^{(i)}_{0 is the clipping range. Inference. During inference, we disable stochasticity and directly use the coordinate mean \bm{\mu} to crop the image. 3.4 Extending NV-CoT with Laplace Policy In prediction tasks such as keypoint localization and bounding-box regression, it is well known that \ell_{1} loss often outperforms \ell_{2}^{2} loss due to its robustness to outliers and sharper error profiles ( 5 ; 31 ) . From a probabilistic perspective, this corresponds to modeling prediction errors with a Laplace distribution rather than a Gaussian distribution. Motivated by this observation, we further extend NV-CoT by replacing the Gaussian policy with a Laplace policy for continuous localization. Laplace policy. Specifically, we model the coordinate action as \mathbf{b}\sim\mathrm{Laplace}(\bm{\mu},\alpha) , whose probability density function is p(\mathbf{b}\mid\bm{\mu},\alpha)=\frac{1}{(2\alpha)^{4}}\exp\!\left(-\frac{\|\mathbf{b}-\bm{\mu}\|_{1}}{\alpha}\right), (12) where \bm{\mu}\in\mathbb{R}^{4} denotes the predicted coordinate mean and b>0 is a shared scale parameter. Equivalently, this corresponds to assuming independent dimensions, under which the Laplace likelihood factorizes across coordinates. SFT objective. Under the Laplace assumption, maximizing the log-likelihood of ground-truth coordinates is equivalent to minimizing an \ell_{1} loss, since -\log p(\mathbf{b}^{\ast}\mid\bm{\mu},\alpha)=\tfrac{1}{\alpha}\|\bm{\mu}-\mathbf{b}^{\ast}\|_{1}+\mathrm{const} . Thus, in the SFT stage, we replace the \ell_{2}^{2} loss Eq. ( 3.2 ) with \mathcal{L}_{\mathsf{SFT}}^{\mathsf{Lap}}(\theta)=\sum_{t\in\mathcal{Y}_{\mathcal{A}}}\|\bm{\mu}_{t}-\mathbf{b}^{\ast}_{t}\|_{1}, (13) which encourages sharper and more robust localization. RL with Laplace policy. Analogous to the Gaussian case, we parameterize the Laplace policy with a location parameter \bm{\mu} and a scale parameter \alpha , and employ reparameterized sampling to enable low-variance gradient estimation. Specifically, a coordinate action is sampled as \mathbf{b}=\bm{\mu}+\alpha\,\mathbf{s}\odot\bm{\epsilon},\quad\mathbf{s}\sim\mathrm{Rademacher}(\pm 1),\;\bm{\epsilon}\sim\mathrm{Exp}(\mathbf{1}), (14) where \odot denotes element-wise multiplication. Here, \mathbf{s} is a random sign vector with i.i.d. entries in \{\pm 1\} , and \bm{\epsilon} has i.i.d. unit-rate exponential entries. For a sampled action \mathbf{b}_{t}^{(i)} , the corresponding importance ratio used in GRPO is r_{t}^{(i)}(\theta)=\frac{\alpha^{4}_{\theta_{\mathsf{old}}}}{\alpha_{\theta}^{4}}\exp\!\left(-\frac{\|\mathbf{b}_{t}^{(i)}-\bm{\mu}_{\theta}\|_{1}}{\alpha_{\theta}}+\frac{\|\mathbf{b}_{t}^{(i)}-\bm{\mu}_{\theta_{\mathsf{old}}}\|_{1}}{\alpha_{\theta_{\mathsf{old}}}}\right), (15) which can be computed analytically. The closed-form KL penalty can be derived analogously, and the overall GRPO procedure follows the same pipeline as in the Gaussian-policy case. 4 Experiments 4.1 Setup Baselines. To evaluate the effectiveness of NV-CoT , we compare against eight state-of-the-art MLLM baselines, grouped into the following three categories: • Open-source MLLMs. This category includes Qwen2.5-VL-{7B, 32B} ( 2 ) and LLaVA-OneVision ( 11 ) . • Supervised fine-tuning based visual CoT. We compare against Vis-CoT-7B ( 26 ) , which leverages annotated intermediate bounding boxes for supervision. • Reinforcement learning based visual CoT. These methods do not assume access to annotated bounding-box. We further divide them into two subgroups: (I) Text-based visual CoT. UV-CoT-7B ( 42 ) uses an LLM-as-a-judge to rank trajectory pairs and optimizes a DPO-style objective ( 25 ) . DeepEyes-7B ( 43 ) applies GRPO-style RL with final answer accuracy as the reward. (II) Patch-based visual CoT. PaDT ( 29 ) generates discrete patch indices/tokens for fine-grained reasoning, while LVR ( 10 ) performs reasoning over latent visual patches. Our NV-CoT is applicable to both SFT and RL settings. In this work, we build the SFT-based model upon Vis-CoT ( 26 ) and the RL-based model upon DeepEyes ( 43 ) . Table 1 : Overall comparison of different models on three benchmarks. The best results are in bold. Our NV-CoT consistently improves performance under both SFT and RL settings. We use NV-CoT (SFT) with an \ell_{1} loss and NV-CoT (RL) with a Laplace policy. DeepEyes-7B † and NV-CoT † denote results under multi-step tool use (multiple zoom-in calls). For a fair comparison, all other visual CoT methods are evaluated with a single zoom-in call, since some baselines do not support multiple tool invocations. Model V^{*} Bench HR Bench 4K HR Bench 8K Attr Spatial Overall FSP FCP Overall FSP FCP Overall LLaVA-OneVision-7B 75.7 75.0 75.4 71.7 53.3 62.5 69.1 52.1 60.6 Qwen2.5-VL-7B 73.9 67.1 71.2 84.7 52.9 68.8 78.7 51.8 65.3 Qwen2.5-VL-32B 87.8 88.1 87.9 89.4 58.3 73.9 83.6 56.9 70.3 PaDT-7B 75.7 73.6 74.9 86.0 54.8 70.4 79.0 53.8 66.4 LVR-7B 84.4 76.3 81.2 88.3 56.8 72.5 82.5 54.5 68.5 UV-CoT-7B 82.6 76.3 80.1 79.8 54.5 67.1 76.8 54.3 65.5 Vis-CoT-7B 80.9 75.0 78.5 79.0 54.3 66.6 75.5 53.0 64.3 + NV-CoT (SFT) 84.3 78.9 82.2 82.0 55.3 68.6 77.3 54.5 65.9 \Delta +3.5 +3.9 +3.7 +3.0 +1.0 +2.0 +1.8 +1.5 +1.6 DeepEyes-7B 87.8 84.2 86.4 89.3 57.8 73.5 84.3 56.5 70.4 + NV-CoT (RL) 90.4 86.8 89.0 91.0 58.5 74.8 85.8 58.3 72.0 \Delta +2.6 +2.6 +2.6 +1.7 +0.7 +1.3 +1.5 +1.8 +1.6 DeepEyes-7B † 91.3 88.2 90.1 91.3 59.0 75.2 86.8 58.5 72.7 + NV-CoT † (RL) 93.0 89.5 91.6 91.8 60.3 76.0 87.5 60.0 73.8 \Delta +1.7 +1.3 +1.5 +0.5 +1.3 +1.1 +0.7 +1.5 +1.2 Datasets. For fair comparison, we use the same training data as the corresponding backbones ( e.g. , DeepEyes-7B and Vis-CoT-7B). For evaluation, we adopt V^{*} Bench ( 38 ) , HR-Bench 4K ( 36 ) , and HR-Bench 8K ( 36 ) , which assess MLLMs’ ability in fine-grained visual detail search and relative spatial reasoning across image resolutions ranging from 2K to 8K. Specifically, V^{*} Bench measures attribute reasoning (Attr) and spatial reasoning (Spatial); HR-Bench focuses on fine-grained spatial perception (FSP) and fine-grained comparison perception (FCP), as well as overall performance. Evaluation protocols. For a fair comparison under identical inference scaling, we evaluate all models with a single tool call (zoom-in) per query, since some baselines ( e.g. , Vis-CoT ( 26 ) and UV-CoT ( 42 ) ) do not support iterative tool invocations. For methods that do support multiple tool calls ( e.g. , DeepEyes ( 43 ) and our NV-CoT (RL)), we additionally report results under multiple tool use. Implementation details. To ensure a fair comparison, we keep the training configurations identical to those of the backbone methods (DeepEyes-7B ( 43 ) and Vis-CoT-7B ( 26 ) ), and only replace text-form coordinate prediction with our continuous action formulation. Specifically, for SFT, we fine-tune LLaVA for one epoch with a batch size of 128. We use the Adam optimizer with zero weight decay, a learning rate of 2\times 10^{-5} , and a cosine learning-rate scheduler. \lambda in Eq. ( 3.2 ) is set to 0.3 . For RL, we train the RL-based model on top of Qwen2.5-VL-7B using GRPO for 80 iterations on 32 A100 GPUs. We set the batch size to 256 and the GRPO group size to G=16 . The KL coefficient is set to \beta=0 . Table 2 : Ablation on coordinate policy (Gaussian ( \ell_{2}^{2} ) vs. Laplace ( \ell_{1} )) and uncertainty parameterization (shared \sigma/\alpha vs. per-coordinate \bm{\sigma}/\bm{\alpha} ). Non-shared \bm{\sigma}/\bm{\alpha} : per-coordinate scale (standard deviation) predicted by four heads. Laplace policy consistently performs better than Gaussian policy, while using a shared versus per-coordinate \bm{\sigma}/\bm{\alpha} yields comparable results. Model V^{*} Bench HR Bench 4K HR Bench 8K Attr Spatial Overall FSP FCP Overall FSP FCP Overall SFT \ell_{2}^{2} loss 83.5 76.3 80.6 81.5 53.5 67.5 76.0 54.3 65.1 \ell_{1} loss 84.3 78.9 82.2 82.0 55.3 68.6 77.3 54.5 65.9 RL Gaussian policy 88.7 85.5 87.4 90.3 58.3 74.3 85.0 58.0 71.5 + Independent \bm{\sigma} 87.8 86.8 87.4 90.0 58.3 74.1 85.5 57.8 71.6 Laplace policy 90.4 86.8 89.0 91.0 58.5 74.8 85.8 58.3 72.0 + Independent \bm{\alpha} 89.6 86.8 88.5 90.8 58.8 74.8 86.0 58.3 72.1 4.2 Main Results The overall performance comparisons are reported in Table 1 , leading to the following key observations: (1) Our NV-CoT consistently outperforms the backbone models across all benchmarks under both SFT and RL. Specifically, under SFT, NV-CoT improves over Vis-CoT-7B by +3.4\% overall on V^{*} Bench, +2.0\% on HR-Bench 4K, and +1.5\% on HR-Bench 8K. Under RL, NV-CoT achieves further gains over DeepEyes-7B, with overall improvements of +2.7\% , +1.3\% , and +1.8\% on the three benchmarks, respectively. These results suggest that replacing text-based bounding-box prediction with our numerical one benefits both SFT and RL training paradigms. (2) We observe a clear paradigm advantage of zoom-in visual CoT over patch-based reasoning. The backbone DeepEyes-7B and our NV-CoT (RL) consistently outperform patch-based baselines such as PaDT-7B and LVR-7B across all benchmarks, suggesting that region selection via zoom-in is more effective than reasoning over fixed-granularity patches. (3) Methods that perform thinking with images substantially outperform basic MLLMs such as LLaVA-OneVision-7B and Qwen2.5-VL-7B. Notably, despite being built on a 7B backbone, NV-CoT achieves performance that surpasses Qwen2.5-VL-32B across all benchmarks. This highlights the importance of region-grounded visual reasoning in improving multimodal understanding. (4) Allowing multiple zoom-in tool calls further improves “thinking with images” performance, indicating that iterative region selection and refinement is beneficial for fine-grained visual reasoning. Notably, DeepEyes-7B † achieves consistently higher scores than its single-call counterpart across all benchmarks. Building on this stronger multi-step setting, NV-CoT † further boosts performance by replacing textified coordinates with continuous coordinate actions, enabling more precise region localization. 4.3 Ablation Studies This section presents ablation studies on (i) the coordinate policy family (Gaussian/ \ell_{2}^{2} vs. Laplace/ \ell_{1} ), and (ii) the uncertainty parameterization, comparing a shared scalar dispersion parameter (Gaussian \sigma or Laplace \alpha ) against independent per-coordinate parameters (Gaussian \bm{\sigma}\in\mathbb{R}_{+}^{4} or Laplace \bm{\alpha}\in\mathbb{R}_{+}^{4} ), as summarized in Table 2 and Table 3 . Table 3 : Bounding-box IoU on the Vis-CoT-363K dataset. NV-CoT substantially improves localization precision over Vis-CoT, with the \ell_{1} loss outperforming the \ell_{2}^{2} loss. Vis-CoT NV-CoT ( \ell_{2}^{2} ) NV-CoT ( \ell_{1} ) Bbox IoU 47.3 57.4 59.5 Figure 3 : Behavior of \alpha . Successful trajectories exhibit smaller \alpha than failed ones, reflecting higher confidence. Regression loss and policy distribution. We jointly analyze the choice of regression loss in SFT and policy distribution in RL, as both stages reflect continuous modeling of coordinates. In the SFT stage, the \ell_{1} loss consistently outperforms the \ell_{2}^{2} loss across all benchmarks, improving overall accuracy on V^{*} Bench by +1.5\% and yielding consistent gains on HR-Bench 4K ( +1.1\% ) and 8K ( +0.6\% ). These trends carry over to RL: the Laplace policy consistently outperforms the Gaussian policy on all benchmarks. This is consistent with prior observations in bounding-box and keypoint regression that \ell_{1} -type objectives are more robust for localization. Under SFT, we further measure bounding-box IoU on the Vis-CoT-363K validation set. As shown in Table 3 , NV-CoT significantly improves localization accuracy over Vis-CoT, with the \ell_{1} loss achieving the best IoU. Figure 4 : Effect of \lambda . Performance peaks at \lambda=0.3 and NV-CoT consistently outperforms the baseline across all values. Figure 5 : Visualization of bounding boxes. NV-CoT produces more accurate bounding boxes (shown in red ) compared to the backbone model (shown in blue ), demonstrating improved localization capability. Shared vs. independent \bm{\sigma/\alpha} parameterization. We further investigate whether the dispersion parameter should be shared across coordinates or predicted independently. Taking the Gaussian policy as an example, we extend the model with four additional heads \Sigma=[\mathbf{w}_{\sigma,x_{1}},\mathbf{w}_{\sigma,y_{1}},\mathbf{w}_{\sigma,x_{2}},\mathbf{w}_{\sigma,y_{2}}]^{\top} to predict per-coordinate standard deviations. Specifically, the independent standard deviations are given by \bm{\sigma}=[\sigma_{1},\sigma_{2},\sigma_{3},\sigma_{4}]^{\top}=\max\!\left(\Sigma\mathbf{h},\varepsilon\right), (16) which generalizes the shared-variance formulation in Eq. ( 2 ). Now, the importance ratio changes to: r(\theta)=\prod_{j=1}^{4}\frac{\sigma_{\theta_{\mathsf{old}},j}}{\sigma_{\theta,j}}\exp\!\left(-\frac{(b_{j}-\mu_{\theta,j})^{2}}{2\sigma_{\theta,j}^{2}}+\frac{(b_{j}-\mu_{\theta_{\mathsf{old}},j})^{2}}{2\sigma_{\theta_{\mathsf{old}},j}^{2}}\right). (17) The Laplace policy follows an analogous procedure. As shown in Table 2 , the performance gap between shared and independent parameterizations is marginal across all benchmarks. Given the comparable results, we adopt a shared \sigma/\alpha in our final model for simplicity and efficiency. 4.4 Other Analyses Behavior analysis of \alpha . In Figure 3 , we analyze the behavior of the Laplace scale parameter \alpha by comparing its average values across success and failure cases. Results across different image resolutions are normalized. Successful trajectories consistently exhibit smaller \alpha than failed ones. This observation indicates that accurate localization is associated with lower predictive uncertainty, leading the policy to produce more concentrated bounding-box samples. Effect of \lambda . In Figure 4 , we study the effect of \lambda in Eq. ( 3.2 ) by varying it from 0.1 to 0.9 and reporting overall accuracy on three benchmarks. NV-CoT achieves the best performance at \lambda=0.3 , while maintaining relatively stable accuracy across a wide range of values. Notably, across all \lambda settings, NV-CoT consistently outperforms the text-based baselines by a clear margin, indicating that the performance gains are robust and not sensitive to the choice of \lambda . Visualization. In Figure 5 , we present qualitative comparisons of bounding-box localization between NV-CoT and the backbone model. The backbone model (blue) often produces coarse or loosely aligned bounding boxes that either cover excessive background regions or partially miss the target objects. In contrast, NV-CoT (red) consistently generates tighter and more accurate bounding boxes that better align with the true object extents. The visualizations demonstrate that modeling bounding-box coordinates as continuous actions enables NV-CoT to capture spatial structure more effectively, resulting in improved localization quality and reduced ambiguity in region grounding. 5 Conclusion We present NV-CoT , a plug-and-play framework that enables MLLMs to directly generate continuous bounding-box coordinates instead of textual tokens. By formulating localization as a continuous-action problem with Gaussian/Laplace policies, NV-CoT supports both supervised fine-tuning and reinforcement learning. NV-CoT mitigates the modality mismatch and semantic fragmentation of text-based visual CoT, while avoiding the fixed-granularity limitation of patch-based designs, with only minimal architectural modifications. Experiments on three benchmarks demonstrate consistent improvements in localization precision, final answer accuracy and training efficiency. Impact Statements This paper presents work whose primary goal is to advance the capabilities of multimodal large language models in visual reasoning, particularly through more accurate and efficient region grounding. By enabling models to reason over images using continuous numerical representations, our approach improves localization precision and training efficiency, which may benefit a wide range of downstream applications such as visual question answering and optical character recognition. At the same time, improved visual localization and reasoning capabilities could be applied in sensitive domains. However, our work does not introduce new data sources, deployable systems, or application-specific pipelines, and it relies on standard benchmark datasets commonly used in the research community. As such, we do not believe that this work introduces novel ethical risks beyond those already well recognized in the field of MLLMs. Appendix A Implementation Details A.1 Datasets For fair comparison with prior visual chain-of-thought methods, we adopt exactly the same training data as the corresponding backbone models. Supervised Fine-Tuning (SFT). For supervised fine-tuning, we adopt the Visual-CoT dataset constructed following the protocol of Vis-CoT ( 26 ) . The dataset is built by collecting images and annotations from twelve publicly available datasets spanning five domains, including text/document understanding, fine-grained visual recognition, general visual question answering, chart understanding, and relation reasoning. These source datasets mainly consist of VQA and image captioning benchmarks, from which images and useful annotations such as question-answer pairs, captions, object bounding boxes, and object relations are reused. The data construction process involves both linguistic and visual annotation stages. For linguistic annotation, a large language model (GPT-4) is employed to generate or refine question-answer pairs and, where applicable, to produce intermediate reasoning steps. For visual annotation, task-relevant regions are identified to serve as visual chain-of-thought (CoT) grounding signals. In text-centric domains, such as TextVQA ( 28 ) , DocVQA ( 23 ) , DUDE ( 32 ) , SROIE ( 8 ) , and InfographicsVQA ( 22 ) , OCR-based tools (e.g., PaddleOCR) are used to detect text regions, and the CoT bounding boxes are defined as regions containing words or sentences that directly support the answer. In fine-grained recognition tasks, bounding boxes corresponding to discriminative object parts or attributes are used to guide fine-grained visual reasoning. For general VQA and relation reasoning tasks, including Flickr30k ( 24 ) , Visual7W ( 45 ) , VSR ( 18 ) , and GQA ( 9 ) , object-level annotations and scene graph information are leveraged. The visual CoT bounding boxes correspond to objects or regions that are explicitly involved in answering the question, such as spatially related objects or attributes specified in the query. In particular, for GQA, structured semantic annotations are used to identify the target objects and relations, enabling precise grounding of intermediate reasoning steps. During SFT, each training example consists of an image, a question, a sequence of intermediate visual grounding steps represented by bounding boxes, and the final answer. The model is trained to jointly generate textual outputs and predict continuous bounding-box coordinates, allowing it to learn region-grounded visual reasoning under explicit supervision. Reinforcement Learning (RL). For reinforcement learning, we adopt the same training data and protocol as DeepEyes ( 43 ) . Unlike supervised fine-tuning, the RL setting does not rely on any explicit intermediate bounding-box annotations. Instead, the model is optimized solely through outcome-level supervision, which better reflects practical scenarios where fine-grained visual grounding labels are unavailable. The RL training data is constructed to emphasize tool-aware visual reasoning and consists of three complementary subsets: fine-grained visual search data, chart understanding data, and general reasoning data. The fine-grained subset is sampled from a portion of the V ∗ training set ( 38 ) , focusing on high-resolution images and detailed perception tasks where localized visual inspection is critical for correct answering. The chart subset is drawn from ArxivQA ( 15 ) , which contains synthetic plots, diagrams, and structured graphical representations, significantly expanding the diversity of visual modalities beyond natural images. To further enhance reasoning diversity, some samples are incorporate from ThinkLite-VL ( 37 ) , which include multimodal questions requiring arithmetic reasoning, commonsense inference, and multi-step problem solving. Then a dedicated data selection pipeline is applied. First, question difficulty is estimated by prompting a strong vision-language model to generate multiple responses per question and measuring answer consistency; overly trivial or extremely difficult samples are filtered out. Second, original questions are reformulated into open-ended formats to better align with generative training objectives, and samples that cannot be reliably converted are discarded. Third, unverifiable instances are removed, including those with ambiguous questions, incorrect annotations, or unreadable visual content. Finally, chart data is exempted from this filtering step due to its inherent reliance on visual structure, while reasoning data is retained in its original form. Figure 6 : More visualization results of bounding boxes. NV-CoT produces more accurate bounding boxes (shown in red ) compared to the backbone model (shown in blue ), demonstrating improved localization capability. A.2 Evaluation Protocol Inference Prompts. We employ two different prompt templates for reinforcement learning and supervised fine-tuning, respectively, reflecting their distinct training objectives and supervision signals. For reinforcement learning, we use a structured inference prompt that explicitly encourages step-by-step reasoning and conditional tool usage. The prompt instructs the model to first reason about the question, then optionally invoke the image zoom-in tool when fine-grained visual inspection is necessary, and finally produce the answer in a strictly defined format. This structured output separates reasoning, tool calls, and final answers, enabling reliable trajectory parsing and outcome-driven reward computation during policy optimization. For supervised fine-tuning, we adopt a localization-oriented prompt that explicitly asks the model to identify a task-relevant image region by predicting a bounding-box coordinate. The model is instructed to answer the question based on both the original image and the localized region. This prompt design encourages the model to learn explicit visual grounding under bounding-box supervision, strengthening the alignment between region selection and downstream reasoning. RL Evaluating Prompt Template Think first, call image_zoom_in_tool if needed, then answer. Format strictly as: ... ... (if tools needed) ... SFT Evaluating Prompt Template Please provide the bounding box coordinate of the region that can help you answer the question better. Answer the question based on the original image and local image. Appendix B More Visualization Results In this section, we provide additional qualitative visualization results to further illustrate the behavior of our model under different visual reasoning scenarios. These examples complement the quantitative evaluations in the main paper and offer intuitive insights into how the model performs region grounding and integrates localized visual information during reasoning. Specifically, we visualize the predicted bounding boxes generated by the model for a variety of tasks, including fine-grained object recognition, spatial relation reasoning, and chart understanding. The results demonstrate that the model consistently identifies task-relevant regions that are closely aligned with the visual evidence required to answer the question, even in high-resolution images with cluttered backgrounds or small target objects. Appendix C LLM Usage Statement ChatGPT was employed solely for minor editorial assistance, such as improving grammar and readability. The research ideas, methodology, experiments, and analysis were entirely developed and conducted by the authors without the use of LLMs.