Seeing is Believing, but How Much? A Comprehensive Analysis of Verbalized Calibration in Vision-Language Models

Weihao Xuan, Qingcheng Zeng, Heli Qi, Junjue Wang, Naoto Yokoya · 2025

Read Seeing is Believing, but How Much? A Comprehensive Analysis of Verbalized Calibration in Vision-Language Models by Weihao Xuan, Qingcheng Zeng, Heli Qi, Junjue Wang, Naoto Yokoya (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20236.txt.

Introduction

Weihao Xuan and co-authors check whether vision-language models know how sure they are. Verbalized confidence lets a model state its certainty in words. The trick works fairly in text-only models but is untested across vision. Their 2025 study spans three model families, four task domains, and three test settings. The verdict is sobering: stated confidence often drifts from real accuracy. Models sound sure when they are wrong, and hedge when right.

Models that reason with images, thinking through what they see, calibrate best. A two-stage prompting scheme, Visual Confidence-Aware Prompting, tightens the match further. The team frames the gap as a faithfulness problem, not a wording one. Trust in multimodal systems, they argue, needs this honesty check.

Catalog record

CREATORWeihao Xuan, Qingcheng Zeng, Heli Qi, Junjue Wang, Naoto Yokoya
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE133 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-20236

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Seeing is Believing, but How Much? A Comprehensive Analysis of Verbalized Calibration in Vision-Language Models Weihao Xuan, Qingcheng Zeng, Heli Qi, Junjue Wang, Naoto Yokoya Abstract Uncertainty quantification is essential for assessing the reliability and trustworthiness of modern AI systems. Among existing approaches, verbalized uncertainty—where models express their confidence through natural language—has emerged as a lightweight and interpretable solution in large language models (LLMs). However, its effectiveness in vision-language models (VLMs) remains insufficiently studied. In this work, we conduct a comprehensive evaluation of verbalized confidence in VLMs, spanning three model categories, four task domains, and three evaluation scenarios. Our results show that current VLMs often display notable miscalibration across diverse tasks and settings. Notably, visual reasoning models (i.e., thinking with images ) consistently exhibit better calibration, suggesting that modality-specific reasoning is critical for reliable uncertainty estimation. To further address calibration challenges, we introduce Visual Confidence-Aware Prompting , a two-stage prompting strategy that improves confidence alignment in multimodal settings. Overall, our study highlights the inherent miscalibration in VLMs across modalities. More broadly, our findings underscore the fundamental importance of modality alignment and model faithfulness in advancing reliable multimodal systems. 1 Introduction Recent advances in large language models (LLMs) and vision-language models (VLMs) have led to significant progress across a broad spectrum of capabilities, including reasoning OpenAI et al. (2024b) ; OpenAI et al. (2025) , instruction following Zhou et al. (2023) ; Grattafiori et al. (2024) , and visual understanding Liu et al. (2023) ; Li et al. (2024a) ; Padlewski et al. (2024) ; Agrawal et al. (2024) ; Bai et al. (2025) . However, as these models are increasingly deployed in real-world and high-stakes applications, evaluating their trustworthiness has become as essential as measuring their task performance. A fundamental aspect of this assessment is calibration - ensuring that a model’s expressed confidence aligns with its actual accuracy in real-world scenarios. With the rise of closed-source models that only support text-based interactions, the ability to express uncertainty, similar to human communication verbally, has become particularly crucial for practical applications Xiong et al. (2024) . Although quite a few studies have explored eliciting more accurate confidence estimations from LLMs Lin et al. (2022) ; Tian et al. (2023) ; Xu et al. (2024) ; Hager et al. (2025) , how these strategies adapt to VLMs remains an open question. Unlike text-only models, VLMs process and integrate information across multiple modalities, introducing new dimensions of complexity in how confidence is expressed and calibrated. This multimodal nature raises three critical challenges: 1) How accurately can VLMs verbalize their confidence? 2) How do instructions embedded within images affect calibration? 3) Does verbalized confidence remain consistent when processing the same information presented in different modalities? These questions highlight a gap in current research and underscore the need for a deeper investigation into modality-sensitive uncertainty estimation in VLMs. Our contributions are threefold: 1) We present the first comprehensive evaluation of verbalized confidence in a diverse set of commercial and open-source VLMs, leveraging widely adopted large-scale multimodal datasets. Our analysis focuses on three evaluation scenarios, with particular focus on the embedded instruction setting and the semantically aligned setting, to investigate how calibration behaviors vary across input modalities. 2) Our results indicate that most VLMs continue to exhibit miscalibration in their verbalized uncertainty. However, visual reasoning models, those capable of thinking with images , show notable improvements in calibration across benchmarks and modalities. These findings point to the promise of visual reasoning-oriented enhancement for verbalized uncertainty estimation. 3) To further improve calibration, we introduce visual confidence-aware prompting , a two-stage strategy that elicits visual-specific confidence before aggregating the final output. Compared to strong baselines such as Top-K prompting and self-reflection, our method yields significant gains in calibration quality. In summary, this work comprehensively evaluates the verbalized calibration in current VLMs, reveals persistent miscalibration issues across modalities, and offers a promising direction for enhancing verbalized uncertainty. Figure 1: The illustration of our three types of evaluations: general, embedded instruction, and semantically aligned evaluation. These configurations test VLMs’ calibration across different input modalities and instruction formats. 2 Related Works 2.1 Uncertainty Quantification and Calibration in L(V)LMs Quantifying and calibrating uncertainty is a key area of research for improving the reliability of LLMs Fadeeva et al. (2023) ; Vashurin et al. (2024) . A variety of techniques have been explored to estimate uncertainty in L(V)LMs, including sampling-based approaches Kuhn et al. (2023) ; Nikitin et al. (2024) , which approximate uncertainty by drawing from predictive distributions; information-theoretic methods Fadeeva et al. (2024) ; Chen et al. (2025) , which employ measures such as entropy or mutual information; and reflexive approaches Tian et al. (2023) ; Xiong et al. (2024) , which investigate how models articulate their own uncertainty through natural language. This work focuses on the reflexive category, specifically examining how VLMs verbalize uncertainty. Verbalized uncertainty offers practical advantages: it eliminates the need for computational overhead associated with sampling or post-hoc calibration, while providing uncertainty assessments that are easily understood by general users Hager et al. (2025) . Prior studies have identified consistent patterns of overconfidence in verbalized uncertainty produced by instruction-tuned models Xiong et al. (2024) ; Yang et al. (2024) . Others have observed that reinforcement learning (RL)-based reasoning can improve calibration across domains, suggesting that RL may induce more reflective and self-aware model outputs Zeng et al. (2025) . While initial analyses of verbalized uncertainty in VLMs have been conducted, primarily on small-scale or object-level datasets Groot and Valdenegro Toro (2024) ; Borszukovszki et al. (2025) ; Zhao et al. (2025) , a broader, systematic evaluation across tasks, domains, and model families remains lacking. Our work addresses this gap through a holistic analysis of how VLMs express and calibrate their uncertainty across diverse settings. 2.2 Modality Misalignment in Multimodal LLMs In multimodal LLMs, an ideal expectation is that the models maintain consistent performance when equivalent information is presented across different modalities. However, a growing body of research in vision-language Li et al. (2024b) ; Mistretta et al. (2025) ; Shu et al. (2025) and audio-language settings Chen et al. (2024) has highlighted significant modality misalignment in many current multimodal models. These findings demonstrate systematic failures in cross-modal information integration and generalization. In response, several benchmarks have been proposed to quantify and analyze these performance gaps Fu et al. (2024) . In this work, we extend the analysis to examine how calibration, particularly through verbalized uncertainty, behaves across text and image modalities in VLMs, providing novel insights into both alignment and confidence consistency. 3 Experimental Setup 3.1 Evaluation Configurations To comprehensively analyze verbalized confidence in VLMs, we design three complementary evaluation configurations, each targeting distinct dimensions of model behavior related to modality, instruction presentation, and calibration robustness across different modalities ( Figure 1 ). These settings allow us to assess not only the overall calibration performance but also how it varies with changes in input format and reasoning demands. 3.1.1 General Evaluation In the general evaluation setting, we assess verbalized confidence when VLMs are prompted via textual instructions and required to reason over visual inputs. This configuration reflects a common usage scenario in which users provide tasks through natural language while the model processes accompanying images or video. We

Read the complete text