VLM Judges Can Rank but Cannot Score: Task-Dependent Uncertainty in Multimodal Evaluation
Divake Kumar, Sina Tayebati, Devashri Naik, Ranganath Krishnan, Amit Ranjan Trivedi, [4pt] University of Illinois at Chicago, AI Labs at Capital One · 2026
Read VLM Judges Can Rank but Cannot Score: Task-Dependent Uncertainty in Multimodal Evaluation by Divake Kumar, Sina Tayebati, Devashri Naik, Ranganath Krishnan, Amit Ranjan Trivedi, [4pt] University of Illinois at Chicago, AI Labs at Capital One (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2604-25235.txt.
Introduction
Kumar and four colleagues study vision-language models as judges through conformal prediction, turning point scores into calibrated ranges from log-probabilities, with no retraining. Across 3 judges and 14 task categories, uncertainty is task-dependent. Intervals cover about 40 percent of the range for aesthetics and natural images but expand to about 70 percent for chart and math tasks. They identify ranking-scoring decoupling: judges rank well while producing wide intervals, failing to assign reliable scores. Interval width tracks task difficulty and annotation quality, with 4.5 times tighter intervals on a clean benchmark.
Catalog record
| CREATOR | Divake Kumar, Sina Tayebati, Devashri Naik, Ranganath Krishnan, Amit Ranjan Trivedi, [4pt] University of Illinois at Chicago, AI Labs at Capital One |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 77194 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2604.25235
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
VLM Judges Can Rank but Cannot Score: Task-Dependent Uncertainty in Multimodal Evaluation Divake Kumar, Sina Tayebati, Devashri Naik, Ranganath Krishnan, Amit Ranjan Trivedi, [4pt] University of Illinois at Chicago, AI Labs at Capital One Abstract Vision-language models (VLMs) are increasingly used as automated judges for multimodal systems, yet their scores provide no indication of reliability. We study this problem through conformal prediction, a distribution-free framework that converts a judge’s point score into a calibrated prediction interval using only score-token log-probabilities, with no retraining. We present the first systematic analysis of conformal prediction for VLM-as-a-Judge across 3 judges and 14 visual task categories. Our results show that evaluation uncertainty is strongly task-dependent: intervals cover ∼ 40 % \sim 40\% of the score range for aesthetics and natural images but expand to ∼ 70 % \sim 70\% for chart and mathematical reasoning, yielding a quantitative reliability map for multimodal evaluation. We further identify a failure mode not captured by standard evaluation metrics, ranking-scoring decoupling , where judges achieve high ranking correlation while producing wide, uninformative intervals, correctly ordering responses but failing to assign reliable absolute scores. Finally, we show that interval width is driven primarily by task difficulty and annotation quality, i.e., the same judge and method yield 4.5 × 4.5\times narrower intervals on a clean, multi-annotator captioning benchmark. Code: github.com/divake/VLM-Judge-Uncertainty 1 Introduction Vision-Language Models (VLMs) are increasingly used as automated judges to evaluate multimodal AI systems ( Chen et al. 2024 ; Li et al. 2025 ) . This VLM-as-a-Judge paradigm extends LLM-based evaluation to tasks requiring visual understanding, including chart comprehension, visual question answering, image captioning, and AI-generated image quality. As multimodal agents are deployed in high-stakes settings such as medical imaging, web navigation, and document analysis, the reliability of these evaluations becomes critical, paralleling broader concerns about uncertainty quantification and robustness in safety-critical autonomous systems ( Trivedi et al. 2025 ; Darabi et al. 2024 ; Darabi et al. 2025 ; Poggi et al. 2026 ; Naik et al. 2026 ) . However, VLM judges produce only point scores, offering no indication of reliability. A score of four out of five (4/5) may reflect confident correctness or substantial uncertainty, yet users cannot distinguish between the two. This limitation is exacerbated in multimodal settings, where errors can arise from both visual perception and language reasoning. For example, evaluating a chart-based answer requires visual parsing, data extraction, and reasoning, each introducing compounding uncertainty. Empirically, this reliability gap is significant. On the MLLM-as-a-Judge benchmark ( Chen et al. 2024 ) , state-of-the-art VLM judges achieve only 32–34% exact agreement with human ratings on a 5-point scale, and 24–30% of predictions deviate by 2 or more points. Correlation metrics remain modest ( \rho=0.30 – 0.46 ), providing limited assurance about per-instance reliability. Existing evaluation metrics thus fail to indicate when a judge’s score can be trusted. We address this problem using conformal prediction ( Vovk et al. 2005 ) , a post-hoc, distribution-free framework that converts point scores into calibrated prediction intervals with provable coverage guarantees. Given a target coverage (e.g., 90%), these intervals contain the true human score with high probability, without requiring model retraining or assumptions on error distributions. Conformal prediction operates directly on score-token log-probabilities, making it readily applicable to existing VLM judge pipelines. While prior work ( Sheng et al. 2025 ) demonstrates the effectiveness of conformal prediction for text-only LLM judges, extending it to multimodal evaluation introduces new challenges: (i) cross-modal uncertainty from visual and textual reasoning, (ii) discrete single-annotator ground truth, (iii) substantial task heterogeneity across visual domains, and (iv) varying levels of log-probability access across models. Standard metrics such as correlation and accuracy fail to capture evaluation reliability. We present a systematic study of conformal prediction for VLM-based evaluation. Our contribution is not the application of conformal prediction itself, but the identification of task-dependent uncertainty structure and a fundamental decoupling between ranking quality and scoring reliability in multimodal evaluation. We show that high correlation does not imply reliable absolute scores, and that uncertainty is primarily driven by task ambiguity and annotation quality rather than model scale. Our key findings are: • Task-dependent uncertainty: Prediction interval width varies by up to 70% across tasks. Vision-heavy tasks such as charts and mathematical reasoning yield substantially wider intervals than natural image or aesthetics tasks, providing a quantitative reliability map. • Ranking-scoring decoupling: We identify a failure mode not captured by standard evaluation metrics where judges achieve strong ranking correlation while producing wide, uninformative intervals. That is, they correctly order responses but fail to assign reliable absolute scores. • Role of data quality: Interval width is primarily driven by task difficulty and annotation quality rather than the conformal method. The same judge and method produce 4.5\times narrower intervals on a clean, multi-annotator captioning benchmark. • Task-conditional calibration: We show that conditioning on task difficulty (Mondrian CP) yields narrower intervals for easy tasks while improving coverage for hard tasks. 2 Related work LLM-as-a-Judge. Using LLMs as automated evaluators has become a standard approach for assessing natural language generation ( Zheng et al. 2023 ; Liu et al. 2023 ) . G-Eval ( Liu et al. 2023 ) uses chain-of-thought prompting with GPT-4 to score text quality and improves correlation with human judgments over metrics such as ROUGE and BERTScore. MT-Bench and Chatbot Arena ( Zheng et al. 2023 ) establish pairwise evaluation and reveal systematic biases including position and verbosity bias. SocREval ( He et al. 2024 ) focuses on reasoning. VLM-as-a-Judge. This paradigm has been extended to multimodal evaluation. Chen et al. 2024 introduce the MLLM-as-a-Judge benchmark with 14 visual task categories and report limited alignment with human judgments. LLaVA-Critic ( Xiong et al. 2025 ) trains a dedicated multimodal judge, while VL-RewardBench ( Li et al. 2025 ) shows that a large fraction of errors are perceptual rather than reasoning-driven. Uncertainty in LLM-based evaluation. Recent work studies confidence and uncertainty in LLM judgments. Wagner et al. 2024 derive confidence scores from token probabilities and show weak correlation with accuracy. Xie et al. 2024 use token probabilities for calibration and propose boosted conformal methods. Other approaches rely on self-reported confidence ( Xiong et al. 2024 ) or consistency across multiple generations ( Tian et al. 2023 ) , both with known limitations. Sheng et al. 2025 apply conformal prediction to text-only LLM judges and show that calibrated intervals improve reliability. Beyond pointwise calibration, recent work studies conformalized abstention policies that selectively defer uncertain predictions in LLM and VLM deployments ( Tayebati et al. 2025a ; Tayebati et al. 2025b ) , and trajectory-level risk aggregation for agentic reasoning ( Tayebati et al. 2026 ) ; our work is complementary in that it directly characterizes the score-token uncertainty of the judge itself rather than acting on it. Conformal prediction. Conformal prediction provides distribution-free uncertainty estimates with coverage guarantees ( Vovk et al. 2005 ) . Prior work applies it mainly to classification tasks such as multiple-choice QA ( Kumar et al. 2023 ; Su et al. 2024 ) , factual consistency ( Quach et al. 2024 ; Mohri & Hashimoto 2024 ) , and calibrated risk control ( Angelopoulos et al. 2021 ) . Recent extensions move beyond fixed nonconformity scores: