LLMs Judging LLMs: A Simplex Perspective

2025

Read LLMs Judging LLMs: A Simplex Perspective (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-21972.txt.

Introduction

Patrick Vossler and four co-authors put the practice of using language models to rank other language models onto geometric footing. With no gold-standard scores, judge-based ranking quietly assumes the judges are right, ignoring uncertainty about judge quality. The authors ask when that practice is valid at all.

Their trick is to place judges and candidates as points on a probability simplex, where areas and distances encode ranking concepts. In that picture, conditions for rankings to be identifiable become visual and provable. Folk wisdom gets a proof: two-level scoring is fundamentally easier for judges than multi-level scoring. Geometric Bayesian priors then let them inject doubt about judge quality and test how rankings bend under sensitivity analysis.

Catalog record

YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE102 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-21972

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

LLMs Judging LLMs: A Simplex Perspective Abstract Given the challenge of automatically evaluating free-form outputs from large language models (LLMs), a common solution is to use LLMs themselves as judges, without any gold-standard scores. Implicitly, this practice accounts for only sampling variability ( aleatoric uncertainty ) and ignores uncertainty about judge quality ( epistemic uncertainty ). While this is justified if judges are perfectly accurate, it is unclear when such an approach is theoretically valid and practically robust. We study these questions for the task of ranking LLM candidates from a novel geometric perspective: for M M -level scoring systems, both LLM judges and candidates can be represented as points on an ( M − 1 ) (M-1) -dimensional probability simplex, where geometric concepts (e.g., triangle areas) correspond to key ranking concepts. This perspective yields intuitive theoretical conditions and visual proofs for when rankings are identifiable; for instance, we provide a formal basis for the “folk wisdom” that LLM judges are more effective for two-level scoring ( M = 2 M=2 ) than multi-level scoring ( M > 2 M>2 ). Using this geometric intuition, we design Bayesian priors that encode epistemic uncertainty and vary the priors to conduct sensitivity analyses. Experiments on LLM benchmarks show that rankings based solely on LLM judges are robust in many but not all datasets, underscoring both their widespread success and the need for caution. Our Bayesian method achieves substantially higher coverage rates than existing procedures by modeling epistemic uncertainty. LLMs Judging LLMs: A Simplex Perspective Patrick Vossler 1∗ Fan Xia 1∗ Yifan Mai 2 Adarsh Subbaswamy 3 Jean Feng 1 1 University of California, San Francisco 2 Stanford University 3 University of Maryland, Baltimore 1 1 footnotetext: Equal contribution 1 INTRODUCTION Scalable benchmarking of large language models (LLMs) is increasingly critical given the rapid proliferation of models, model updates, and new benchmark datasets. While multiple choice or numerical answers can be verified algorithmically, many benchmark tasks allow free-form text responses that are more difficult to verify, such as clinical reasoning expressed as natural language or mathematical proofs involving multi-part LaTeX formulas. While the current gold standard of consensus voting by multiple human experts is effective, it is often prohibitively expensive and difficult to scale. In response to these challenges, recent work has proposed using LLMs themselves as judges (Figure 1 ) ( Zheng et al., 2023b ) . Here we refer to evaluator LLMs as “judges” and evaluated LLMs as “candidates.” This now-common practice effectively treats LLM judges as perfectly accurate, ignoring any uncertainty about their quality and acknowledging only sampling variability (e.g., through bootstrapping or confidence intervals). Borrowing terms from epistemology, the first source of uncertainty is systematic or epistemic ; due to the lack of gold-standard data, one is uncertain about and cannot determine the true quality of the judges. The second source of uncertainty is stochastic or aleatoric ; due to sampling variability, there is noise in the returned judge scores but this type of uncertainty can be reduced by increasing sample size. The goal of this work is to understand how epistemic uncertainty impacts our ability to rank LLM candidates. We do so by answering two questions: (i) from a theoretical standpoint, what are sufficient conditions for an LLM-as-a-judge pipeline to identify the true rankings and (ii) from a methodological standpoint, how can we quantify our confidence in estimated rankings when we do not know if these theoretical conditions hold in practice? Figure 1: LLM judge workflow: For each benchmark question, LLM judges score each candidate’s answer according to a rubric. Candidates are ranked based on their judge-assigned scores. Shaded boxes indicate cases where the same LLM serves as both candidate and judge (self-judging). We show that a geometric perspective clarifies the role of epistemic uncertainty and guides both theoretical and methodological development. The key idea is that we can simultaneously visualize judge quality and candidate score distributions on a probability simplex, where geometric concepts (e.g., triangle areas) correspond to key ranking concepts. Epistemic uncertainty manifests as uncertainty in the location of judge points, while aleatoric uncertainty manifests as stochasticity of candidate points. This representation allows us to reason about how the relative positions of these points affect identifiability and estimation of the true rankings. Using this framework, we find that constancy of LLM judge behavior is sufficient for ranking identifiability in two-level scoring systems. However, this sufficiency breaks down when ranking across three or more levels, uncovering a surprising phase transition. These theoretical results motivate the development of a Bayesian framework for estimating ranks, where we construct minimally-informative geometric priors that encode our prior beliefs about judge quality. We then conduct sensitivity analyses of estimated rankings by varying the strength of the Bayesian priors, which corresponds to varying the level of epistemic uncertainty. Applying our framework to five LLM benchmark datasets, our sensitivity analyses reveal that estimated candidate rankings are robust in some cases (e.g., GPQA and SummEval) but not others (e.g., Omni-MATH). These results explain the practical success of LLM judges, but also emphasize the importance of their careful, measured use. The Bayesian framework also achieves substantially higher coverage of the true rankings than existing methods, since it captures both aleatoric and epistemic uncertainty whereas standard approaches capture only the former. These results underscore how incorporating epistemic uncertainty is necessary for reliable rankings from LLM judges. Code for reproducing this work and running the Bayesian inference pipeline is available at https://github.com/jjfenglab/judging-llms-on-a-simplex . 2 RELATED WORK LLM-as-a-judge and their implicit assumptions. While LLM judges have emerged as a scalable alternative to traditional metrics that require reference outputs ( Papineni et al., 2001 ; Lin, 2004 ; Wang et al., 2023 ; Chiang and Lee, 2023 ; Li et al., 2024 ; Gu et al., 2024 ) , current approaches may not fully capture all sources of uncertainty in their rankings. LLM judges exhibit systematic biases such as position bias and verbosity bias ( Zheng et al., 2023b ; Koo et al., 2024 ; Wei et al., 2025 ) , echoing known phenomena in human judgment—the halo effect ( Thorndike, 1920 ) and anchoring ( Tversky and Kahneman, 1974 ) . Proposed mitigations—score averaging, juries, judge debates, rubrics ( Liang et al., 2023 ; Verga et al., 2024 ; Kalra and Tang, ; Chan et al., 2024 ; Databricks, 2024 ; Lee et al., 2024 ) —implicitly assume that judges are perfect or that their errors cancel out in expectation, ignoring uncertainty about judge quality. While Guerdan et al. (2025) discussed the limitations of LLM judges when there is no true agreed-upon rating scale, we prove that even with agreed-upon scales, fundamental identifiability limits exist that no averaging or ensemble method can overcome. Uncertainty quantification without ground truth. Existing uncertainty quantification methods cannot address the fundamental challenge of epistemic uncertainty about judge quality. Bootstrapping ( Goldstein and Spiegelhalter, 1996 ; Xie et al., 2009 ) only quantifies sampling variation, leading to undercoverage when assumptions fail. Methods like prediction-powered inference ( Chatzi et al., 2024 ; Angelopoulos et al., 2023 ) , conformal inference ( Jung et al., 2025 ) , or consensus models ( Raykar et al., 2010 ; Welinder and Perona, 2010 ) can integrate LLM judging if

Read the complete text