SLMEval: Entropy-Based Calibration for Human-Aligned Evaluation of Large Language Models

Roland Daynauth, Christopher Clarke, Krisztian Flautner, Lingjia Tang, Jason Mars · 2025

Read SLMEval: Entropy-Based Calibration for Human-Aligned Evaluation of Large Language Models by Roland Daynauth, Christopher Clarke, Krisztian Flautner, Lingjia Tang, Jason Mars (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-16003.txt.

Introduction

Roland Daynauth, Christopher Clarke, Krisztian Flautner, Lingjia Tang, and Jason Mars fix a weakness in using language models as judges, in a 2025 paper. Model judges offer cheap, scalable scoring of other models. Calibration tricks aim to align their scores with human taste. Past tricks were tuned on narrow, tidy benchmarks. The team shows they often fail on open-ended real work. Scores can even run opposite to human judgment.

Their method, SLMEval, calibrates by maximizing entropy over a small set of human preferences. It estimates a hidden spread of model quality. Judge scores are then reweighted to match. On two real production tasks and one public benchmark, the method tracked human scores well. One task reached a strong rank correlation where a leading rival went negative. Costs fell five to thirty times versus top-tier judge setups. The work targets teams grading models in the wild.

Catalog record

CREATORRoland Daynauth, Christopher Clarke, Krisztian Flautner, Lingjia Tang, Jason Mars
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE22 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-16003

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

SLMEval: Entropy-Based Calibration for Human-Aligned Evaluation of Large Language Models Roland Daynauth, Christopher Clarke, Krisztian Flautner, Lingjia Tang, Jason Mars Abstract The LLM-as-a-Judge paradigm offers a scalable, reference-free approach for evaluating language models. Although several calibration techniques have been proposed to better align these evaluators with human judgment, prior studies focus primarily on narrow, well-structured benchmarks. As a result, it remains unclear whether such calibrations generalize to real-world, open-ended tasks. In this work, we show that SOTA calibrated evaluators often fail in these settings, exhibiting weak or even negative correlation with human judgments. To address this, we propose SLMEval, a novel and efficient calibration method based on entropy maximization over a small amount of human preference data. By estimating a latent distribution over model quality and reweighting evaluator scores accordingly, SLMEval achieves strong correlation with human evaluations across two real-world production use cases and the public benchmark. For example, on one such task, SLMEval achieves a Spearman correlation of 0.57 with human judgments, while G-Eval yields a negative correlation. In addition, SLMEval reduces evaluation costs by 5–30× compared to GPT-4-based calibrated evaluators such as G-eval. 1 Introduction Despite the rapid advancement of large language models (LLMs), reliably evaluating their outputs in a way that aligns with human judgment remains an open challenge. Traditional automated metrics like BLEU Papineni et al. (2002) and ROUGE Lin (2004) offer efficiency and scalability, but dependent on reference outputs and often fail to capture the subjective and contextual nuances that characterize real-world human preferences. Human evaluation remains the gold standard for assessing LLM quality, but is prohibitively expensive, time-consuming, and impractical for large-scale or iterative development cycles Chiang et al. (2024) . To address these limitations, the LLM-as-a-Judge paradigm has gained widespread adoption as a practical, low-cost alternative to human evaluation Zheng et al. (2024) ; Liu et al. (2023a) . However, despite its growing popularity, LLM-based evaluators have certain limitations. Their scores suffer from several well-documented biases and artifacts, including token length bias Li et al. (2023) , position bias Wang et al. (2024) , and repeated score patterns Liu et al. (2023b) , all of which can distort comparative judgments and reduce reliability. To mitigate these issues, a range of calibration techniques have been proposed to better align LLM-as-a-Judge evaluations with human judgments. Yet most prior studies validate these methods on narrow, well-structured benchmarks, such as summarization, translation, and question answering, where task definitions are clear and evaluation criteria are constrained Yuan et al. (2023) ; Li et al. (2023) ; Liu et al. (2023a) . As a result, it remains unclear whether these calibration strategies generalize to more subjective, open-ended tasks commonly encountered in real-world deployments. In this work, we demonstrated that the state-of-the-art calibrated LLM-based evaluators Yuan et al. (2023) ; Li et al. (2023) ; Liu et al. (2023a) frequently fail on such open-ended tasks, often yielding weak or even negative correlation with human judgments. To address this limitation, we introduce SLMEval, a novel and effective evaluation framework that uses entropy maximization to calibrate LLM-generated scores based on a small amount of human evaluation data. This calibration promotes well-calibrated LLM-based judgments that better correlate with human evaluations. In addition to better calibration results, unlike prior methods that rely on computationally intensive techniques, such as chain-of-thought prompting or multiple API calls, SLMEval operates using a single-pass evaluation with a small language model (SLM). This dramatically reduces evaluation costs and enables scalable deployment in real-world pipelines, without sacrificing alignment with human evaluations. We summarize the key contributions of this work as follows: 1. Improved Alignment with Human Judgments : We show that state-of-the-art evaluation methods, such as G-Eval Liu et al. (2023a) and GPTScore Fu et al. (2023) , perform poorly in subjective real-world tasks. In contrast, our method substantially improves alignment with human judgments. For example, in our production use case, our approach achieves a Spearman correlation of 0.57, while G-Eval yields a negative correlation, highlighting a significant performance gap in this setting. 2. Reduced Computational Overhead : Using a small language model (SLM), our approach achieves strong performance while significantly reducing the number of required API calls. For example, on a public dataset, our method achieves comparable or better alignment with human judgments while reducing evaluation costs by up to 30× compared to GPT-based evaluators.. 3. Evaluation in Real-World and Generalized Settings : We evaluate SLMEval on two real-world production tasks and a public benchmark to demonstrate its generalizability and practical relevance across diverse evaluation scenarios. 2 Related Work Traditional Evaluation Methods Embedding-based methods such as SBERT Reimers and Gurevych (2019) and BERTScore Zhang et al. (2020) improved contextual evaluations, while BLEURT Sellam et al. (2020) fine-tunes models on human-labeled data for better alignment. However, reliance on reference outputs limits their effectiveness in open-ended tasks Liu et al. (2024) . LLM-as-a-Judge Paradigm LLM-based evaluators Liu et al. (2023a) ; Fu et al. (2024) ; Irugalbandara et al. (2024) ; Kocmi and Federmann (2023) ; Chen et al. (2023) , assess the output without references, reducing the dependency on human annotation. Despite efficiency gains, these models suffer from position and verbosity biases, which impact reliability Dubois et al. (2024) . Alignment with Human Preferences Efforts to align LLM evaluations with human judgments include reinforcement learning with human feedback (RLHF) Ji et al. (2024) ; Askell et al. (2021) and direct preference optimization (DPO) Rafailov et al. (2024) . However, these approaches require extensive labeled data and significant computational resources, which limits scalability. Calibrating Evaluation with Human Preferences Studies such as Liu et al. (2024) and Wang et al. (2024) explore human-in-the-loop calibration to improve the performance of LLM-based evaluators. These methods depend on expert judgments, which may not always be feasible, particularly in open-ended tasks. 3 SLMEval Framework 3.1 SLMEval Overview Let M=\{1,\cdots,n\} be the set of models under evaluation. For a given prompt Q , an LLM or SLM-based evaluator f compares two model outputs R_{i} and R_{j} from models i,j\in M where i\neq j . The evaluator f returns scalar scores S_{ij},S_{ji}\in[1,10] such that: f(Q,R_{i},R_{j})=\{S_{ij},S_{ji}\} (1) By default, model i is said to beat j if S_{ij}>S_{ji} . However, scores suffer from several well-documented biases and limitations, such as token length bias Li et al. (2023) , position bias Wang et al. (2024) , and repeated score patterns Liu et al. (2023b) that can distort comparative judgments. To mitigate these biases, we introduce weights p=\{p_{i}\}^{n}_{i=1} similar to G-Eval Liu et al. (2023b) with the constraint p_{i}>0,\quad\sum_{i=1}^{n}p_{i}=1 (2) Unlike G-Eval, which refines evaluator scores using token-level output probabilities, SLMEval assigns each model i a latent strength parameter p_{i} estimated from a distribution designed to reflect human preferences. These parameters are then used to calibrate the evaluator’s raw scores. The win condition between models i and j is redefined as: \text{model }i\text{ beats }j\iff p_{i}S_{ij}>p_{j}S_{ji} (3) 3.2 Entropy-Based Weight Estimation To obtain an unbiased estimate of p , we maximize the Shannon entropy using the principle of maximum entropy Jaynes (1957) , selecting the distribution with the highest entropy among those consistent with observed human preferences. \max_{p}H(p)=-\sum_{i=1}^{n}p_{i}\log p_{i} (4) This objective is optimized subject to constraints derived from observed human comparisons. Details of the optimization procedure are provided in Appendix A.5

Read the complete text