BiasScope: Towards Automated Detection of Bias in LLM-as-a-Judge Evaluation

Peng Lai, Zhihao Ou, Yong Wang, Longyue Wang, Jian Yang, Yun Chen, Guanhua Chen · 2026

Read BiasScope: Towards Automated Detection of Bias in LLM-as-a-Judge Evaluation by Peng Lai, Zhihao Ou, Yong Wang, Longyue Wang, Jian Yang, Yun Chen, Guanhua Chen (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-09383.txt.

Introduction

Using language models as judges of other models is now widespread, but judging itself can be biased, and known-bias checklists miss biases nobody has named yet. Peng Lai and six co-authors propose BiasScope, a 2026 framework that hunts for evaluation biases automatically and at scale, turning bias discovery from passive manual checking into active exploration. The system is driven by language models and works across model families and sizes.

Validated on the JudgeBench evaluation set, BiasScope uncovers potential biases that predefined lists would miss. Building on it, the authors release JudgeBench-Pro, a harder benchmark for judge robustness. Strikingly, even powerful evaluator models err on more than half the items there. The paper argues that judge-based evaluation needs systematic bias hunting, not just spot checks, before its verdicts can be trusted.

Catalog record

CREATORPeng Lai, Zhihao Ou, Yong Wang, Longyue Wang, Jian Yang, Yun Chen, Guanhua Chen
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE95 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-09383

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

BiasScope: Towards Automated Detection of Bias in LLM-as-a-Judge Evaluation Peng Lai, Zhihao Ou, Yong Wang, Longyue Wang, Jian Yang, Yun Chen, Guanhua Chen Abstract LLM-as-a-Judge has been widely adopted across various research and practical applications, yet the robustness and reliability of its evaluation remain a critical issue. A core challenge it faces is bias, which has primarily been studied in terms of known biases and their impact on evaluation outcomes, while automated and systematic exploration of potential unknown biases is still lacking. Nevertheless, such exploration is crucial for enhancing the robustness and reliability of evaluations. To bridge this gap, we propose BiasScope , a LLM-driven framework for automatically and at scale discovering potential biases that may arise during model evaluation. BiasScope can uncover potential biases across different model families and scales, with its generality and effectiveness validated on the JudgeBench dataset. It overcomes the limitations of existing approaches, transforming bias discovery from a passive process relying on manual effort and predefined bias lists into an active and comprehensive automated exploration. Moreover, based on BiasScope , we propose JudgeBench-Pro, an extended version of JudgeBench and a more challenging benchmark for evaluating the robustness of LLM-as-a-judge. Strikingly, even powerful LLMs as evaluators show error rates above 50% on JudgeBench-Pro, underscoring the urgent need to strengthen evaluation robustness and to mitigate potential biases further. Code JudgeBench-Pro 1 Introduction With the optimization of algorithms and model architectures, the field of AI has gradually entered the second phase—the era of evaluation ( 8 ) . Model improvement no longer relies solely on training; rather, it increasingly depends on practical evaluation to uncover potential shortcomings and guide further enhancement ( 10 ) . LLM-as-a-Judge ( 38 ) , as a promising new paradigm, offers advantages over traditional methods by leveraging the large language model (LLM) as a “judge” to evaluate model outputs at scale in diverse and dynamic settings with automation and consistency ( 31 ; 15 ) . Moreover, LLM-as-a-Judge has now been extensively adopted across a wide range of research and application domains, including benchmark construction ( 14 ; 29 ) , data curation ( 32 ; 5 ) , and model performance evaluation ( 38 ; 17 ) . Consequently, given its widespread adoption, ensuring the reliability and robustness of LLM-as-a-judge has become a critical challenge that urgently needs to be addressed. The core challenge faced by LLM-as-a-judge primarily stems from bias ( 4 ) . Bias refers to the systematic, non-random tendencies exhibited by a Judge LLM during answer evaluation, which can lead its assessments to deviate from objective and equitable standards, thereby affecting the robustness and reliability of the evaluation ( 30 ) . Early studies primarily focused on verifying whether LLMs maintain robustness when affected by biases, or on mitigating the impacts of such biases, with common types including gender bias ( 24 ) , length bias ( 35 ) , self-bias ( 33 ) , position bias ( 18 ) , and so on. Meanwhile, related work (e.g., CALM ( 35 ) ) has attempted to construct benchmarks using known biases to quantify the extent of bias exhibited by LLM-as-a-judge. However, these studies are primarily limited to verifying and analyzing known biases, lacking systematic exploration of potential or unidentified biases, which may have a more significant impact on the reliability of LLM-as-a-Judge and the fairness of its assessment outcomes. Identifying such potential biases manually is challenging to scale, which naturally raises the question: how can potential biases be discovered in an automated and large-scale manner? To address this question, we propose BiasScope , a framework that iteratively and automatically discovers potential diversity biases in the LLM evaluation process. BiasScope consists of two phases: (1) Bias Discovery, a teacher model is leveraged to inject basic biases into the target dataset to trigger and identify potential biases in the target model; (2) Bias Validation, the effectiveness of candidate biases in perturbing the target model is assessed on a test dataset, and the biases confirmed to be effective are then integrated into the basic bias library. This process is then iterated to obtain more diverse and effective biases in target models continuously. We conduct reliability validation of BiasScope , confirming that its observed effects are not caused by perturbations that increase response length or modify answers, and we find that incorporating preference data synthesized from the discovered biases into DPO ( 26 ) training further mitigates the biases exhibited by the model during evaluation. Moreover, building upon JudgeBench ( 29 ) , we use BiasScope to construct a more challenging benchmark, JudgeBench-Pro, designed to evaluate the assessment capabilities and robustness of LLM-as-a-judge. This Benchmark was carefully curated through verification by powerful LLMs and rigorous manual review. The evaluation results show that, among the five mainstream powerful models, four performed at or below the level of random guessing, with an average error rate 25.9% higher than on JudgeBench. These findings indicate that ensuring the robustness of current LLM-as-a-Judge remains challenging. To summarize, our main contributions are as follows: \triangleright We propose BiasScope , a framework entirely driven by large language models that can automatically and at scale discover potential biases that may arise during model evaluation. \triangleright BiasScope can mine potential biases in models across different families and scales, and its generality and effectiveness are validated on the objective and reliable JudgeBench dataset. \triangleright Leveraging our framework BiasScope , we developed JudgeBench-Pro, a more challenging benchmark for evaluating the robustness of LLMs as judges, extending the original JudgeBench. 2 BiasScope To systematically uncover potential biases in the target model, we propose BiasScope , an iterative framework (Figure 1 ). The detailed pseudocode is provided in Algorithm 1 . BiasScope leverages random bias perturbations combined with the target model’s misjudgment self-explanations to induce the model to expose more diverse potential biases, which are then analyzed and identified using a teacher model (§ 2.2 ). These biases are subsequently compared against a known bias library and validated through perturbation tests, retaining only those that are both novel and genuinely reflected in the model’s behavior, thereby enabling the bias space to self-expand and self-converge (§ 2.3 ). 2.1 General Problem Formulation of Automatic Bias Discovery In this section, we formalize the problem of automatic bias discovery in the LLM-as-a-judge paradigm. Figure 1: The Overview of BiasScope . In the Bias Discovery phase ( Left ), we evaluate the target model on the target dataset perturbed by known biases to expose further potential biases, which are then discovered by a teacher model. In the Bias Validation phase ( Right ), we introduce a test dataset to examine the effectiveness of the discovered biases. Based on the evaluation results, valid biases are retained and incorporated into the basic bias library to support subsequent iterations. Following previous work ( 29 ; 35 ) , we adopt the pair-wise evaluation approach to identify the potential biases of LLM-as-a-Judge better and reduce confounding effects. Let \mathcal{D}=\{(x_{i},y_{i}^{c},y_{i}^{r})\}_{i=1}^{N} denote a target preference dataset, where x_{i} is the input instruction, y_{i}^{c} is the chosen response, and y_{i}^{r} is the rejected response. We denote the target model as M , which is the model whose potential biases we aim to analyze. Let \mathcal{B}_{0}=\{b_{1},b_{2},\dots,b_{K}\} denote the

Read the complete text