Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Models
Shuliang Liu, Xinze Li, Zhenghao Liu, Yukun Yan, Cheng Yang, Zheni Zeng, Zhiyuan Liu, Maosong Sun, Ge Yu · 2025
Read Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Models by Shuliang Liu, Xinze Li, Zhenghao Liu, Yukun Yan, Cheng Yang, Zheni Zeng, Zhiyuan Liu, Maosong Sun, Ge Yu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-18817.txt.
Introduction
Shuliang Liu and eight co-authors judge the judges of retrieval systems in twenty twenty-five. Retrieval-augmented generation cuts hallucination, but scoring its outputs is hard. Automated metrics fall short, so language models are used as judges. Those judges are prompt-sensitive, and their verdicts wobble between runs.
Their method, ConsJudge, turns that wobble into a signal. The model generates judgments under many combinations of judgment dimensions. Judge-consistency then scores which judgments hold together. Accepted and rejected judgments are selected on that basis. The surviving judgments train the judge to be steadier. Readers who evaluate retrieval systems get a way to make model judges grade more accurately and more consistently.
Catalog record
| CREATOR | Shuliang Liu, Xinze Li, Zhenghao Liu, Yukun Yan, Cheng Yang, Zheni Zeng, Zhiyuan Liu, Maosong Sun, Ge Yu |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-18817
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Models Shuliang Liu, Xinze Li, Zhenghao Liu, Yukun Yan, Cheng Yang, Zheni Zeng, Zhiyuan Liu, Maosong Sun, Ge Yu Abstract Retrieval-Augmented Generation (RAG) has proven its effectiveness in alleviating hallucinations for Large Language Models (LLMs). However, existing automated evaluation metrics cannot fairly evaluate the outputs generated by RAG models during training and evaluation. LLM-based judgment models provide the potential to produce high-quality judgments, but they are highly sensitive to evaluation prompts, leading to inconsistencies when judging the output of RAG models. This paper introduces the Judge-Consistency (ConsJudge) method, which aims to enhance LLMs to generate more accurate evaluations for RAG models. Specifically, ConsJudge prompts LLMs to generate different judgments based on various combinations of judgment dimensions, utilize the judge-consistency to evaluate these judgments and select the accepted and rejected judgments for DPO training. Our experiments show that ConsJudge can effectively provide more accurate judgments for optimizing RAG models across various RAG models and datasets. Further analysis reveals that judgments generated by ConsJudge have a high agreement with the superior LLM. All codes are available at https://github.com/OpenBMB/ConsJudge . 1 Introduction Retrieval-Augmented Generation (RAG) Guu et al. (2020) ; Lewis et al. (2020) ; Asai et al. (2023) ; Shi et al. (2023) has proven effective in mitigating hallucinations Elazar et al. (2021) ; Ji et al. (2023) ; Shuster et al. (2021) ; Huang et al. (2023) in Large Language Models (LLMs). RAG retrieves relevant knowledge from the knowledge base and incorporates the external information as the input context Ram et al. (2023) , benefiting various knowledge-intensive tasks Trivedi et al. (2023) ; Izacard et al. (2022) ; He et al. (2021) . Existing studies typically employ automated evaluation metrics to assess the outputs of RAG systems during both training Li et al. (2024b) and evaluation Lin et al. (2023) ; Gao et al. (2023b) phases. These metrics primarily focus on string-level exact matching, which is less effective for determining whether the LLM-generated responses align with the ground truth Gao et al. (2023a) ; Saad-Falcon et al. (2024) , posing a challenge for RAG systems. Figure 1: The Framework of ConsJudge. It enhances the judgment capabilities of LLMs and benefits the training process of RAG models. To enable more accurate evaluation of RAG models, some works incorporate LLMs as judgment models to assess the quality of generated responses Saad-Falcon et al. (2024) ; Friel et al. (2024) ; Adlakha et al. (2023) , relying on their human-equivalent evaluation capabilities Chiang and Lee (2023a) ; Zheng et al. (2023) ; Sottana et al. (2023) . These judgment models introduce specific evaluation dimensions, such as hallucination and comprehensiveness, to prompt LLMs to verify whether the generated responses align with the facts in the retrieved documents and whether all relevant information has been properly extracted and integrated Jin et al. (2024) ; Jacovi et al. (2025) ; Zhu et al. (2024) . However, LLM-based judgment models are highly sensitive to the design of evaluation prompts Zhou et al. (2023) ; Liu et al. (2024) , which may lead to inconsistencies in judgments when different evaluation dimensions are employed. In this paper, we introduce Judge-Consistency (ConsJudge), a method that enhances LLM-based judgment models to generate more accurate evaluations for RAG models in a self-improvement framework. ConsJudge incorporates specialized evaluation dimensions and employs a multiple-choice selection strategy for evaluation modeling. Additionally, ConsJudge leverages the Direct Preference Optimization (DPO) method Rafailov et al. (2023) to enhance the judgment capabilities of LLMs, while also implementing a “judge as a judge” mechanism during choosing preference pairs of judgments. Specifically, ConsJudge encourages LLMs to generate judgment results based on various combinations of judgment dimensions, evaluates the quality of these judgments using judge-consistency, and selects the chosen and rejected judgments for DPO training. This approach enhances the performance of the LLM-based judgment model without necessitating distillation from more powerful LLMs Zhang et al. (2025) . Our experiments demonstrate the effectiveness of the ConsJudge method as a reward model for optimizing the RAG model, resulting in significant improvements over vanilla LLMs. Further analysis shows that ConsJudge helps LLMs select appropriate evaluation dimensions for assessing response quality by incorporating the agreements and consistency across different evaluation dimensions during optimization. Additionally, compared to other baselines, ConsJudge exhibits higher judgment consistency with the superior LLM, GLM-4-plus Du et al. (2022) , across various RAG evaluation datasets, further highlighting its effectiveness in optimizing LLMs to produce more accurate judgments on diverse RAG tasks. 2 Related Work Retrieval-Augmented Generation (RAG) has proven its effectiveness in various tasks, such as open-domain question answering Trivedi et al. (2023) , dialogue systems Cai et al. (2019) , and code generation Li et al. (2025) . By integrating external knowledge into the input context Ram et al. (2023) , Large Language Models (LLMs) can alleviate hallucination issues and produce more accurate responses Asai et al. (2024) . To evaluate the performance of LLM responses, most existing RAG models rely on automatic metrics like Exact-Match during both evaluation Lin et al. (2023) ; Gao et al. (2023b) and training Li et al. (2024b) . However, these metrics may fail to offer a fair assessment when the LLM-generated responses are lengthy or semantically similar to the ground truth but not character-matched Gao et al. (2023a) . Recently, LLMs, such as ChatGPT OpenAI (2023) , have demonstrated human-equivalent performance Chiang and Lee (2023a) ; Zheng et al. (2023) ; Sottana et al. (2023) and are now commonly used as judgment models to assess generated responses in various tasks Chen et al. (2023a) ; Chen et al. (2023b) ; An et al. (2023) ; Chan et al. (2023) . These studies typically prompt LLMs to evaluate generated responses based on specific evaluation dimensions Chiang and Lee (2023b) . However, using APIs of these closed-source models incurs significant costs and reduces reproducibility, as the models may evolve behind the API Gu et al. (2024) . To address this, some researchers are turning to open-source LLMs as alternatives, using judgments from closed-source LLMs to fine-tune open-source models and improve their evaluation capabilities Wang et al. (2023b) ; Zheng et al. (2023) . Moreover, RAG models also employ LLMs as judges to assess the quality of generation, focusing on the relevance and faithfulness of the responses Saad-Falcon et al. (2024) ; Friel et al. (2024) ; Adlakha et al. (2023) . These models typically design prompts to instruct LLMs to determine whether the generated response aligns with the facts in the retrieved document and whether all relevant information has been fully extracted and integrated Jin et al. (2024) ; Jacovi et al. (2025) ; Zhu et al. (2024) . However, LLM-based evaluations are highly sensitive to prompt designs Zhou et al. (2023) ; Liu et al. (2024) , making the judgments inconsistent when using different dimensions for evaluating RAG responses. To mitigate this issue, ConsJudge introduces a judge-consistency approach to self-improve the judgment performance of LLMs in RAG systems, avoiding distillation from larger-scale LLMs Zhang et al. (2025) . 3 Methodology In this section, we introduce the Judge-Consistency (ConsJudge) method, which optimizes Large Language Models (LLMs) as judgment models to evaluate the