Improve LLM-as-a-Judge Ability as a General Ability

Jiachen Yu, Shaoning Sun, Xiaohui Hu, Jiaxu Yan, Kaidong Yu, Xuelong Li · 2025

Read Improve LLM-as-a-Judge Ability as a General Ability by Jiachen Yu, Shaoning Sun, Xiaohui Hu, Jiaxu Yan, Kaidong Yu, Xuelong Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-11689.txt.

Description

Jiachen Yu and co-authors train language models to judge other models, and find the skill lifts general ability in a 2025 paper. Judge models supply the preference signals that align chatbots with human values. Prior judge training ate data and taught judging narrowly.

A two-stage recipe warms up with supervised examples, then sharpens with preference optimization on synthetic judgments. With a fraction of rival data budgets, their judge topped a standard leaderboard. Remarkably, the same training improved the models broader skills, and its verdicts boosted downstream alignment training. Judging, reframed, is a general workout for a model.

Catalog record

CREATORJiachen Yu, Shaoning Sun, Xiaohui Hu, Jiaxu Yan, Kaidong Yu, Xuelong Li
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE57 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2502-11689

Browse the full library · About the Tower of Babel