Improve LLM-as-a-Judge Ability as a General Ability
Jiachen Yu, Shaoning Sun, Xiaohui Hu, Jiaxu Yan, Kaidong Yu, Xuelong Li · 2025
Read Improve LLM-as-a-Judge Ability as a General Ability by Jiachen Yu, Shaoning Sun, Xiaohui Hu, Jiaxu Yan, Kaidong Yu, Xuelong Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2502-11689.txt.
Description
Jiachen Yu and co-authors train language models to judge other models, and find the skill lifts general ability in a 2025 paper. Judge models supply the preference signals that align chatbots with human values. Prior judge training ate data and taught judging narrowly.
A two-stage recipe warms up with supervised examples, then sharpens with preference optimization on synthetic judgments. With a fraction of rival data budgets, their judge topped a standard leaderboard. Remarkably, the same training improved the models broader skills, and its verdicts boosted downstream alignment training. Judging, reframed, is a general workout for a model.
Catalog record
| CREATOR | Jiachen Yu, Shaoning Sun, Xiaohui Hu, Jiaxu Yan, Kaidong Yu, Xuelong Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 57 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2502-11689