Automated Concept Discovery for LLM-as-a-Judge Preference Analysis
James Wedgwood, Chhavi Yadav, & Virginia Smith · 2026
Read Automated Concept Discovery for LLM-as-a-Judge Preference Analysis by James Wedgwood, Chhavi Yadav, & Virginia Smith (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2603-03319.txt.
Description
James Wedgwood, Chhavi Yadav, and Virginia Smith ask what large language model judges secretly prefer. Models increasingly grade other models' answers, but their choices carry systematic biases that can drift away from human judgment. Earlier studies mostly checked a short, hand-picked list of suspected biases. Their 2026 paper instead discovers the drivers automatically, with no fixed list in advance.
Several concept extraction methods compete on clarity and prediction, and sparse autoencoders win on clarity while staying competitive. Applied to more than twenty-seven thousand paired answers judged by three models, the method confirms known habits, like refusing sensitive requests more often than humans. It also finds new ones, favoring concrete, empathetic, detailed, and formal replies in some fields, and disfavoring legal advice that urges active steps.
Catalog record
| CREATOR | James Wedgwood, Chhavi Yadav, & Virginia Smith |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 30911 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2603.03319