Judging Against the Reference: Uncovering Knowledge-Driven Failures in LLM-Judges on QA Evaluation

Dongryeol Lee, Yerin Hwang, Taegwan Kang, Minwoo Lee, Younhyung Chae, Kyomin Jung · 2026

Read Judging Against the Reference: Uncovering Knowledge-Driven Failures in LLM-Judges on QA Evaluation by Dongryeol Lee, Yerin Hwang, Taegwan Kang, Minwoo Lee, Younhyung Chae, Kyomin Jung (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-07506.txt.

Description

Dongryeol Lee and colleagues probe a weak spot in using language models as graders. Many teams now let an LLM judge answers to questions against a given reference. Lee's team asks whether judges actually follow that reference. Their 2026 preprint reports a critical failure mode in reference-based evaluation.

When the reference conflicts with what the judge model already believes, scores turn unreliable. The model leans on its own stored knowledge instead of the text it was given. That drift substantially lowers evaluation fidelity, the authors report. The finding matters wherever LLM judges score question answering at scale. It warns builders to test judges against references that deliberately contradict common knowledge.

Catalog record

CREATORDongryeol Lee, Yerin Hwang, Taegwan Kang, Minwoo Lee, Younhyung Chae, Kyomin Jung
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE68 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-07506

Browse the full library · About the Tower of Babel