Making Bias Non-Predictive: Training Robust LLM Judges via Reinforcement Learning

Qian Wang, Xuandong Zhao, Zirui Zhang, Zhanzhi Lou, Nuo Chen, Dawn Song, Bingsheng He · 2026

Read Making Bias Non-Predictive: Training Robust LLM Judges via Reinforcement Learning by Qian Wang, Xuandong Zhao, Zirui Zhang, Zhanzhi Lou, Nuo Chen, Dawn Song, Bingsheng He (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01528.txt.

Description

Qian Wang and co-authors propose Epistemic Independence Training, making bias cues non-predictive of reward. LLM judges still shift under spurious cues. Prompting and fine-tuning fail, changing surface conduct, not the objective. EIT balances so bias signals support right and wrong answers equally, penalizing following without rewarding agreement. Qwen tests show better accuracy and robustness under adversarial biases, kept when bias is true. Bandwagon-only training generalizes to authority. EIT generalizes across benchmarks, families, and scales, beating shift methods label-free.

Catalog record

CREATORQian Wang, Xuandong Zhao, Zirui Zhang, Zhanzhi Lou, Nuo Chen, Dawn Song, Bingsheng He
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE75399
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602.01528

Browse the full library · About the Tower of Babel