Making Bias Non-Predictive: Training Robust LLM Judges via Reinforcement Learning
Qian Wang, Xuandong Zhao, Zirui Zhang, Zhanzhi Lou, Nuo Chen, Dawn Song, Bingsheng He · 2026
Read Making Bias Non-Predictive: Training Robust LLM Judges via Reinforcement Learning by Qian Wang, Xuandong Zhao, Zirui Zhang, Zhanzhi Lou, Nuo Chen, Dawn Song, Bingsheng He (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-01528.txt.
Description
Qian Wang and co-authors propose Epistemic Independence Training, making bias cues non-predictive of reward. LLM judges still shift under spurious cues. Prompting and fine-tuning fail, changing surface conduct, not the objective. EIT balances so bias signals support right and wrong answers equally, penalizing following without rewarding agreement. Qwen tests show better accuracy and robustness under adversarial biases, kept when bias is true. Bandwagon-only training generalizes to authority. EIT generalizes across benchmarks, families, and scales, beating shift methods label-free.
Catalog record
| CREATOR | Qian Wang, Xuandong Zhao, Zirui Zhang, Zhanzhi Lou, Nuo Chen, Dawn Song, Bingsheng He |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 75399 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602.01528