RBCorr: Response Bias Correction in Language Models
Om Bhatt, Anna A. Ivanova · 2026
Read RBCorr: Response Bias Correction in Language Models by Om Bhatt, Anna A. Ivanova (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-12445.txt.
Description
Language models show response biases, favouring certain options in fixed-response questions regardless of content, which skews evaluations of their true abilities. Om Bhatt led this work with one co-author, Anna A. Ivanova, proposing RBCorr, a simple, low-cost correction strategy. Tests cover 12 open-weight models on yes-no, entailment, and multiple-choice questions.
Response bias proves prevalent before correction, and RBCorr effectively eliminates bias while boosting performance. The team also probes how bias behaviour generalises across models, data sets, and prompt formats, finding that LogProbs-based correction depends heavily on all three. Overall, RBCorr is easy to use, lifts smaller models in particular, and brings closed-response benchmark scores closer to true capabilities.
Catalog record
| CREATOR | Om Bhatt, Anna A. Ivanova |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 32 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2602-12445