RBCorr: Response Bias Correction in Language Models

Om Bhatt, Anna A. Ivanova · 2026

Read RBCorr: Response Bias Correction in Language Models by Om Bhatt, Anna A. Ivanova (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2602-12445.txt.

Description

Language models show response biases, favouring certain options in fixed-response questions regardless of content, which skews evaluations of their true abilities. Om Bhatt led this work with one co-author, Anna A. Ivanova, proposing RBCorr, a simple, low-cost correction strategy. Tests cover 12 open-weight models on yes-no, entailment, and multiple-choice questions.

Response bias proves prevalent before correction, and RBCorr effectively eliminates bias while boosting performance. The team also probes how bias behaviour generalises across models, data sets, and prompt formats, finding that LogProbs-based correction depends heavily on all three. Overall, RBCorr is easy to use, lifts smaller models in particular, and brings closed-response benchmark scores closer to true capabilities.

Catalog record

CREATOROm Bhatt, Anna A. Ivanova
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE32 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2602-12445

Browse the full library · About the Tower of Babel