B-score: Detecting biases in large language models using response history

An Vo, Mohammad Reza Taesiri, Daeyoung Kim, Anh Totti Nguyen · 2025

Read B-score: Detecting biases in large language models using response history by An Vo, Mohammad Reza Taesiri, Daeyoung Kim, Anh Totti Nguyen (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-18545.txt.

Introduction

Language models favor women less, or the number seven more, and their biases hide inside single answers. An Vo and three co-authors ask in 2025 whether a model shown its own earlier answers to the same question can correct itself, testing nine topics across subjective, random, and objective questions. For random questions, where bias has nowhere to hide, self observation works.

Their B-score turns the trick into a detector, reading a model's answer history to flag biased or shaky replies. On three standard benchmarks the score improved which answers get accepted far beyond confidence words or vote counting. The authors release code and data with the work. A model's past answers, they show, testify about its present ones.

Catalog record

CREATORAn Vo, Mohammad Reza Taesiri, Daeyoung Kim, Anh Totti Nguyen
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE76 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2505-18545

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

B-score: Detecting biases in large language models using response history An Vo, Mohammad Reza Taesiri, Daeyoung Kim, Anh Totti Nguyen Abstract Large language models (LLMs) often exhibit strong biases, e.g., against women or in favor of the number 7. We investigate whether LLMs would be able to output less biased answers when allowed to observe their prior answers to the same question in a multi-turn conversation. To understand which types of questions invite more biased answers, we test LLMs on our proposed set of questions that span 9 topics and belong to three types: (1) Subjective; (2) Random; and (3) Objective. Interestingly, LLMs are able to “de-bias” themselves in a multi-turn conversation in response to questions that seek an Random, unbiased answer. Furthermore, we propose B-score, a novel metric that is effective in detecting biases to Subjective, Random, Easy, and Hard questions. On MMLU, HLE, and CSQA, leveraging B-score substantially improves the verification accuracy of LLM answers (i.e., accepting LLM correct answers and rejecting incorrect ones) compared to using verbalized confidence scores or the frequency of single -turn answers alone. Code and data are available at: b-score.github.io . † † affiliationnotice: Equal contribution 1 Introduction (a) B-score indicates is biased towards option 7 and 4 . (b) Three single -turn convos (c) A multi -turn convo Figure 1 : When asked to output a random number, GPT- 4o often answers 7 (b), 70% of the time (a). In contrast, in multi -turn conversations where the LLM observes its past answers to the same question, it is able to de-bias itself, choosing the next numbers such that all numbers in history form nearly a uniform distribution (b) at \sim 10% chance (a). LLMs can be notoriously biased towards a gender, race, profession, number, name, or even a birth year ( Zhang et al., 2024 ; Sheng et al., 2019b ) . These biases are often identified by repeatedly asking LLMs the same question (where there are \geq 2 correct answers) and checking if one answer appears much more frequently than others. An LLM is considered biased if one answer appears more often than the others in such single -turn conversations ( Fig. 1 b). We find that biased responses can appear at different temperatures ( Sec. B.1 ), but most frequently at temp=0. Such biased responses could exist because LLMs are asked “only once” and the same highest-probability answer appears again in the next single -turn conversation due to greedy decoding ( Fig. 1 b). Therefore, we ask: Would an LLM be able to de-bias itself if it is allowed to observe its prior responses to the same question? Interestingly, the answer is: Yes. For example, instead of 70% of the time choosing the number 7 , GPT- 4o would output every number from 0 to 9 at a near-random chance in multi -turn conversations ( Fig. 1 c). Figure 2 : GPT- 4o ’s single -turn and multi -turn response probabilities for the politics topic ( Trump vs. Biden ) across 10 runs under four categories. In the single -turn setting P(single) , the model shows a similarly skewed distribution for the Subjective and Random questions (favoring Biden ). However, in the multi -turn setting, chooses random answers in Random ( P(multi) \approx 0.5) while still favoring Biden in Subjective ( P(multi) \approx 1.0). The distribution of Easy questions remains identical (correct answers dominating) across both settings. In contrast, Hard question exhibits a wider spread and different behavior between settings. In the multi -turn setting, returns a consistent preference in Subjective , random answers in Random , consistently correct answers to Easy questions, and variable answers to Hard questions. We conjecture that there may be multiple types of biases in LLMs (1) bias due to actual preferences; (2) consistently selecting the wrong answer because the question is too hard; and (3) bias learned from imbalanced training data. Yet, most prior research focused on the third type ( Sheng et al., 2019b ) . Here, we propose a novel test framework where we ask LLMs the same set of questions across 9 topics but in 4 different wordings that ask for (1) a subjective opinion ; (2) a random choice ; (3) an objective answer to an easy question ; (4) an answer to a hard question ( Fig. 2 ). Leveraging the insight that LLMs can become substantially less biased given their response history, we propose B-score , a metric that identifies biased answers without requiring access to groundtruth labels. B-score is computed for each answer a returned by an LLM and is the \Delta between the probability that a appears in single-turn runs vs. that in multi-turn runs. The main findings from our experiments across 8 LLMs— GPT- 4o ( ), GPT- 4o -mini ( ), Gemini- 1.5 -Pro ( ), Gemini- 1.5 -Flash ( ), Llama-3.1 ( and ), Command R ( ), and Command R+ ( + )—are: 1. Across all 4 question categories, biases may diminish in multi -turn settings, i.e. some common LLM biases can be mitigated with response history ( Sec. 5.1 ). 2. The B-score effectively captures bias in model responses, providing a metric that can help the user understand and detect biases that appear in single -turn questions ( Secs. 5.1 and 5.2 ). 3. Verbalized confidence scores generated by LLMs are not as good an indicator for bias as our B-score ( Sec. 5.3 ). 4. Using B-score as an extra indicator for whether an LLM is being biased to decide to accept or reject an LLM decision results in substantially higher answer-verification accuracy, by +9.3 on our proposed questions and +2.9 on common benchmarks (MMLU, HLE and CSQA) ( Sec. 5.4 ). 2 Related work LLM bias in text generation Early transformer-based LLMs (e.g., GPT-2 Radford et al. (2019) ) have been shown to exhibit biases (i.e. reflecting societal stereotypes) inherited from their training corpora ( Sheng et al., 2019a ) . Subsequent studies have documented biases in numerous dimensions, including demographic biases (e.g. gender, race, religion, culture, etc.) ( Brown et al., 2020 ; Abid et al., 2021 ; Zhao et al., 2023 ; Kumar et al., 2024 ; Shin et al., 2024 ) , political biases ( Bang et al., 2024 ; Potter et al., 2024 ) , geographical biases ( Manvi et al., 2024 ) , cognitive biases ( Echterhoff et al., 2024 ; Koo et al., 2024 ) , ableist biases ( Wu & Ebling, 2024 ; Li et al., 2024 ) , etc. Recently, Zhang et al. (2024) demonstrated that LLMs often favor specific options, even when asking LLMs multiple times with explicitly random prompts (e.g. “Randomly pick a prime number between 1 and 50”). Our work differs from these prior studies in two main aspects: (1) we investigate biases through a novel bias evaluation framework of four question categories—subjective, random, easy, and hard (see Fig. 2 ), whereas previous works primarily focus on biases stemming from imbalanced training data; and (2) we propose B-score, a novel metric for users to detect biased answers at runtime. Multi-turn conversation for self-correction Most existing studies rely on single -turn conversations, where the model is queried once per

Read the complete text