More Bias, Less Bias: BiasPrompting for Enhanced Multiple-Choice Question Answering DOI: XXXXXXX.XXXXXXX Conference: The 41st ACM/SIGAPP Symposium on Applied Computing; March 23–27, 2026; Thessaloniki, Greece ISBN: 979-X-XXXX-XXXX-X/26/03 CCS: Computing methodologies Natural language processing CCS:

Duc Anh Vu, Nguyen Thanh Thong, Cong-Duy Nguyen, Viet Anh Nguyen, Anh Tuan Luu · 2025

Read More Bias, Less Bias: BiasPrompting for Enhanced Multiple-Choice Question Answering DOI: XXXXXXX.XXXXXXX Conference: The 41st ACM/SIGAPP Symposium on Applied Computing; March 23–27, 2026; Thessaloniki, Greece ISBN: 979-X-XXXX-XXXX-X/26/03 CCS: Computing methodologies Natural language processing CCS: by Duc Anh Vu, Nguyen Thanh Thong, Cong-Duy Nguyen, Viet Anh Nguyen, Anh Tuan Luu (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2511-20086.txt.

Introduction

Vu, Thong, Nguyen, Nguyen, and Luu fight bias in AI multiple-choice answers by adding more of it. Their 2025 paper introduces BiasPrompting for language models. Models often pick answers with little real reasoning. Bare options invite shallow guesses and ordering biases. Context-free choices leave plausible answers unexplored.

BiasPrompting first makes the model argue for every option. A supportive reasoning is generated for each candidate answer. Then a second stage weighs those arguments together. The model selects the answer whose case survives scrutiny. Five standard question-answering benchmarks tested the framework. Accuracy improved significantly across the board. Ordering effects shrank compared with plain prompting. Performance held steadier across repeated runs as well. Hard questions, where rivals falter, gained the most. Experiments used seven-billion-parameter models like Mistral and Gemma. Compute costs stayed below heavier self-consistency schemes. Larger models remain untested.

Catalog record

CREATORDuc Anh Vu, Nguyen Thanh Thong, Cong-Duy Nguyen, Viet Anh Nguyen, Anh Tuan Luu
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE23 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2511-20086

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

More Bias, Less Bias: BiasPrompting for Enhanced Multiple-Choice Question Answering DOI: XXXXXXX.XXXXXXX Conference: The 41st ACM/SIGAPP Symposium on Applied Computing; March 23–27, 2026; Thessaloniki, Greece ISBN: 979-X-XXXX-XXXX-X/26/03 CCS: Computing methodologies Natural language processing CCS: Computing methodologies Artificial intelligence CCS: Computing methodologies Machine learning algorithms Duc Anh Vu, Nguyen Thanh Thong, Cong-Duy Nguyen, Viet Anh Nguyen, Anh Tuan Luu Abstract . With the advancement of large language models (LLMs), their performance on multiple-choice question (MCQ) tasks has improved significantly. However, existing approaches face key limitations: answer choices are typically presented to LLMs without contextual grounding or explanation. This absence of context can lead to incomplete exploration of all possible answers, ultimately degrading the models’ reasoning capabilities. To address these challenges, we introduce BiasPrompting, a novel inference framework that guides LLMs to generate and critically evaluate reasoning across all plausible answer options before reaching a final prediction. It consists of two components: first, a reasoning generation stage, where the model is prompted to produce supportive reasonings for each answer option, and then, a reasoning-guided agreement stage, where the generated reasonings are synthesized to select the most plausible answer. Through comprehensive evaluations, BiasPrompting demonstrates significant improvements in five widely used multiple-choice question answering benchmarks. Our experiments showcase that BiasPrompting enhances the reasoning capabilities of LLMs and provides a strong foundation for tackling challenging questions, particularly in settings where existing methods underperform. 1. Introduction Large language models (LLMs) have significantly advanced state-of-the-art in natural language processing (NLP) 41 ; 9 ; 1 , excelling in tasks such as natural language understanding 3 ; 8 ; 50 ; 49 , text generation 53 ; 34 , multimodal 20 ; 28 ; 29 ; 30 ; 33 and reasoning 17 ; 37 . Prompt optimization has become crucial for enhancing the performance of LLMs. However, despite their capabilities, LLMs remain sensitive to input design, particularly in multiple-choice question (MCQ) settings, where they often exhibit limited instruction-following ability and shallow task understanding 13 ; 31 ; 32 ; 35 . First, recent studies have shown that large language models are sensitive to the way input is structured, where a minor adjustment to the prompt may lead to an improvement or decline in performance. When provided with minimal context, such as only the answer choices without additional context, LLMs can exhibit intrinsic bias 55 ; 23 , selection bias 56 or lack of task understanding 13 . Second, while many prompting strategies achieve remarkable performance, they bring additional computational burden of model inference. Prior approaches such as Chain-of-Thought (CoT) prompting 47 , Self-Refine 26 and Self-Consistency 45 not only involve extensive token generation but also introduce challenges such as misinterpretation of intermediate steps and reduced interpretability 52 . In-context learning (ICL) 4 ; 54 ; 43 conditions the model on a long sequence of input-output demonstrations provided in the prompt. Furthermore, multi-agent frameworks 6 ; 19 ; 51 force LLMs to engage in multiple rounds of reasoning and coordination among agents before reaching a consensus. This process significantly increases computational costs, making such methods less efficient. Figure 1. Illustration of BiasPrompting with two steps of Reasoning Generation and Reasonings-Guided Agreement. To address these challenges, we propose BiasPrompting, a lightweight yet effective prompting framework that enhances LLM reasoning in MCQ answering. BiasPrompting encourages the model to bias toward each possible candidate, enabling it to generate rich contextual reasoning for each option before achieving a final consensus. This structured evaluation ensures a deeper exploration of all options, mitigating model biases and improving decision-making. In addition, unlike existing methods that rely on complex multi-agent frameworks or extensive token generation, BiasPrompting can operate sequentially within a single LLM, making it computationally efficient. Our results demonstrate significant performance gains compared to prior inference methods. Moreover, BiasPrompting uncovers latent reasoning capabilities by successfully addressing questions that other methods underperform. 2. BiasPrompting BiasPrompting is motivated by the observation that in many multiple-choice question (MCQ) tasks, LLMs struggle to retrieve relevant facts when provided only with answer options. Formally, let an MCQ task be defined by a tuple (Q,A,y^{*}) , where Q is the question given in a natural language, A=\{A_{1},A_{2},\dots,A_{n}\} is a set of n answer options and y^{*}\in A is the ground-truth correct answer. Let p_{\theta} denote a pre-trained large language model (LLM) with parameters \theta , where p_{\theta}(y\mid Q,A,\textit{prompt}) models the distribution over generated outputs conditioned on a question Q , candidate answers A , and a prompt design. Traditional prompting methods directly predict the sequence [z_{0},\ldots,z_{m},y] , where z_{0},\ldots,z_{m} are optional intermediate reasoning steps (enabled by certain prompting frameworks), and y is the final predicted answer. This sequence is modeled as: \left[z_{0},\ldots,z_{m},y\right]=p_{\theta}(z_{0},\ldots,z_{m},y\mid Q,A,\textit{prompt}). As illustrated in Figure 1 , given the question: "Where would you find magazines along side many other printed works?" , LLMs are given a limited set of answer options, each consisting of only a few words. Due to this constraint, the model often generates reasoning for its chosen option only, ignoring underexplored alternatives. In this example, the model selects "doctor" as the answer, failing to consider other options meaningfully. BiasPrompting first prompts the LLM to generate supporting reasoning for each answer option (e.g., "doctor", "bookstore", "market", "train station", "mortuary" ), treating each as if it were correct . This encourages the model to retrieve a broad range of relevant information before selecting an answer. By embedding controlled biases into the prompt, we hypothesize this method reduces the LLM’s tendency to favor specific options. BiasPrompting involves two key steps: 2.1. Reasoning Generation Given an MCQ task with question Q and answer options A , BiasPrompting first prompts the LLM to generate a reasoning R_{i} for each answer option A_{i} , where i=1,2,\dots,n . Unlike prior methods that directly evaluate the correctness of each option, BiasPrompting instructs the model to produce reasoning that supports A_{i} as if it were the correct answer, regardless of its actual validity. This process is formalized as: R_{i}\sim p_{\theta}(R_{i}\mid Q,A_{i},\textit{prompt}_{\text{RG}}) , where \textit{prompt}_{\text{RG}} is a prompt designed to generate reasoning that supports A_{i} . This structured approach ensures that the model explores all answer options exhaustively, preventing premature dismissal of alternatives. Even if some generated reasonings are incorrect, this step enriches the model’s understanding of the context and improves the robustness of the final prediction. The template of \textit{prompt}_{\text{RG}} is provided in Table 4 . Mode CommonsenseQA StrategyQA PIQA Date Understanding Causal Judgement Mistral Zero-shot 65.1 63.8 75.1 35.6 53.5 Chain-of-Thought 67.1 (+2.0%) 52.8 (-11.0%) 70.5 (-4.6%) 32.0 (-3.6%) 54.6 (+1.1%) BiasPrompting 66.0 (+0.9%) 67.7 (+3.9%) 74.2 (-0.9%) 40.0 (+4.4%) 62.6 (+9.1%) Deepseek Zero-shot 50.1 57.1 64.8 37.6 53.5 Chain-of-Thought 49.3 (-0.8%) 52.7 (-4.4%) 63.8 (-1.1%) 36.4 (-1.2%) 49.7 (-3.8%) BiasPrompting 48.5 (-1.6%) 57.5 (+0.4%) 64.9 (+0.1%) 40.0 (+2.4%) 55.6 (+2.1%) Gemma Zero-shot 27.0 48.5 48.9 20.0 51.9 Chain-of-Thought 38.0 (+11.0%) 44.4 (-4.1%) 51.0 (+2.1%) 27.6 (+7.6%) 38.0 (-13.9%) BiasPrompting 38.7 (+11.7%) 49.1 (+0.6%) 54.2 (+5.3%) 23.2 (+3.2%) 51.9 (-0.0%) Table 1. Performance comparison across datasets and models with greedy decoding. Note that there can be an error of 0.1 due to rounding. 2.2. Reasonings-Guided Agreement After generating reasonings R=\{R_{1},R_{2},\dots,R_{n}\} for all answer options, BiasPrompting constructs a final prompt that integrates the original question Q , the answer options A , and the generated reasonings

Read the complete text