Self-Consistency Falls Short! The Adverse Effects of Positional Bias on Long-Context Problems

Adam Byerly, Daniel Khashabi · 2024

Read Self-Consistency Falls Short! The Adverse Effects of Positional Bias on Long-Context Problems by Adam Byerly, Daniel Khashabi (2024) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2411-01101.txt.

Description

A 2024 arXiv research paper by Adam Byerly, Daniel Khashabi. Self-consistency (SC) has been demonstrated to enhance the performance of large language models (LLMs) across various tasks and domains involving short content. However, does this evidence support its effectiveness for long-context problems? We challenge the assumption that SC’s benefits generalize to long-context settings, where LLMs often struggle with position bias–a systematic tendency to over-rely on specific context regions-which hinders their ability to utilize information effectively from all parts of their context.

Catalog record

CREATORAdam Byerly, Daniel Khashabi
YEAR2024
COLLECTIONPAPERS
FORMATTXT
FILE SIZE48 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2411-01101

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Self-Consistency Falls Short! The Adverse Effects of Positional Bias on Long-Context Problems Adam Byerly, Daniel Khashabi Abstract Self-consistency (SC) has been demonstrated to enhance the performance of large language models (LLMs) across various tasks and domains involving short content. However, does this evidence support its effectiveness for long-context problems? We challenge the assumption that SC’s benefits generalize to long-context settings, where LLMs often struggle with position bias–a systematic tendency to over-rely on specific context regions-which hinders their ability to utilize information effectively from all parts of their context. Through comprehensive experimentation with varying state-of-the-art models and tasks, we find that SC not only fails to improve but actively degrades performance on long-context tasks. This degradation appears driven by persistent position bias, worsening with longer context lengths and smaller model sizes, but invariant to prompt format or task type. Unlike short-context tasks, where SC diversifies reasoning paths, long-context SC amplifies positional errors. These comprehensive results provide valuable insight into the limitations of current LLMs in long-context understanding and highlight the need for more sophisticated approaches. Figure 1 : Schematic of self-consistency in long-context, “needle-in-a-haystack” scenarios. The input consists of a query and multiple evidence documents, one containing the correct answer. The model generates diverse intermediate answers via stochastic sampling (non-zero temperature). However, aggregation may yield incorrect answers due to position bias, highlighting a key challenge in long-context reasoning. Sampling from a model with inherent position bias can amplify rather than mitigate errors, as all samples inherit the same structural biases, violating SC’s core assumption of error independence. 1 Introduction Large Language Models (LLMs) have shown remarkable versatility in performing various tasks through prompting ( Brown et al. 2020 , inter alia) . However, these models exhibit various forms of brittleness across tasks ( Mishra et al. 2022 ; Frieder et al. 2024 ; Mirzadeh et al. 2024 ; Wu et al. 2024 ) , including catastrophic failures on simple problems easily solvable by humans ( Nezhurina et al. 2024 ) . To improve reliability, self-consistency (SC) ( Wang et al. 2022b ) has emerged as a powerful strategy that aggregates multiple sampled responses to mitigate failures. SC has been highly effective in short tasks (e.g., \leq 100 tokens), but its ability to handle long contexts (e.g., \geq 10K tokens) remains underexplored. As real-world applications increasingly demand processing lengthy inputs—such as legal analysis, medical diagnostics, or scientific literature review—understanding SC’s scalability is crucial for developing robust solutions. This prompts a critical question: does SC’s benefit scale with context length, or do longer contexts induce challenges that fundamentally alter their effectiveness? Fundamentally, SC assumes that errors in individual samples are independent and uncorrelated. When this holds, aggregating multiple responses cancels out noise and converges toward the correct answer. However, in long-context tasks, systemic position biases—where models over-rely on specific context regions—induce correlated errors , violating SC’s core assumption. While prior work ( Wang et al. 2023 ; Zheng et al. 2023 ; Liu et al. 2024 ) has documented position bias as a standalone challenge in long-context reasoning, our study reveals how these biases interact with self-consistency, compounding errors through correlated sampling rather than resolving them. We hypothesize that because SC aggregates multiple responses from the same biased model, it reinforces rather than corrects these correlated errors, ultimately amplifying position bias (Figure 1 ). To rigorously test this hypothesis and explore the broader implications of SC in long-context scenarios, we conduct extensive experiments across state-of-the-art models (GPT-4o ( Hurst et al. 2024 ) , LLaMA-3.3-70B ( Dubey et al. 2024 ) , and Qwen-2.5-72B ( Yang et al. 2024 ) ) and efficient smaller variants, evaluating nine diverse long-context tasks spanning summarization, question answering, multi-hop reasoning, and controlled position experiments. Our comprehensive evaluation combines traditional metrics with LLM-based assessment and explores multiple SC implementations, including majority voting ( Wang et al. 2022b ) , universal SC ( Chen et al. 2024 ) , and soft SC ( Wang et al. 2024 ) . Contributions. We provide the first systematic study of self-consistency in long-context settings, revealing three key findings through 651 carefully designed experiments: (1) Failure of SC in long-contexts: SC consistently degrades performance across models and tasks, even with state-of-the-art commercial systems. This degradation persists across synthetic and real-world tasks, challenging the assumption that SC universally improves LLM reliability. (2) Robustness to metric and implementation: Multiple metrics and aggregation approaches confirm SC’s fundamental limitations in long-contexts. (3) Mechanistic role of position bias: Through controlled experiments, we decouple retrieval from reasoning, showing that SC amplifies position bias in both steps. Varying prompt structure and SC configuration reveals that SC’s failures stem from correlated positional errors . These insights challenge the assumption that SC universally improves performance and provides guidance for developing more robust approaches to long-context tasks. Our findings underscore the necessity of rethinking aggregation strategies in the face of position bias, paving the way for future research into context-aware methods, such as position-aware voting or debiased sampling, that enhance reliability in long-context tasks. 2 Related Work Self-consistency. Building on chain-of-thought prompting ( Wei et al. 2022 ) , self-consistency (SC) ( Wang et al. 2022b ) leverages the intuition that diverse reasoning paths—generated via stochastic sampling—converge toward correct answers when aggregated through methods like majority voting, likelihood scoring ( Wang et al. 2024 ) , LLM Judges ( Chen et al. 2024 ; Lin et al. 2024 ) , or game theoretic consensus ( Jacob et al. 2023 ) . However, these studies predominantly focus on short tasks (e.g., math problems, brief QA), where stochastic sampling produces independent errors . This assumption breaks down in long settings where systemic errors emerge due to position bias. While Chen et al. 2024 evaluates SC on long-context summarization, their reliance on ROUGE metrics—which measures surface-level alignment rather than holistic quality—leaves SC’s impact on long-context understanding insufficiently addressed. Our work bridges this gap by comprehensively evaluating SC implementations across multiple long-context tasks. Unlike prior studies, we employ automated metrics (ROUGE, F1, accuracy) and LLM judges, with bootstrapped 95% confidence intervals to quantify statistical significance rigorously. This multifaceted approach reveals systemic degradations in SC performance that surface-level metrics like ROUGE fail to capture. Position bias. Position bias, a tendency to favor or neglect certain context regions, has emerged as a fundamental challenge for LLMs in long-context processing. Prior work highlights three key manifestations: primacy (overweighting early context) ( Wang et al. 2023 ) , recency (preferring recent information) ( Zheng et al. 2023 ) , and a U-shaped pattern where middle-context information is neglected ( Liu et al. 2024 ) . These biases persist across architectures, unaffected by instruction tuning ( Liu et al. 2024 ) or extreme context window scaling ( Lee et al. 2024 ) , suggesting they are intrinsic to transformer-based attention mechanisms. While recent efforts propose mitigations through context compression ( Jiang et al. 2024 ) , attention calibration ( Hsieh et al. 2024b ) , or fine-tuning ( Xiong et al. 2024 ) , such approaches incur computational overhead and merely alleviate symptoms rather than address the root cause. Critically, these approaches target individual model outputs but do not consider how aggregation methods like SC might amplify positional errors—a gap our work

Read the complete text