Mind the Gap: How Elicitation Protocols Shape the Stated-Revealed Preference Gap in Language Models

Pranav Mahajan, Ihor Kendiukhov, Syed Hussain, Lydia Nottingham · 2026

Read Mind the Gap: How Elicitation Protocols Shape the Stated-Revealed Preference Gap in Language Models by Pranav Mahajan, Ihor Kendiukhov, Syed Hussain, Lydia Nottingham (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-21975.txt.

Introduction

Pranav Mahajan and co-authors study a gap between what language models say they value and what they actually choose. A model may endorse one value in words, then pick differently when acting in context. Earlier tests of this stated and revealed preference gap leaned on forced binary choices.

Binary prompts mix genuine preferences with artifacts of how the question is asked. The team's 2026 preprint systematically varies the elicitation protocol, the exact way preferences are drawn out, to see how much of the gap is real. How big that gap truly is matters for alignment work. A model whose stated values do not predict its choices cannot be trusted on its word alone.

Catalog record

CREATORPranav Mahajan, Ihor Kendiukhov, Syed Hussain, Lydia Nottingham
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE24 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-21975

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Mind the Gap: How Elicitation Protocols Shape the Stated-Revealed Preference Gap in Language Models Pranav Mahajan, Ihor Kendiukhov, Syed Hussain, Lydia Nottingham Abstract Recent work identifies a stated–revealed (SvR) preference gap in language models (LMs): a mismatch between the values models endorse and the choices they make in context. Existing evaluations rely heavily on binary forced-choice prompting, which entangles genuine preferences with artifacts of the elicitation protocol. We systematically study how elicitation protocols affect SvR correlation across 24 LMs. Allowing neutrality and abstention during stated preference elicitation allows us to exclude weak signals, substantially improving Spearman’s rank correlation ( ρ \rho ) between volunteered stated preferences and forced-choice revealed preferences. However, further allowing abstention in revealed preferences drives ρ \rho to near-zero or negative values due to high neutrality rates. Finally, we find that system prompt steering using stated preferences during revealed preference elicitation does not reliably improve SvR correlation on AIRiskDilemmas. Together, our results show that SvR correlation is highly protocol-dependent and that preference elicitation requires methods that account for indeterminate preferences. 1 Introduction Recent work has identified a stated–revealed (SvR) preference gap in language models (LMs): a mismatch between the values models endorse in abstract and the choices they make in contextualized scenarios ( 7 ; 14 ; 5 ) . Existing evaluations of this gap rely heavily on forced binary-choice prompting, which collapses preference strength, indifference, and uncertainty into a single outcome. As a result, measured SvR correlations may conflate genuine preferences with artifacts of the elicitation protocol ( 11 ; 2 ) . We systematically study how elicitation protocols shape measured SvR correlation across 24 LMs. We focus on whether elicitation permits neutrality or abstention, and whether preferences are elicited in abstract (stated) or contextualized (revealed) settings. Allowing neutrality during stated preference elicitation filters out weak or indeterminate comparisons, substantially increasing rank correlation with forced-choice revealed behavior. In contrast, allowing neutrality during revealed preference elicitation leads many models to consistently select Depends or Equal Preference , driving rank-based SvR correlation to near-zero or negative values. Finally, we test whether the SvR gap can be reduced via prompt-based steering—conditioning revealed preference elicitation on a model’s own stated value hierarchy. While prior work reports gains for small value sets ( 14 ) , we find steering unreliable over a 16-value domain, consistent with evidence on the fragility of prompting as a steering mechanism ( 16 ) . Together, our results show that SvR correlation is highly protocol-dependent and that preference evaluation must explicitly account for neutrality and indeterminacy. Resources. We release the MindTheGap elicitations and full evaluation code. 1 1 1 Elicitations: https://huggingface.co/datasets/LydiaNottingham/MindTheGap . Dataset: Code: https://github.com/SPAR-SvR/Mind-the-Gap . 2 Methods We study how elicitation protocols affect stated–revealed preference (SvR) correlation by varying the options available during preference elicitation. Our evaluation builds on the LitmusValues framework of 5 , extending it to explicitly allow neutrality and abstention. We consider two elicitation protocols. In forced-choice elicitation, models must select one of two values or actions. In expanded-choice elicitation, models may additionally respond with Equal Preference or Depends , allowing them to express indifference or contextual uncertainty. Stated preferences are elicited via abstract pairwise value comparisons, while revealed preferences are elicited using contextualized moral dilemmas from AIRiskDilemmas ( 5 ) . All generations use deterministic decoding, and responses are categorized into the four response types using an LM judge (GPT-4o-mini). Pairwise responses are aggregated into global value rankings using win rates over decisive (binary) comparisons; neutral responses are excluded when constructing rankings. SvR correlation is measured as Spearman’s rank correlation ( \rho ) between stated and revealed value rankings ( 5 ) . We evaluate three protocol configurations: forced–forced , expanded-stated / forced-revealed , and expanded–expanded elicitation. To test whether the SvR gap can be reduced via prompt-based intervention, we apply system prompt steering during revealed preference elicitation. For each model, we construct a system prompt containing its stated value ranking obtained under expanded-choice stated preference elicitation, prepend this prompt during revealed preference evaluation, and compare SvR correlation before and after steering. Full prompt templates are provided in Appendix C. 3 Results 3.1 Systematic Evaluation of Neutrality Rates in LLM Responses We begin by measuring neutrality rates —the frequency with which models select Equal Preference or Depends —under an expanded-choice elicitation protocol. Neutrality serves as a direct indicator of weak or indeterminate preferences that are suppressed or misclassified by binary forced-choice prompting. Across 24 LMs, neutrality rates vary widely by model family and elicitation mode. In stated preference elicitation (Fig. 1 , left), neutrality ranges from 48.2% to 100%, with some models (e.g., Qwen-3-8B) predominantly selecting the Depends option. In revealed preference elicitation (Fig. 1 , right), neutrality is substantially higher and more variable across families. While LLaMA-3.1 and LLaMA-4 largely retain binary decisions, Mistral-3-8B variants select neutral responses in nearly all revealed scenarios, preventing the construction of complete binary rankings. Gemma-3-4B selects Equal Preference in approximately 70% of cases. Overall, elevated neutrality in revealed contexts indicates that forced binary comparisons often mask substantial uncertainty or indifference when models are asked to act in concrete scenarios rather than express abstract values. Figure 1: Response Category Distribution showing the proportion of Binary (red), Equal (blue), and Depends (grey) responses under expanded-choice elicitation for stated (left) and revealed (right) preferences. Neutrality rates differ substantially across model families, particularly in revealed scenarios. 3.2 Expanded-Choice Stated Preferences Increase SvR Correlation We evaluate SvR correlation (Spearman’s \rho ) under three elicitation conditions. First, we reproduce the baseline protocol of 5 , using forced-choice elicitation for both stated and revealed preferences. This condition exhibits substantial cross-model variance in SvR correlation (Fig. 2 ), indicating sensitivity to model-specific decision patterns. Second, we replace forced-choice stated preference elicitation with expanded-choice elicitation while retaining forced-choice revealed preferences. This change produces a marked increase in SvR correlation across models (Fig. 2 ). For example, LLaMA-3.1-405B-Instruct improves from \rho\approx 0.2 to \rho\approx 0.7 . Allowing neutrality in stated preferences filters out weak or indeterminate comparisons, yielding rankings that better reflect robust value hierarchies expressed in contextualized revealed behavior. Under this condition, SvR correlation is positively associated with model capability, as measured by the Epoch Capabilities Index (Fig. 3 ). Finally, allowing expanded-choice responses in both stated and revealed preference elicitation causes SvR correlation to drop to near-zero or negative values for many models (Fig. 2 ). This reflects the fact that many models consistently express neutrality—choosing Depends or Equal Preference—in both conditions (Fig. 1 ). In this regime, revealed preferences no longer induce a dense or stable ranking over values, and residual binary choices provide only a weak signal for correlation-based comparison. Together, these results show that SvR correlation is highly protocol-dependent: allowing models to express neutrality or abstain in stated preferences improves correlation by isolating strong preferences, while allowing neutrality in revealed preferences surfaces the extent to which many models’ preferences are weak, indeterminate, or context-sensitive. Figure 2: Impact of Elicitation Protocol on SvR Correlation. (A) Baseline: Forced vs. Forced. (B) Expanded-Stated vs. Forced-Revealed, showing higher SvR correlation. (C) Expanded-Stated vs. Expanded-Revealed, yielding low or negative SvR correlation due to high neutrality rates. Models with neutrality rate above 99% are excluded. Figure 3: SvR Correlation vs. Model Capability. (A) Forced-Stated /

Read the complete text