When Models Decide and When They Bind: A Two-Stage Computation for Multiple-Choice Question-Answering

Hugh Mee Wong, Rick Nouwen, Albert Gatt · 2026

Read When Models Decide and When They Bind: A Two-Stage Computation for Multiple-Choice Question-Answering by Hugh Mee Wong, Rick Nouwen, Albert Gatt (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-03914.txt.

Introduction

Hugh Mee Wong, Rick Nouwen, and Albert Gatt examine how language models answer multiple-choice questions, a format that hides a subtle second task. The model must both solve the problem and emit the symbol, such as a letter, that stands for its chosen answer. Reasoning errors and symbol-binding failures get tangled in the final score. The team used representational analyses and causal interventions to watch the process unfold inside the model.

States at option boundaries carried strong signals about each option's correctness. The winning option's identity in content space became decodable right after the last option was read, while the output symbol appeared later, near the answer position. Permuting symbols and content supported a two-stage picture: first pick the winner, then bind it to its symbol. That separation helps explain odd multiple-choice failures.

Catalog record

CREATORHugh Mee Wong, Rick Nouwen, Albert Gatt
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE37 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-03914

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

When Models Decide and When They Bind: A Two-Stage Computation for Multiple-Choice Question-Answering Hugh Mee Wong, Rick Nouwen, Albert Gatt Abstract Multiple-choice question answering (MCQA) is easy to evaluate but adds a meta-task: models must both solve the problem and output the symbol that represents the answer, conflating reasoning errors with symbol-binding failures. We study how language models implement MCQA internally using representational analyses (PCA, linear probes) as well as causal interventions. We find that option-boundary (newline) residual states often contain strong linearly decodable signals related to per-option correctness. Winner-identity probing reveals a two-stage progression: the winning content position becomes decodable immediately after the final option is processed, while the output symbol is represented closer to the answer emission position. Tests under symbol and content permutations support a two-stage mechanism in which models first select a winner in content space and then bind or route that winner to the appropriate symbol to emit. We release our code at https://github.com/to-reveal-after-reviews . 1 Introduction Multiple-choice question answering (MCQA) is pervasive in natural language processing (NLP) benchmarks, in part because of its ease of evaluation compared to long-form generation: assessing a model’s response can often be reduced to inspecting the token (distribution) immediately following the user’s prompt. However, reframing NLP tasks as MCQA prompts also introduces an additional meta-task, over and above the NLP task itself. Specifically, a language model must both determine the correct answer to the target question and recognize that it should output the symbol that represents that answer. Consequently, when a model selects an incorrect option, this failure may stem from a misunderstanding of the target question, the MCQA format, or both. Prior work has shown that language models exhibit selection biases for particular option identifiers such as the label “A” ( 31 ; 5 ; 12 ; 26 ) . They may also be sensitive to the ordering of answer choices ( 19 ) , the specific symbols used to denote the options ( 28 ; 25 ) , and the length of answer options ( 30 ) . Furthermore, the answer obtained from comparing probabilities of the first tokens in MCQA is often not consistent with the long-form generation output ( 24 ; 20 ) . These issues underscore the need to better understand how a language model solves MCQA tasks, separating a model’s task-relevant knowledge from artifacts introduced by the MCQA format itself, especially symbol binding , where a model has to associate an answer symbol with its corresponding option text. Mechanistic interpretability (MI) methods can be used to identify why and how answer options are represented, as well as how symbols such as option identifiers are bound to their semantic content, and how these representations are ultimately converted into a final decision. Prior MI work on MCQA has identified attention heads as key contributors to predicting the answer symbol: 13 highlight “Correct Letter Heads” that attend from the final token to the correct symbol token, while 25 localize symbol-predictive signals in mid-layer heads. However, because these analyses intervene primarily at the last token position, they may miss binding dynamics if the model has already committed earlier. Leveraging results on binding mechanisms in entity tracking ( 6 ; 4 ) tasks, 17 find evidence that models compute an index for the correct option and then dereference it to emit the corresponding symbol. In this work, we focus on when and where models represent the correct option and its symbol. We combine representational analyses (PCA and linear probing) with causal interventions (activation patching) to separate three stages of computation: per-option correctness evaluation, global option winner selection, and symbol binding at the answer-emission site. Our contributions are as follows. • We perform representational analyses which show that models track both the position of symbols, and whether the current or previously seen option is correct. We further show that an option-boundary state (i.e., the newline after any MCQA option) often contains highly linearly decodable information related to the correctness of the option. • Training 4-way winner-identity probes (predicting the symbol that the model outputs) and evaluating them under symbol permutations and content permutations yield a clear disassociation: the winner content position is already represented right after the model has processed the last option, while the identity of the symbol emerges later. • We find further support for this dissociation by performing causal interventions using probe-aligned patching. Together, these results suggest that language models use a two-stage mechanism in which they first commit to a winning option before they are prompted to respond and subsequently route/bind that winner tot he appropriate symbol closer to the point of answer emission. 2 Related Work Symbol emission 13 identify Correct Letter Heads , attention heads that attend heavily from the final token to the correct label. Low-rank analyses suggest that these heads may encode information about a letter (symbol) being the n -th item in a list. As such, these heads promote the chosen symbol based on its position in the symbol ordering. 25 use vocabulary projection ( logit lens ) and activation patching at the last token position to show that attention heads in middle layers play an important role in the prediction of an answer symbol. Binding in language models Symbol binding has been a challenging problem in both neuroscience 2 and neural networks 22 . A well-known example of binding can be found in entity tracking ( 10 ) , where a model must bind an entity to its attributes to later retrieve the correct attribute. 6 remark that these associations are made in context, so binding must occur in the activations of the language model instead of being stored as facts in the weights. They propose the binding ID (BI) mechanism: the model assigns abstract IDs to entities and attributes, and bound pairs share an ID that can be referenced later. 4 extend this line of work by capturing the ordering ID (OI), the input order in which the entities and attributes appear in the context. They show that OI is encoded in a low-rank activation subspace that influences in-context binding. Building on this, 17 argue that MCQA may rely on ordering IDs: the model identifies the answer’s position in the option list and then dereferences that index to emit the corresponding symbol, echoing a hypothesis by 13 . 13 ’s preliminary experiments to analyze the outputs to the Correct Letter Heads suggest that models may use “Content Gatherers”, which attend from the final tokens to the last token of the correct option content token. In contrast, 17 report that order information shifts from the correct symbol token to the last token position in middle layers. 3 Experimental Setup Task definition Following 25 and 17 , we use a synthetic 4-way MCQA task to disentangle a model’s task-specific knowledge from MCQA behavior. Prior work relies on the Copying Colors from Context ( 25 , Colors ;) dataset, adapted from the Memory Colors dataset introduced by 18 . Its questions target prototypical colors of objects and are of the form “A banana is yellow. What color is a banana?” Because such facts may be stored in model weights, the way questions are framed obscures the role of symbol binding, which

Read the complete text