Gaming the Answer Matcher: Examining the Impact of Text Manipulation on Automated Judgment

Manas Khatore, Sumana Sridharan, Kevork Sulahian, Benjamin J. Smith, Shi Feng · 2026

Read Gaming the Answer Matcher: Examining the Impact of Text Manipulation on Automated Judgment by Manas Khatore, Sumana Sridharan, Kevork Sulahian, Benjamin J. Smith, Shi Feng (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2601-08849.txt.

Introduction

Manas Khatore and four co-authors test how foes can game an AI grader. The grader reads a free text reply and checks it next to a right reply. Such checks scale well and match human marks in fair play. But a sly user can pad a reply with long words, repeat key terms, or guess in a bold style to lift the score.

The team tries such tricks and tracks how marks move when the true worth of a reply stays the same. Tricks that work show a flaw in the grader, not skill in the user. A reader who uses AI checks gets a list of weak points. It helps them build checks that prize true right replies, not slick text.

Catalog record

CREATORManas Khatore, Sumana Sridharan, Kevork Sulahian, Benjamin J. Smith, Shi Feng
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE27 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2601-08849

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Gaming the Answer Matcher: Examining the Impact of Text Manipulation on Automated Judgment Manas Khatore, Sumana Sridharan, Kevork Sulahian, Benjamin J. Smith, Shi Feng Abstract Automated answer matching, which leverages LLMs to evaluate free-text responses by comparing them to a reference answer, shows substantial promise as a scalable and aligned alternative to human evaluation. However, its reliability requires robustness against strategic attacks such as guesswork or verbosity that may artificially inflate scores without improving actual correctness. In this work, we systematically investigate whether such tactics deceive answer matching models by prompting examinee models to: (1) generate verbose responses, (2) provide multiple answers when unconfident, and (3) embed conflicting answers with the correct answer near the start of their response. Our results show that these manipulations do not increase scores and often reduce them. Additionally, binary scoring (which requires a matcher to answer with a definitive ”correct” or ”incorrect”) is more robust to attacks than continuous scoring (which requires a matcher to determine partial correctness). These findings show that answer matching is generally robust to inexpensive text manipulation and is a viable alternative to traditional LLM-as-a-judge or human evaluation when reference answers are available. Introduction Output evaluation and validation is a bottleneck for modern language-model development: human judgments are reliable but slow and costly, while automated evaluation offers faster, cheaper, and more reproducible feedback. Answer matching, which entails scoring a free-text response against a reference answer, has become a method for multiple choice evaluation because it targets agreement with a known answer and can run on compact matcher models, with prior work showing good alignment on clean free-text responses ( 4 ) . Asking a judge model to validate multiple choice options (i.e. A, B) remains appealing for clarity and objective scoring, but it measures selection among predefined options rather than generative claims and can be gamed by test-taking artifacts ( 4 ) . LLM-as-a-judge methods (which evaluate the correctness of free-text responses without a reference) are efficient and flexible but face reliability, bias, and hallucination problems ( 22 ; 20 ; 27 ; 14 ; 7 ) . The deployment of new models requires evaluating how they perform on existing, challenging benchmarks. Since many benchmarks have reference answers available, we argue that answer matching is a natural fit for validating a model’s performance before it is released. As model evaluation research continues to explode, the sheer quantity and diversity of benchmarks that contain reference solutions has grown as well, which can assess a model’s performance across a variety of domains. In the pre-deployment phase, answer matching is superior to other methods of validation that may require human feedback, such as preference learning. Answer matching is objective and compares a generated response to a known truth, while preference learning is not as effective at detecting when responses are incorrect (as a human or model denotes which output they ”prefer,” even if all possible outputs are incorrect). Additionally, scoring with reference answers provides clear metrics for how a model is performing against a specific benchmark, which can be especially valuable before deploying models in high-impact domains like medicine and law. However, a concern is that matchers may overweigh presentation over content, with prior work showing that superficial cues (e.g., chain-of-thought prompts, verbosity, punctuation) can sway LLM judgments ( 26 ; 16 ) . We test three simple attacks: • Verbosity-only inflation : length added to generated answer without content change • Forward : correct answer presented earlier in the generated answer, with the second half containing a contradiction, and • Strategic : when the model is uncertain, the generated response is made vague with multiple answers included. Our aim is to see whether the strengths of the answer matching method on clean inputs hold under these easy-to-deploy manipulations. 1 1 1 Code available at: https://github.com/KevorkSulahian/Gaming-the-Answer-Matcher/ Research Questions Our interest in the robustness of answer matching models stems from prior research on manipulating how a model evaluates free response text. Specifically, our research questions are: 1. Are LLM-based answer matchers more likely to classify responses as correct if they are vague and contain multiple plausible answers? : Previous research on answer matching has evaluated its effectiveness by using generated responses that contain a single, unambiguous answer ( 4 ) . The response is judged as correct if the content of the response matches with that of the reference answer, but what if part of the response matches with the reference and another part conflicts? 2. Are LLM-based answer matchers more likely to classify responses as correct if they are verbose? : LLMs have been shown to exhibit verbosity bias ( 18 ) , meaning that when given two response with similar content and greatly different lengths, a model will prefer the longer response. This is true even if the shorter response is more direct, and the extra length of the preferred response does not make the response ”more correct.” Given this result, we are motivated to determine whether verbosity can be used as a way to trick an answer matching model to consistently choose a certain response. This is especially salient for answer matching, where reference answers are typically less than a sentence long and verbosity is not required to have an accurate answer. 3. Are binary or continuous judgments more robust to gaming? : Binary judgment refers to a matcher having two response options, either ”correct” or ”incorrect” (denoted as 1 or 0, respectively). On the other hand, continuous judgment allows for a model to assign partial correctness to a response, typically on a scale from 0 to 1 with increasing values corresponding to higher correctness. Recent research has shown that models operating on a binary judgment paradigm are ”negative” and less likely to deem an answer as correct ( 13 ) . Hypotheses 1. Responses that are vague and embed multiple answers when a model is unsure of the correct answer will elicit higher scores from the answer matcher model than baseline responses. 2. Responses that are verbose will elicit higher scores from the answer matcher model than baseline responses. 3. Matchers operating under a binary judgment role will be more robust to attacks compared to those with a continuous judgment. Metrics We used the following metrics to test our hypotheses that answer matching is vulnerable to strategies that involve creating vague, conflicting responses and increasing verbosity. 1. Average alignment: We use average alignment to refer to the mean score assigned to each experiment for each dataset. We calculated an average alignment score for all of the questions in each experimental condition. \displaystyle\bar{A}_{c} \displaystyle=\frac{1}{n_{c}}\sum_{i=1}^{n_{c}}a_{i} \displaystyle a_{i} \displaystyle=\text{numerical score assigned by the matcher for question }i \displaystyle n_{c} \displaystyle=\text{total number of questions in condition }c While it lacks granularity into the scores of specific questions, this metric provides an overall view into the rate at which a model determines a response to be correct. To determine whether an attack is significantly more effective, we compared the average alignment of each attack with the corresponding baseline version using a two-proportion z-test with a p-value cutoff of 0.05. 2. Attack success rate (ASR): Previous literature uses this metric to determine the effectiveness of an adversarial attack in being able to convert failures into successes

Read the complete text