On Robustness and Reliability of Benchmark-Based Evaluation of LLMs
Riccardo Lunardi, Vincenzo Della Mea, Stefano Mizzaro, Kevin Roitero * {}^{\text{\footnotesize{*}}} · 2025
Read On Robustness and Reliability of Benchmark-Based Evaluation of LLMs by Riccardo Lunardi, Vincenzo Della Mea, Stefano Mizzaro, Kevin Roitero * {}^{\text{\footnotesize{*}}} (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2509-04013.txt.
Introduction
Testing whether standard benchmark scores for large language models survive simple rewording is what Riccardo Lunardi and three co-authors do in a 2025 research paper. Benchmarks like MMLU present questions in one fixed, standardised wording. Real users phrase the same questions many ways, so a model that only handles the canonical wording is less capable than its score suggests.
The authors generate paraphrases of every question across six common benchmarks, then measure how effectiveness changes for thirty-four leading language models . Model rankings stay relatively stable under paraphrase: the best models mostly remain the best. Absolute scores, however, change and decline significantly, showing the models struggle with linguistic variability. That drop undermines trust in benchmark-based evaluation, since high scores may not reflect robustness to real-world input variation. The authors emphasise robustness-aware benchmarks, designed to measure performance across rewordings, as a better guide to practical deployment.
Catalog record
| CREATOR | Riccardo Lunardi, Vincenzo Della Mea, Stefano Mizzaro, Kevin Roitero * {}^{\text{\footnotesize{*}}} |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 43 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2509-04013
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
On Robustness and Reliability of Benchmark-Based Evaluation of LLMs Riccardo Lunardi, Vincenzo Della Mea, Stefano Mizzaro, Kevin Roitero * {}^{\text{\footnotesize{*}}} Abstract Large Language Models (LLMs) effectiveness is usually evaluated by means of benchmarks such as MMLU, ARC-C, or HellaSwag, where questions are presented in their original wording, thus in a fixed, standardized format. However, real-world applications involve linguistic variability, requiring models to maintain their effectiveness across diverse rewordings of the same question or query. In this study, we systematically assess the robustness of LLMs to paraphrased benchmark questions and investigate whether benchmark-based evaluations provide a reliable measure of model capabilities. We systematically generate various paraphrases of all the questions across six different common benchmarks, and measure the resulting variations in effectiveness of 34 state-of-the-art LLMs, of different size and effectiveness. Our findings reveal that while LLM rankings remain relatively stable across paraphrased inputs, absolute effectiveness scores change, and decline significantly. This suggests that LLMs struggle with linguistic variability, raising concerns about their generalization abilities and evaluation methodologies. Furthermore, the observed performance drop challenges the reliability of benchmark-based evaluations, indicating that high benchmark scores may not fully capture a model’s robustness to real-world input variations. We discuss the implications of these findings for LLM evaluation methodologies, emphasizing the need for robustness-aware benchmarks that better reflect practical deployment scenarios. † † paperid: 9556 1 Introduction Large Language Models (LLMs) capabilities have rapidly advanced in recent years, demonstrating state-of-the-art performance across a variety of natural language processing tasks. Their effectiveness is primarily assessed through standardized benchmark evaluations, such as the Massive Multitask Language Understanding (MMLU) [ 16 ] , Winogrande [ 32 ] , and HellaSwag [ 46 ] . These benchmarks provide a structured and widely accepted framework for comparing models, ensuring consistency in evaluation, in a multiple-choice question answering setting. However, questions are presented in a fixed, standardized wording and this controlled setting does not fully account for the variability inherent in real-world interactions, where users may express the same intent in multiple ways. A crucial open question is whether LLMs evaluated in these rigid benchmark settings exhibit robustness to linguistic variation. Recent studies have shown that LLMs are highly sensitive to changes in prompt formatting and minor alterations in wording, often leading to significant performance fluctuations [ 35 , 47 ] . This phenomenon raises concerns about model robustness , i.e., the ability of LLMs to generalize across semantically equivalent yet reworded inputs. If a model’s effectiveness drops drastically when faced with paraphrased questions, its real-world applicability and generalization capabilities may be overestimated. At the same time, these observations challenge the reliability of benchmark-based evaluations . If benchmark scores are highly dependent on the specific phrasing of questions, do they truly reflect a model’s reasoning ability, or do they merely capture performance on a particular wording of the task? While prior research has explored the impact of prompt variations on LLM outputs [ 23 ] , less attention has been given to the extent to which benchmark evaluations remain stable and reliable when test questions have systematic rewording. In this study, we investigate both of these fundamental issues. First, we assess the robustness of LLMs by systematically paraphrasing benchmark questions and measuring the resulting changes in performance. Second, we evaluate the reliability of benchmark-based evaluations by analyzing whether the relative ranking of models remains stable across paraphrased inputs. By introducing controlled linguistic and syntactic variations, our study provides a direct test of models’ ability to generalize beyond the specific phrasings seen during training. This allows us to assess whether current benchmark methodologies truly capture a model’s underlying reasoning capabilities or whether they merely reflect performance on narrowly framed tasks, ultimately risking an overstatement of model effectiveness. We address the following research questions: RQ1 Are benchmark-based evaluations reliable ? Do LLM evaluation results change significantly when benchmark questions are replaced by simple paraphrases? RQ2 Are LLMs robust to question paraphrases? Does question paraphrasing decrease LLM effectiveness, revealing limitations in their generalization capabilities? Our findings reveal that while the rankings of LLMs remain relatively stable, their absolute performance drops significantly when questions are paraphrased. This suggests that while benchmarks may provide a reasonable comparative measure of models, they overestimate absolute performance and generalization abilities. All data and code, including the complete set of questions, paraphrases, model predictions, and high-resolution plots, are available at https://osf.io/jq56f/?view_only=aa6d0c67db7e47c08cff3b3e1a610764 . 2 Background and Related Work Effectiveness evaluation is a fundamental problem across multiple disciplines, including Information Retrieval (IR), Natural Language Processing (NLP), and Artificial Intelligence (AI). Reliable evaluation frameworks are essential for ensuring that progress in the field reflects genuine improvements rather than artifacts of specific test conditions. Effectiveness evaluation has a long tradition especially in the IR field, where a rich body of research has explored how to design evaluations that are both efficient and reliable, particularly when human annotations are expensive or limited [ 15 , 34 , 36 ] . Studies have proposed methods to reduce the number of relevance judgments without compromising evaluation validity [ 6 , 7 ] , analyzed optimal topic set sizes for stable system comparisons [ 14 ] , and investigated model ranking stability under incomplete assessments [ 40 ] . These works collectively emphasize that relative rankings of retrieval systems tend to remain stable even under noisy or incomplete assessments [ 3 , 38 , 39 ] . Recent work has also raised concerns about the long-term reliability of test collections, showing that even if system rankings remain stable, benchmarks may lose discriminative power over time as models overfit to narrow interpretations of relevance, effectively “expiring” in their utility [ 29 ] . Insights from decades of IR evaluation research can be leveraged in the context of LLM benchmarking, where structured evaluations have become the de-facto standard for measuring model capabilities. While benchmarks are widely used to track progress and compare model performance, their quality varies significantly, and many commonly used benchmarks suffer from issues such as poor design, limited replicability, or lack of statistical rigor [ 31 ] . Benchmarks such as MMLU [ 16 ] , ARC-C [ 11 ] , and HellaSwag [ 46 ] provide standardized datasets that enable reproducible model comparisons. However, these benchmarks assume a rigidly controlled testing environment in which questions are presented in a fixed wording and format. This does not reflect real-world applications, where linguistic variability is the norm [ 25 , 26 , 37 ] . In fact, humans may naturally phrase the same question in multiple ways depending on context, intent, or background knowledge, making it essential to assess whether models can maintain their effectiveness across diverse rewordings. Recent studies have shown that LLMs are highly sensitive to prompt variations, with minor changes in wording, structure, or formatting leading to substantial performance shifts [ 35 , 47 ] . While prompt engineering techniques have investigated how to optimize LLM outputs by refining input phrasing [ 41 ] , this does not necessarily indicate robustness of models. Instead, it often exposes an over-reliance on surface-level patterns, where high benchmark scores may be driven by implicit dataset artifacts rather than genuine reasoning abilities [ 23 ] . This raises the question of whether LLM evaluations conducted under fixed benchmark