The Emperor’s New Clothes in Benchmarking? A Rigorous Examination of Mitigation Strategies for LLM Benchmark Data Contamination

Yifan Sun, Han Wang, Dongbai Li, Gang Wang, Huan Zhang · 2025

Read The Emperor’s New Clothes in Benchmarking? A Rigorous Examination of Mitigation Strategies for LLM Benchmark Data Contamination by Yifan Sun, Han Wang, Dongbai Li, Gang Wang, Huan Zhang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2503-16402.txt.

Introduction

Yifan Sun and co-authors present a 2025 paper that tests whether fixes for a known flaw in language model exams really work. If exam questions leak into a model's training data, scores swell and stop being trustworthy. Fixes rewrite old questions or make new ones in the same style, but their worth had not been checked in a strict way.

The team built a controlled test pipeline and two new scores. One score checks whether per-question results still match the clean exam, and the other checks how well a fix resists leaks. Trials with ten models and five exams gave a fine-grained view. The work gives exam makers a firmer way to judge fixes.

Catalog record

CREATORYifan Sun, Han Wang, Dongbai Li, Gang Wang, Huan Zhang
YEAR2025
COLLECTIONPAPERS
FORMATTXT
FILE SIZE65 KB
VERSION1.0
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2503-16402

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

The Emperor’s New Clothes in Benchmarking? A Rigorous Examination of Mitigation Strategies for LLM Benchmark Data Contamination Yifan Sun, Han Wang, Dongbai Li, Gang Wang, Huan Zhang Abstract Benchmark Data Contamination (BDC)—the inclusion of benchmark testing samples in the training set—has raised increasing concerns in Large Language Model (LLM) evaluation, leading to falsely inflated performance estimates and undermining evaluation reliability. To address this, researchers have proposed various mitigation strategies to update existing benchmarks, including modifying original questions or generating new ones based on them. However, a rigorous examination of the effectiveness of these mitigation strategies remains lacking. In this paper, we design a systematic and controlled pipeline along with two novel metrics— fidelity and contamination resistance —to provide a fine-grained and comprehensive assessment of existing BDC mitigation strategies. Previous assessment methods, such as accuracy drop and accuracy matching, focus solely on aggregate accuracy, often leading to incomplete or misleading conclusions. Our metrics address this limitation by emphasizing question-level evaluation result matching. Extensive experiments with 10 LLMs, 5 benchmarks, 20 BDC mitigation strategies, and 2 contamination scenarios reveal that no existing strategy significantly improves resistance over the vanilla case ( i.e. , no benchmark update) across all benchmarks, and none effectively balances fidelity and contamination resistance. These findings underscore the urgent need for designing more effective BDC mitigation strategies. Our code repository is available at https://github.com/ASTRAL-Group/BDC_mitigation_assessment . † † affiliationnotice: Equal contribution 1 Introduction Benchmarking Large Language Models (LLMs) has recently become a critical area of focus ( White et al., 2024 ; Xia et al., 2024 ; Guha et al., 2024 ; Zeng et al., 2024 ; Lin et al., 2024 ; Ni et al., 2024a ) , driven by the rapid increase in their number and capacity ( Achiam et al., 2023 ; Dubey et al., 2024 ; Team, 2024b ; Team et al., 2023 ; Team et al., 2024 ) . Reliable and high-quality evaluation benchmarks are essential to provide comprehensive and accurate assessments of LLM capabilities. However, as modern LLMs are trained on vast amounts of web-scraped data, concerns have emerged regarding benchmark samples inadvertently appearing in their training sets. Consequently, it is challenging to determine whether the model just simply memorizes answers to difficult test questions to achieve a better performance ( Oren et al., 2023 ; Zhu et al., 2024b ) . This phenomena, known as Benchmark Data Contamination (BDC) , results in falsely inflated performance metrics, thereby undermining the reliability of evaluation conclusions ( Zhou et al., 2023 ; Jiang et al., 2024 ; Sainz et al., 2023 ) . Figure 1: Illustration of BDC mitigation strategies. BDC mitigation strategies, such as synonym replacement and analysis extension ( Ying et al., 2024 ) , update benchmark questions to reduce the risk of direct memorization. Figure 2: The limitations of existing approaches for assessing BDC mitigation strategies : (a) Accuracy drop measures the performance decline between contaminated accuracy and mitigated accuracy, but does not account for the clean accuracy, making it unclear how much drop indicates effective mitigation. (b) Accuracy matching requires that the mitigated accuracy restores clean accuracy. However, as shown in the example, even when the accuracies match, the question-level evaluation results differ significantly ( e.g. , correctly answering the 1st and 2nd questions versus the 4th and 5th). This discrepancy suggests that the updated benchmark may evaluate different aspects of model capacity compared to the original benchmark. As a result, the mitigation strategy may fail to preserve the original benchmark’s evaluation objective and could be ineffective. To mitigate BDC, creating new benchmark datasets from scratch is a potential solution, but this process is often prohibitively expensive and labor-intensive 1 1 1 For instance, curating the GPQA dataset ( Rein et al., 2023 ) , which contains 448 multiple-choice questions written by domain experts, required over $120,000 ( Rein, 2024 ) . Similarly, the recently introduced HLE benchmark ( Phan et al., 2025 ) has allocated $500,000 to collect high-quality benchmark questions. . Moreover, some existing benchmark datasets, such as MMLU ( Hendrycks et al., 2020 ) and GSM8K ( Cobbe et al., 2021 ) , are already of high quality and accurately reflect real-world question distributions within their respective domains. Rather than retiring such well-established benchmarks, ongoing efforts Table 1: Definition of different evaluation scenarios based on the contamination status of the LLM and the benchmark version used. Scenario LLM Benchmark Clean Uncontaminated Original Contaminated Contaminated Original Mitigated Contaminated Updated aim to update them or generate new questions based on these benchmarks to mitigate BDC ( Zhu et al., 2023b ; Zhu et al., 2024a ; Zhu et al., 2024b ; Ying et al., 2024 ) . For example, a straightforward approach is to paraphrase original questions, reducing the risk of models naively leveraging memorized answers. Figure 3: Overview of our pipeline for assessing BDC mitigation strategies : (1) We select an LLM-benchmark pair and ensure it passes three BDC detection methods to confirm it is uncontaminated, a crucial step for reliable “clean” evaluation results (§ 4.2 ). (2) Each mitigation strategy is applied separately to the original benchmark to produce an updated benchmark; 20 strategies are examined in total (§ 4.3 ). (3) The uncontaminated LLM is fine-tuned on the original benchmark dataset. Two contamination recipes (mild and intensive) are tested to ensure robust conclusions and three validation checks are performed to confirm the effectiveness of the contamination process (§ 4.4 ). (4) Evaluation vectors are computed for: (a) uncontaminated LLM with the original benchmark, (b) uncontaminated LLM with the updated benchmark, and (c) contaminated LLM with the updated benchmark (§ 4.5 ). (5) Fidelity and resistance are derived based on the degree of matching between these evaluation vectors (§ 3 ). An effective mitigation strategy should achieve high scores in both metrics. Our Research Question Each BDC mitigation strategy yields an updated benchmark. We focus on a thorough and rigorous examination towards the effectiveness of different BDC mitigation strategies. However, it is crucial to assess the effectiveness of different BDC mitigation strategies systematically. For example, whether surface paraphrasing can indeed alleviate the effects of BDC is under question. Nevertheless, current practices for assessing BDC mitigation strategies have clear limitations, as illustrated in Fig. 2 : (a) Accuracy drop. Some previous studies regard a mitigation strategy as successful if the contaminated LLM’s accuracy on the updated benchmark ( i.e., mitigated accuracy) is lower than its accuracy on the original benchmark ( i.e., contaminated accuracy) ( Zhu et al., 2024a ) . However, without referencing the model’s performance on the original benchmark before any contamination ( i.e., clean accuracy), it is unclear how much of a drop is meaningful. (b) Accuracy matching. Other works assess mitigation strategies by comparing clean accuracy with mitigated accuracy, expecting them to match ( Zhu et al., 2023b ; Zhu et al., 2024b ; Ying et al., 2024 ) . Yet, accuracy is only an aggregate metric. Focusing solely on matching the scalar accuracy is not sufficient and can even be misleading. For example, in the case shown in Fig. 2 (b), even if scalar accuracy aligns, the strategy fails to recover the clean question-wise evaluation results. Consequently, the mitigation strategy may alter the original benchmark’s evaluation

Read the complete text