Silencer : From Discovery to Mitigation of Self-Bias in LLM-as-Benchmark-Generator
Peiwen Yuan, Yiwei Li, Shaoxiong Feng, Xinglin Wang, Yueqi Zhang, Jiayi Shi, Chuyi Tan, Boyuan Pan, Yao Hu, Kan Li · 2025
Read Silencer : From Discovery to Mitigation of Self-Bias in LLM-as-Benchmark-Generator by Peiwen Yuan, Yiwei Li, Shaoxiong Feng, Xinglin Wang, Yueqi Zhang, Jiayi Shi, Chuyi Tan, Boyuan Pan, Yao Hu, Kan Li (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2505-20738.txt.
Introduction
When a model writes its own exam, it tends to ace it, and Yuan and co-authors measure that self-bias and build a tool to silence it. They trace the inflation to three sources: the questions' domain, the writing style, and wrong answer keys. Their framework, Silencer, mixes several generator models so their differing biases cancel, working at both the single question and whole benchmark levels.
In tests, the method drove self-bias close to zero. Benchmarks built this way also tracked human-made gold benchmarks far better, with agreement rising from 0.655 to 0.833 on the standard correlation measure. The authors report the approach held up across settings.
Catalog record
| CREATOR | Peiwen Yuan, Yiwei Li, Shaoxiong Feng, Xinglin Wang, Yueqi Zhang, Jiayi Shi, Chuyi Tan, Boyuan Pan, Yao Hu, Kan Li |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 49 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2505-20738
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Silencer : From Discovery to Mitigation of Self-Bias in LLM-as-Benchmark-Generator Peiwen Yuan, Yiwei Li, Shaoxiong Feng, Xinglin Wang, Yueqi Zhang, Jiayi Shi, Chuyi Tan, Boyuan Pan, Yao Hu, Kan Li Abstract LLM-as-Benchmark-Generator methods have been widely studied as a supplement to human annotators for scalable evaluation, while the potential biases within this paradigm remain underexplored. In this work, we systematically define and validate the phenomenon of inflated performance in models evaluated on their self-generated benchmarks, referred to as self-bias, and attribute it to sub-biases arising from question domain, language style, and wrong labels. On this basis, we propose Silencer , a general framework that leverages the heterogeneity between multiple generators at both the sample and benchmark levels to neutralize bias and generate high-quality, self-bias-silenced benchmark. Experimental results across various settings demonstrate that Silencer can suppress self-bias to near zero, significantly improve evaluation effectiveness of the generated benchmark (with an average improvement from 0.655 to 0.833 in Pearson correlation with high-quality human-annotated benchmark), while also exhibiting strong generalizability. 1 Introduction The rapid evolution of large language models (LLMs) ( Guo et al., 2025 ; OpenAI, 2025 ) has led to three key trends in evaluation: (1) benchmarks saturate more quickly, increasing the demand for continual benchmark construction ( Wang et al., 2024 ) ; (2) LLMs are applied to a wider range of downstream tasks, amplifying the need for more customized benchmarks ( Chang et al., 2024 ) ; (3) as LLMs achieve and even surpass human capability, ever greater intelligence is demanded of benchmark generators ( Patel et al., 2025 ) . Traditional human-centered benchmark construction paradigm struggles to meet these demands due to high annotation costs and the inherent ceiling of human intelligence. To address this, LLM-as-Benchmark-Generator has been proposed as a potential paradigm ( Huang et al., 2024 ; Farchi et al., 2024 ; Maheshwari et al., 2024 ; Yuan et al., 2025 ) for automatically constructing customizable benchmarks that are scalable in difficulty based on LLMs. However, the potential biases in LLM-generated benchmarks remain underexplored, which may lead to unreliable evaluation results. In this work, we investigate the self-bias of LLM-as-Benchmark-Generator , a phenomenon where LLMs tend to achieve overestimated performance on benchmarks they generate themselves . Specifically, we first introduce a formal and quantifiable definition of self-bias \mathcal{B} , and then empirically demonstrate its widespread presence across various LLMs and evaluation tasks. To gain a deeper understanding of the origin of self-bias, we heuristically disentangle \mathcal{B} into three contributors: q uestion domain bias \mathcal{B}^{q} , language s tyle bias \mathcal{B}^{s} , and wrong l abel bias \mathcal{B}^{l} . Investigative experiments show that the three sub-biases collectively contribute to self-bias, with their relative contributions ordered as \mathcal{B}^{l}>\mathcal{B}^{q}>\mathcal{B}^{s} . To eliminate self-bias for achieving more accurate evaluation results, we propose Silencer , a general S elf-b i as neutra l ization fram e work for be nc hmark gen er ation that exploits the heterogeneity of multiple generators to construct self-bias-silenced benchmark. Specifically, to mitigate the sub-biases at sample level, we introduce (1) Attribute Integration to encourage the LLM generators to create more domain-unbiased question sets ( \mathcal{B}^{q} ); (2) Cross Paraphrase to avoid stylistic monotony in language ( \mathcal{B}^{s} ); (3) Label Calibration to reduce the inherent alignment between wrong labels and predictions offered by generators ( \mathcal{B}^{l} ). To suppress self-bias at benchmark level, we propose a Bias-Neutralizing Ensemble algorithm, which iterates through two steps: (1) estimating each generator’s self-bias by measuring the consistency of its evaluation results with those of the ensembled benchmark, and (2) ensembling the generated benchmarks with weights that are inversely proportional to the estimated self-bias, thereby reducing the self-bias introduced to the final ensembled benchmark. We validate the effectiveness and generalizability of Silencer across three tasks, seven LLM generators, and two LLM-as-Benchmark-Generator methods. Comprehensive experimental results demonstrate that Silencer significantly suppresses self-bias, improving evaluation consistency of LLM-generated benchmark with high-quality human-annotated benchmark by 27.2% (from 0.655 to 0.833) on average. Detailed ablation studies and visualizations confirm the effectiveness and working mechanism of each component in Silencer . Building on this, we further explore the impact of factors such as the number of generators and benchmark size on self-bias and evaluation effectiveness, offering practical insights for applying Silencer in real scenarios. 2 Related Works 2.1 LLM-as-Benchmark-Generator Benchmark saturation ( Glazer et al., 2024 ) , data contamination ( Balloccu et al., 2024 ) , and accelerated LLM evolution have collectively motivated the research community to leverage the LLMs for automatic benchmark construction, moving toward the vision of self-evaluation ( Maheshwari et al., 2024 ) . In particular, a specific LLM adopts a designated generation strategy to construct a benchmark based on benchmark definition inputs such as the task description and seed samples ( Lei et al., 2023 ; Huang et al., 2024 ) . The evaluation effectiveness of the generated benchmark is typically validated via benchmark agreement testing ( Perlitz et al., 2024 ) , where the performance of some LLMs on LLM-generated and human-annotated benchmarks are calculated using certain agreement metric (e.g., rank correlation). Metrics such as sample correctness and diversity are computed to support a more fine-grained evaluation of benchmark quality ( Yuan et al., 2025 ) . However, existing studies lack consideration of the generator’s self-bias, raising the risk of performance overestimation. 2.2 Self-Bias of LLMs Variations in training corpora, model architectures, and training strategies cause LLMs to exhibit different domain-specific biases ( Gallegos et al., 2023 ) . Among them, self-bias generally refers to the tendency of the LLM to favour its own generations when acting as a judge ( Panickssery et al., 2024 ; Xu et al., 2024 ; Bai et al., 2023 ) . In this work, we extend the notion of self-bias to the setting of LLM-as-Benchmark-Generator. While judge-side self-bias primarily stems from content-based self-preference ( Gu et al., 2024 ) , our experiments show that self-bias of benchmark generators arises from multiple, more intricate factors and thus requires mitigation efforts from multiple aspects * * * Unless otherwise noted, all subsequent mentions self-bias refers to that in LLM-as-Benchmark-Generator. . 3 Preliminary 3.1 Formal Definition and Verification of Self-Bias Humans tend to perform better on tests they create themselves ( Corrigan and Craciun, 2013 ; Saucier et al., 2024 ) . This motivates the necessity to investigate whether LLMs show similar self-bias when evaluated on benchmarks they generate, which previous studies have largely neglected ( Huang et al., 2024 ; Yuan et al., 2025 ) . We define R(\mathcal{M}|\mathcal{M}^{que},\mathcal{M}^{lab}) as the performance (e.g. accuracy) of model \mathcal{M} evaluated on benchmarks where questions are provided by \mathcal{M}^{que} and labels are provided by \mathcal{M}^{lab} . As different benchmarks vary in difficulty, to compare the evaluation results across them, we calculate the relative performance of \mathcal{M} with respect to K reference models \mathcal{M}^{\text{ref}}_{1:K} as follows: R\left(\mathcal{M}\mid\mathcal{M}^{\text{que}},\mathcal{M}^{\text{lab}},\mathcal{M}^{\text{ref}}_{1:K}\right)=\frac{K\cdot R\left(\mathcal{M}\mid\mathcal{M}^{\text{que}},\mathcal{M}^{\text{lab}}\right)}{\sum_{k=1}^{K}R\left(\mathcal{M}^{\text{ref}}_{k}\mid\mathcal{M}^{\text{que}},\mathcal{M}^{\text{lab}}\right)} (1) On this basis, the evaluation bias of \mathcal{M} on benchmark generated by \mathcal{M}^{\text{gen}} can be calculated as: \mathcal{B}(\mathcal{M}|\mathcal{M}^{\text{gen}})=R(\mathcal{M}|\mathcal{M}^{\text{gen}},\mathcal{M}^{\text{gen}},\mathcal{M}^{\text{ref}}_{1:K})-R(\mathcal{M}|\mathcal{M}^{\text{human}},\mathcal{M}^{\text{human}},\mathcal{M}^{\text{ref}}_{1:K}) (2) where R(\mathcal{M}|\mathcal{M}^{\text{human}},\mathcal{M}^{\text{human}},\mathcal{M}^{\text{ref}}_{1:K}) denotes the relative performance on human-annotated benchmark. Accordingly, the self-bias of \mathcal{M} can be denoted as \mathcal{B}(\mathcal{M}|\mathcal{M}) , abbr. \mathcal{B}(\mathcal{M}) . A larger value of \mathcal{B}(\mathcal{M}) indicates a greater degree of self-bias in the benchmark generated by the \mathcal{M}