A Unified Perturbation Framework for Analyzing Leaderboard Stability and Manipulation

Hosna Oyarhoseini, Jimmy Lin, Amir-Hossein Karimi · 2026

Read A Unified Perturbation Framework for Analyzing Leaderboard Stability and Manipulation by Hosna Oyarhoseini, Jimmy Lin, Amir-Hossein Karimi (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-15761.txt.

Introduction

Hosna Oyarhoseini, Jimmy Lin and Amir-Hossein Karimi probe how easily model leaderboards built from pairwise human votes can be shifted. Their test set drops, adds or flips single matches and removes players. They track top-rank spots, global rank order and error bars. Across Chatbot Arena and six other sets, targeted shifts under one percent moved the top model, hurt rank order and moved error bars. The same influence scores also let attackers push chosen models up or down with few moves.

Catalog record

CREATORHosna Oyarhoseini, Jimmy Lin, Amir-Hossein Karimi
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE89091
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2605.15761

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

A Unified Perturbation Framework for Analyzing Leaderboard Stability and Manipulation Hosna Oyarhoseini, Jimmy Lin, Amir-Hossein Karimi Abstract Evaluation leaderboards such as LMArena play a central role in benchmarking large language models by aggregating pairwise human preferences into model rankings, yet the robustness of these rankings remains poorly understood. We present a unified perturbation framework for analyzing Bradley–Terry leaderboards under structured data modifications using influence-based approximations. Our framework studies three match-level perturbations— Drop , Add , and Flip —together with player removal, and evaluates their effects on top- k k membership , global ranking consistency via Kendall’s τ \tau , and confidence-interval-based uncertainty . Across Chatbot Arena and six additional pairwise-comparison datasets, we show that modern leaderboards are non-robust across all three objectives: sub-1% targeted perturbations can change the top-ranked model, degrade Kendall’s τ \tau , and alter confidence intervals. Beyond robustness auditing, we show that the same influence scores enable efficient targeted perturbations, promoting or demoting specific models and reducing target-model uncertainty with fewer actions than previous manipulation and active-sampling baselines. By summarizing these effects with normalized dataset-level robustness scores, our framework provides a practical and helpful tool for auditing leaderboard stability and motivating more robust evaluation protocols. 1 Introduction The rapid proliferation of Large Language Models (LLMs) has necessitated the development of scalable, human-centric evaluation frameworks ( 20 ; 42 ; 64 ; 25 ) . Because the quality of open-ended generation is subjective and hard to capture with a single absolute metric, modern platforms have increasingly adopted pairwise preference comparisons, where judges choose between two model outputs. In systems such as LMArena/Chatbot Arena, these preferences are primarily collected from human voters ( 11 ) , though LLM-based judges are also increasingly used in related evaluation settings ( 64 ) . This paradigm builds on a classical approach for ranking items from direct comparison outcomes ( 8 ; 43 ; 60 ; 51 ) , but has recently become a central pillar of LLM benchmarking ( 64 ; 11 ) . Most notably, Chatbot Arena ( 12 ) uses Bradley–Terry scores derived from crowdsourced votes to produce model rankings. Beyond leaderboard evaluation, Bradley–Terry models are also underpinned to reward model training for RLHF ( 44 ; 4 ; 36 ; 56 ; 62 ; 54 ) and have been used to route queries to suitable LLMs or inference-time scaling strategies ( 14 ) . As these leaderboards increasingly shape model adoption and industry recognition ( 40 ; 35 ; 53 ) , they are often treated as stable estimates of true model skill. Recent work challenges this assumption ( 28 ; 41 ; 29 ; 53 ; 61 ) . 28 show that removing only a small number of pairwise comparisons can alter top rankings, while other studies identify vulnerabilities from injected votes ( 41 ) , gamed LLM judges ( 65 ; 49 ) , apathetic or arbitrary annotators ( 63 ) , and data leakage or selective reporting ( 53 ) . However, existing analyses typically focus on a single perturbation type or ranking objective. This leaves open a broader question: how do different small, structured changes to the comparison dataset propagate through different leaderboard outcomes? We address this question by building on ( 28 ) ’s idea with a unified influence-based perturbation framework for Bradley–Terry leaderboards. Our framework treats dataset modifications as structured interventions and propagates their effects through the ranking estimator to downstream leaderboard conclusions. This allows us to study both robustness failures and targeted interventions within the same formalism, including match-level perturbations and player-level removal motivated by model deprecation or exclusion. Our main contributions are: • We introduce a unified influence-based framework for auditing Bradley–Terry leaderboards under three match-level perturbations— Drop , Add , and Flip —instantiated for three ranking objectives: top- k membership , Kendall’s \tau for global consistency, and confidence-interval-based uncertainty for the reliability of estimated skills. • Across seven pairwise-comparison datasets, we show that leaderboard non-robustness is systematic across datasets, perturbation type , and ranking criteria: fewer than 1% of comparisons substantially affect top- k membership , Kendall’s \tau , and CI-based stability. We also aggregate influence-guided failures into normalized dataset-level robustness scores, giving a compact audit profile across Top- k , CI-aware, and global-ranking views. • The same framework supports targeted interventions, promoting or demoting specific models with fewer actions than prior vote-manipulation ( 41 ) and identifying matchups that reduce uncertainty more effectively than Chatbot Arena-style active sampling ( 12 ) . • A player-removal analysis shows that removing influential players can induce broad reordering, highlighting model deprecation as a source of the leaderboard illusion ( 53 ) . Overall, this work provides a unified perspective on leaderboard non-robustness by bridging robustness analysis and adversarial manipulation, revealing fundamental limitations in current leaderboard designs and highlighting the need for more reliable and trustworthy benchmarking methodologies. 2 Preliminaries 2.1 Pairwise comparison and Bradley–Terry framework Modern LLM leaderboards rank models from pairwise preference data rather than absolute scores. In this setting, each player denotes an entity being ranked; for LLM leaderboards, a player corresponds to an LLM or model. A match or vote denotes one pairwise comparison between two players, typically obtained when a human or judge compares two model responses to the same prompt and selects the preferred output. These comparisons are commonly modeled using the Bradley–Terry (BT) framework ( 8 ) , which estimates latent skill scores from pairwise outcomes. We adopt the notation of ( 11 ) , defining a set of M models \mathcal{M}=\{m_{1},\dots,m_{M}\} and a dataset D=\{z_{n}\}_{n=1}^{N} . Each observation z_{n}=(x_{n},y_{n}) compares two players (i_{n},j_{n}) , where x_{n}=e_{i_{n}}-e_{j_{n}}\in\mathbb{R}^{M} encodes the matchup and y_{n}\in\{0,1\} indicates whether i_{n} beats j_{n} . For a comprehensive breakdown of the data format and our specific protocol for handling ties, please refer to Appendix B.1 . The BT model assigns each model m_{i} a scalar latent skill coefficient \theta_{i}\in\mathbb{R} . For comparison n , let (i,j) denote the ordered pair of models being compared, and let y_{n}=1 indicate that model i is preferred to model j . The Bradley–Terry probability is \displaystyle p_{n} \displaystyle:=P(y_{n}=1\mid i,j;\theta) (1) \displaystyle=\sigma(x_{n}^{\top}\theta)=\sigma(\theta_{i}-\theta_{j}) \displaystyle=\frac{1}{1+e^{-(\theta_{i}-\theta_{j})}}. To ensure identifiability against constant shifts, we fix \theta_{1}=0 . The parameter vector \theta is estimated by minimizing the empirical binary cross-entropy loss: \displaystyle\hat{\theta} \displaystyle=\arg\min_{\theta}\sum_{n=1}^{N}\ell(z_{n};\theta) (2) \displaystyle=\arg\min_{\theta}\sum_{n=1}^{N}\big[-y_{n}\log p_{n} \displaystyle-(1-y_{n})\log(1-p_{n})\big]. 2.2 Influence functions and propagation to objectives Previous work has used influence scores to identify high-impact deletions under a fixed budget ( 9 ) . Building on this idea, we study how perturbing individual BT comparisons affects both the estimated skills and downstream leaderboard conclusions. Let w\in\mathbb{R}^{N} denote match weights and define the weighted BT estimator \hat{\theta}(w)=\operatorname*{arg\,min}_{\theta:\theta_{1}=0}\sum_{n=1}^{N}w_{n}\ell(z_{n};\theta), (3) where w=\mathbf{1} gives the full-data fit and w_{n}=0 removes match z_{n} . Let \hat{\theta}=\hat{\theta}(\mathbf{1}) , g_{n}=\nabla_{\theta}\ell(z_{n};\hat{\theta}) , and H=\nabla_{\theta}^{2}\sum_{n=1}^{N}\ell(z_{n};\hat{\theta}) . Influence functions approximate the local effect of changing a match weight without refitting ( 34 ) : \frac{\partial\hat{\theta}(w)}{\partial w_{n}}\Big|_{w=\mathbf{1}}=-H^{-1}g_{n}. (4) We propagate this parameter sensitivity to a scalar leaderboard objective f(\hat{\theta}(w),w) , such as a top- k membership , Kendall’s \tau surrogate, or confidence-interval-based uncertainty criterion. Allowing explicit dependence on w captures objectives, such as uncertainty, that change directly with the weighted comparison graph. The objective-level influence of match z_{n} is \begin{gathered}I^{(f)}_{n}:=\nabla_{\theta}f(\hat{\theta}(w),w)^{\top}\frac{\partial\hat{\theta}(w)}{\partial w_{n}}+\frac{\partial f(\hat{\theta}(w),w)}{\partial w_{n}},\\[2.0pt] f(\hat{\theta}(w+\Delta w),w+\Delta w)\approx

Read the complete text