Beyond Winning: Margin of Victory Relative to Expectation Unlocks Accurate Skill Ratings
Shivam Shorewala, Zihao Yang · 2025
Read Beyond Winning: Margin of Victory Relative to Expectation Unlocks Accurate Skill Ratings by Shivam Shorewala, Zihao Yang (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2506-00348.txt.
Introduction
Shivam Shorewala and Zihao Yang argued in 2025 that skill ratings in competitive games improve when they use not just who won, but by how much compared with expectation. Classic ratings like Elo ignore margin entirely. Existing margin-based fixes lack a principled way to fold the information in. Their method learns a curve that predicts expected margin from the rating gap, including saturation and home advantage.
The update signal is the gap between the real margin and the expected one. Tested on over thirteen thousand NBA games across a decade, the method beat standard Elo and strong Bayesian rivals. It cut prediction error, raised accuracy slightly, and reached stable ratings about thirteen percent faster, all at Elo-like computing cost.
Catalog record
| CREATOR | Shivam Shorewala, Zihao Yang |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 33 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2506-00348
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Beyond Winning: Margin of Victory Relative to Expectation Unlocks Accurate Skill Ratings Shivam Shorewala, Zihao Yang Abstract Knowledge of accurate relative skills in any competitive system is essential, but foundational approaches such as ELO discard extremely relevant performance data by concentrating exclusively on binary outcomes. While margin of victory (MOV) extensions exist, they often lack a definitive method for incorporating this information. We introduce Margin of Victory Differential Analysis (MOVDA), a framework that enhances traditional rating systems by using the deviation between the true MOV and a modeled expectation . MOVDA learns a domain-specific, non-linear function (a scaled hyperbolic tangent that captures saturation effects and home advantage) to predict expected MOV based on rating differentials. Crucially, the difference between the true and expected MOV provides a subtle and weighted signal for rating updates, highlighting informative deviations in all levels of contests. Extensive experiments on professional NBA basketball data (from 2013 to 2023, with 13,619 games) show that MOVDA significantly outperforms standard ELO and Bayesian baselines. MOVDA reduces Brier score prediction error by 1.54% compared to TrueSkill, increases outcome accuracy by 0.58%, and most importantly accelerates rating convergence by 13.5%, while maintaining the computational efficiency of the original ELO updates. MOVDA offers a theoretically motivated, empirically superior, and computationally lean approach to integrating performance magnitude into skill rating for competitive environments like the NBA. I Introduction Quantifying skill and predicting outcomes in competitive scenarios, such as professional sports leagues [ 1 ] and multiplayer online games [ 2 ] to evaluating AI agents [ 3 ] is a fundamental challenge with broad implications. Rating systems aim to solve this by inferring latent skill from observed performances. The ELO system [ 4 ] is one of the most praised tools for its elegant simplicity and interpretability. However, the ELO system’s reliance on only binary win-loss results acts as a choke point. Standard ELO treats close call wins the same as blowout wins and thus ignores information about the magnitude of performance [ 5 ] . Losing this information creates large gaps in predictive accuracy and causes ratings to converge slower to true skill levels, especially as ratings evolve in dynamic environments [ 6 ] . Recognizing this deficiency, previous works have explored incorporating the margin of victory (MOV). These existing attempts often rely on ad-hoc heuristics, such as directly scaling ELO’s K-factor by the raw MOV [ 7 , 8 ] . These approaches lack a systematic way to determine how much margin is expected given the competitors’ relative skill, rendering the raw MOV a potentially noisy and uncalibrated signal. Moreover, it still leads to an increase in the winning team’s ELO even if the victory was not decisive, as their initial ELO difference might have indicated. At the same time, sophisticated Bayesian systems like Glicko-2 [ 9 ] or TrueSkill [ 2 ] model uncertainty effectively but primarily focus on outcome probabilities and often have significant computational overhead, typically do not explicitly model the expected performance margin itself. Therefore, a key gap persists: a method that integrates MOV information within an efficient ELO-like framework, based on a principled, learned model of expected performance margin. This paper introduces Margin of Victory Differential Analysis (MOVDA), a unique approach designed to effectively fill this gap. MOVDA is grounded in the principle of comparing observed performance against a learned and context-aware expectation. We first model the expected MOV ( E_{MOV} ) as a non-linear function (specifically, a scaled hyperbolic tangent) of the pre-match rating difference ( \Delta R ), incorporating domain-specific factors such as home advantage. This function is calibrated on historical data. The core insight is to use the resulting differential, \Delta_{MOV}=T_{MOV}-E_{MOV} (where T_{MOV} is the true observed margin), as an extremely rich, informative signal for refining rating updates. Our contributions are: 1. Principled Expected MOV Modeling: We suggest and validate a theoretically motivated functional form (scaled hyperbolic tangent) to model expected MOV. This captures non-linearity based on rating differentials and different contexts. 2. MOV Differential Rating Update: We develop an innovative ELO update rule that adaptively utilizes the MOV differential ( \Delta_{MOV} ), to provide a signal beyond the binary outcomes while importantly retaining the core ELO structure. 3. Significant Empirical Improvement on NBA Data: We then demonstrate through extensive experiments on 13,619 professional NBA games (from 2013 to 2023) that MOVDA significantly outperforms standard ELO and other baselines like TrueSkill. Specifically, MOVDA achieves a 1.54% lower Brier score (indicating better probabilistic predictions), 0.58% higher outcome accuracy, and most importantly a 13.5% convergence of ratings, allowing for extremely fast adaptation to changes in teams’ abilities while keeping the same computational efficiency as the original ELO. The structure of this paper is as follows. Section II situates our work in the relevant literature on rating systems within a wider context. Section III formalizes the existing ELO framework to provide a benchmark. Section III-A introduces our contribution, our MOVDA framework, and outlines both its theoretical foundations and practical implications. Section IV offers a complete empirical evaluation. Section V considers broader implications and acknowledges key limitations. Finally, Section VI concludes the paper and proposes future potential directions. II Related Work Our work builds upon a substantial body of research on the design of rating systems. We group relevant literature into three primary pillars: (i) foundational ELO-based models, (ii) methods that incorporate margin of victory information, and (iii) probabilistic and Bayesian extensions. II-A Foundational Rating Systems The ELO framework [ 4 ] has long been a dominant method for competitive ranking systems, across domains from chess to esports. The ELO model, fundamentally, is a model of win probability as a logistic function of the rating differential and it updates a rating linearly based on observed outcomes. The ELO system has been successfully applied across many domains because its practical applicability, ease of interpretation, and computational efficiency. Subsequent work has proposed numerous extensions the base ELO model, such as adaptive scaling constants ( c ), dynamic K-factors [ 7 ] , and context-aware adjustments. Theoretical treatments often recast ELO as a maximum likelihood estimator under parametric assumptions [ 9 ] , or relate it to the Bradley–Terry model for paired comparisons. The standard ELO is binary, simply limited to win/loss results, and and does not account for the margin or quality of performance in its updates. II-B Incorporating Margin of Victory It is now substantial evidence that margin of victory (MOV) has a significant informative signal. Early approaches incorporate the MOV via rule-based adjustments to the ELO update. A common idea is scaling the K-factor in proportion to the observed margin, thereby amplifying rating updates due to blowout outcomes. [ 7 ] . Hvattum [ 6 ] applied such techniques in the domain of soccer, where they used goal difference to result in modest gains to the predictive accuracy. Similarly, Gill [ 8 ] examined MOV based K-factor scaling in basketball, demonstrating empirical improvements. While these methods validate the value of incorporating MOV, they lack a principled mechanism for modeling the expected margin. As a result, they conflate the predictable dominant wins that are the result of a large skill gap with true overperformance, introducing variance that can distort rating updates. Parallel work in sports analytics has sought