Empirical parameterization of the Elo Rating System
Shirsa Maitra Tathagata Banerjee Anushka De Computer Science Engineering Dept. of Statistics & Data Science Dept. of Statistics & Data Science Heritage Institute of Technology, Kolkata National University of Singapore Northwestern University, Illinois Diganta Mukherjee Tridib Mukherjee Sampling & Of · 2025
Read Empirical parameterization of the Elo Rating System by Shirsa Maitra Tathagata Banerjee Anushka De Computer Science Engineering Dept. of Statistics & Data Science Dept. of Statistics & Data Science Heritage Institute of Technology, Kolkata National University of Singapore Northwestern University, Illinois Diganta Mukherjee Tridib Mukherjee Sampling & Of (2025) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2512-18013.txt.
Introduction
Shirsa Maitra and four coauthors revisit the Elo rating system, the numbers that rank chess players and game rivals. Elo and its cousins rest on settings picked by habit or by neat math assumptions, not by the data of the game at hand. The team asks what happens when the settings are learned from results instead.
Their method tunes the settings to maximize how well the ratings predict who wins. The same recipe can be fitted to other rating schemes and even to games with more than two players. Tests on real and simulated play show the tuned ratings track player strength well, a case for letting each game's own record set its scale.
Catalog record
| CREATOR | Shirsa Maitra Tathagata Banerjee Anushka De Computer Science Engineering Dept. of Statistics & Data Science Dept. of Statistics & Data Science Heritage Institute of Technology, Kolkata National University of Singapore Northwestern University, Illinois Diganta Mukherjee Tridib Mukherjee Sampling & Of |
|---|---|
| YEAR | 2025 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 31 KB |
| VERSION | 1.0 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2512-18013
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Empirical parameterization of the Elo Rating System Shirsa Maitra Tathagata Banerjee Anushka De Computer Science Engineering Dept. of Statistics & Data Science Dept. of Statistics & Data Science Heritage Institute of Technology, Kolkata National University of Singapore Northwestern University, Illinois Diganta Mukherjee Tridib Mukherjee Sampling & Official Statistics Unit (SOSU) Chief Data Scientist & AI Officer Indian Statistical Institute, Kolkata IDfy, India Abstract This study aims to provide a data-driven approach for empirically tuning and validating rating systems, focusing on the Elo system. Well-known rating frameworks, such as Elo, Glicko, TrueSkill systems, rely on parameters that are usually chosen based on probabilistic assumptions or conventions, and do not utilize game-specific data. To address this issue, we propose a methodology that learns optimal parameter values by maximizing the predictive accuracy of match outcomes. The proposed parameter-tuning framework is a generalizable method that can be extended to any rating system, even for multiplayer setups, through suitable modification of the parameter space. Implementation of the rating system on real and simulated gameplay data demonstrates the suitability of the data-driven rating system in modeling player performance. Keywords : Elo rating system, Parameter Tuning, Game Outcome Prediction 1 Introduction A key component of sports analytics is determining a player’s skill level in a game. Fair matchmaking, ranking and performance tracking of players and competitive integrity all depend on the quantification of player skill. Accurate skill estimation is also crucial for fraud detection, quantifying whether a game is skill or luck-based [ 14 ] , to improve player engagement, and creating balanced gaming environments in professional sports and online platforms. Many methods have been developed over time to measure player skill, and the majority of these methods rely on performance-based metrics derived from gameplay outcomes. The Elo rating system [ 3 ] has gained widespread acceptance as a standard for allocating numerical ratings that represent a player’s relative skill in two-player games like chess. After every game, these ratings are updated to reflect a player’s dynamic skill level more accurately. The Glicko [ 1 ] and Glicko-2 [ 8 ] systems are two examples of extensions of Elo that have been created and are in use in practice. These systems use rating volatility and confidence intervals to more accurately capture uncertainty over longer time periods. In this study, we propose a data-driven approach to parameter tuning in the Elo rating system. Glickman (1999) [ 2 ] introduced a state-space approach for dynamic parameter estimation, treating player strength as a time-evolving latent variable. While his work was focused on probabilistic estimation of skill volatility and uncertainty, our method takes a complementary, generalized empirical approach of optimized parameter tuning directly from data based on the predictive power [ 4 , 10 ] of player ratings. This framework can be extended to any rating system with finite parameters, such as Glicko or TrueSkill(and its advancements and variations) [ 6 , 7 , 13 ] , where only the underlying formulas and the parameter space change, but the optimization strategy remains the same. The resultant rating system is then implemented in simulated and real gameplay datasets to study its applicability in player performance modeling. This paper puts forward a comprehensive study describing the methodology of the Elo rating system for two-player games and suggests a detailed framework for parameter tuning in rating system formulations. This enables enhancing the sensitivity of rating models to specific game environments. Section 2 begins with a brief background on the Elo rating system, followed by a short subsection discussing the key assumptions underlying different rating models. This is followed by a detailed formulation of the Elo update mechanism in a two-player setting and introduces a sensitivity factor based on player experience to improve rating stabilization. Section 3 outlines the core contribution, which is our proposed parameter tuning approach, supported by concrete reasoning for our assumptions, choice of classification models, and parameters. The empirical analysis is conducted using the proposed framework on both real and simulated gameplay datasets in Section 4 . This section also serves as an illustrative example of how parameter configurations can be evaluated and their values can be optimized using our parameterization technique to identify the best values for a given rating model. Section 5 discusses the more in-depth findings and interpretations of the empirical study. We conclude the paper by providing a summary of the study’s objectives and outlining possible avenues for further research that could build on this work in section 6 . 2 The Elo Rating System 2.1 Background The Elo rating system was developed by Arpad Elo, a Hungarian-American physicist and chess master, as a mathematical method to measure the relative skill levels of players in zero-sum games. Introduced by the United States Chess Federation in 1960 and later adopted by FIDE, it replaced older, subjective ranking systems with a probabilistic model based on expected outcomes of matches. The system assumes that player performance follows a normal distribution and updates ratings dynamically based on match results. Its simplicity and accuracy made it the foundation of modern competitive ranking systems used in chess, e-sports, and various online platforms. 2.2 Assumptions in Rating System Models Most rating systems rely on specific assumptions that influence how player strength is realized from match outcomes. • Elo Rating System: The Elo system [ 3 ] assumes that player performance follows a logistic distribution centered around their latent skill level. If R_{A} and R_{B} denote the ratings of players A and B , the expected score for A is given by, E_{A}=\frac{1}{1+10^{(R_{B}-R_{A})/400}} After each game, the updated rating is computed as, R_{A}^{\prime}=R_{A}+K(S_{A}-E_{A}) where S_{A}\in\{0,0.5,1\} represents the actual outcome and K is a sensitivity factor. Elo assumes static skill between games and does not explicitly model uncertainty or volatility. • Glicko Models: The Glicko models [ 1 , 8 ] extends Elo by introducing a rating deviation (RD) , representing uncertainty and variability in a player’s skill estimate. Player skill is assumed to follow a Gaussian distribution, \theta_{i}\sim\mathcal{N}(\mu_{i},\sigma_{i}^{2}) , where \mu_{i} is the mean rating and \sigma_{i} evolves with inactivity and game outcomes. Glicko-2 further introduces a volatility parameter \tau that governs how rapidly skill can change over time, adapting to performance variance. • Microsoft’s TrueSkill: TrueSkill [ 6 ] generalizes the Elo and Glicko systems through a Bayesian framework. Instead of assigning a fixed rating, TrueSkill adopts a Bayesian approach, modelling each player’s skill as a Gaussian random variable, p_{i}\sim\mathcal{N}(\mu_{i},\sigma_{i}^{2}) , where \mu_{i} represents the estimated skill mean and \sigma_{i} encodes uncertainty about that estimate. In a two-player setting, the probability that player i defeats player j is given by: P(i\text{ wins})=\Phi\!\left(\frac{\mu_{i}-\mu_{j}}{\sqrt{2(\sigma_{i}^{2}+\beta^{2})}}\right) where \Phi(\cdot) is the cumulative density of the standard normal distribution, and \beta represents the random performance variance during a game. After each match, both \mu_{i} and \sigma_{i} are updated using approximate Bayesian updation, allowing the model to dynamically capture improvement, learning, and uncertainty reduction over time. Unlike Elo or Glicko, which assume scalar and independent rating updates, TrueSkill naturally extends to multiplayer or team-based games by inferring posterior skill distributions jointly from all participants’ outcomes. TrueSkill-2 [ 7 ] further refines this process by enabling multidimensional skill vectors and real-time volatility adaptation, at the cost of increased computational complexity and reduced