Bayesian Uncertainty Quantification for Ranked Choice Voting Polls

Evan T. R. Rosenman Jason Liang Department of Mathematical Sciences Claremont McKenna College Claremont, CA, United States · 2026

Read Bayesian Uncertainty Quantification for Ranked Choice Voting Polls by Evan T. R. Rosenman Jason Liang Department of Mathematical Sciences Claremont McKenna College Claremont, CA, United States (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2606-31022.txt.

Introduction

Evan Rosenman and Jason Liang give pollsters a way to state uncertainty for ranked choice elections. Under ranked choice, voters list candidates in order. The count then eliminates the weakest candidates round by round. Their votes move to each voter's next choice. A win is not a single population parameter. So the usual margin of error has no clear meaning. The elimination order shapes the outcome.

The authors propose a simple Bayesian framework. It estimates each candidate's probability of winning. A conjugacy relationship lets those probabilities be conditioned on poll results. They apply it to two contests. One is the 2021 New York City Democratic mayoral primary, where Eric Adams narrowly beat Kathryn Garcia. The other is Alaska's 2022 House election. Mary Peltola won it despite not being the Condorcet winner. Cast vote records expose the failures of frequentist measures. A poll of the New York race demonstrates the method.

Catalog record

CREATOREvan T. R. Rosenman Jason Liang Department of Mathematical Sciences Claremont McKenna College Claremont, CA, United States
YEAR2026
COLLECTIONPAPERS
FORMATTXT
FILE SIZE79 KB
LICENSEhttp://creativecommons.org/licenses/by/4.0/
RIGHTSCC BY
SOURCEarXiv

Source: https://arxiv.org/abs/2606.31022

Browse the full library · About the Tower of Babel

Full text

The opening of the work, from the library's hosted text:

Bayesian Uncertainty Quantification for Ranked Choice Voting Polls Evan T. R. Rosenman Jason Liang Department of Mathematical Sciences Claremont McKenna College Claremont, CA, United States Abstract Ranked choice voting (RCV) is a popular alternative voting method in which voters are asked to list their favored candidates in preference order, rather than vote for a single candidate. When these ballots are tabulated, candidates are successively eliminated, and their votes are reallocated to each voter’s next-preferred choice. The process continues until a single candidate commands a majority of the active ballots and is declared the winner. As RCV gains wider adoption, the method poses novel challenges for pollsters. Unlike traditional, plurality elections, the event that a given candidate wins cannot be expressed in terms of a single population parameter. Hence, the basic concept of a margin-of-error is no longer straightforward to define. Moreover, a candidate’s ability to win may depend on both their support across the ballot and the order by which other candidates are eliminated. Existing measures of sampling uncertainty for polls of RCV elections do not clearly quantify these path-dependent outcomes. Here, we propose a simple, Bayesian framework to quantify uncertainty in polls of RCV elections. We cast the problem as one of estimating win probabilities for each leading candidate, and leverage a simple conjugacy relationship to estimate these probabilities conditional on the poll results. We also include applied analyses involving two prominent ranked choice voting elections: the 2021 New York City Democratic mayoral primary, in which Eric Adams narrowly defeated Kathryn Garcia in the final round; and the 2022 special election to Alaska’s U.S. House seat, in which Mary Peltola was elected despite not being a Condorcet winner. Using the cast vote records from both elections, we demonstrate some of the challenges of traditional frequentist uncertainty quantification in RCV polls. We also demonstrate the utility of our approach using a poll of the NYC primary obtained from the polling firm Data for Progress. 1 Introduction Ranked choice voting (RCV) is an increasingly popular electoral system, in which voters are asked to rank their favored candidates in order rather than select a single choice. Voters can express more complex preferences using RCV, and its advocates frequently tout the potential to improve electoral representation and responsiveness ( Vishwanath, 2025 ) . The method has been widely adopted in the United States, and is now used for all federal and state-level elections in Alaska and all federal elections in Maine, as well as municipal elections and primaries in cities such as New York City, San Francisco, Portland, and Minneapolis. In tabulations for ranked choice voting elections, ballots are initially assigned to their first-ranked candidate. If no candidate receives a majority of the first-choice votes, the candidate with the least first-choice support is eliminated and the candidates ranked after the eliminated candidates on any ballot each move up one spot. For example, in tabulations following the elimination of a voter’s top-ranked candidate, their second-ranked candidate becomes top-ranked, their third-ranked candidate becomes second-ranked, and so on. In each round of eliminations, the highest-ranked non-eliminated candidate becomes the first choice of each ballot. Once all candidates on a ballot have been eliminated, that ballot is considered “exhausted” and no longer counts toward the vote totals in future rounds. The rounds of elimination and retallying continue until one candidate secures a majority of the active ballots. See Santucci, 2021 for a detailed explanation of RCV and some variations. RCV elections differ from traditional, plurality elections in that the election winner’s victory depends on both how frequently candidates are ranked at the top of ballots and the relative rankings of different frontrunners across ballots. Statistically, this means that RCV election outcomes cannot be expressed as a function of a single population parameter. Moreover, unlike in plurality elections, the event that a candidate wins the election is a union of several disjoint pathways to victory. Hence, traditional frequentist tools for summarizing polling uncertainty, such as the margin-of-error, cannot be straightforwardly adapted to RCV elections. This poses a methodological challenge for survey analysts as they seek to report inferential results for polls conducted on RCV elections. In this paper, we propose a simple Bayesian framework for quantifying uncertainty in ranked choice voting polls. We formulate the problem in terms of “ballot orderings,” the unique possible ways a voter can rank a set of candidates. For example, in an RCV election with candidates A, B, and C, a voter may rank A first, B second, and C third; rank only A; or rank B followed by C. Each option corresponds to a unique ballot ordering. The observed frequencies of these orderings are sufficient statistics for the underlying population proportions, which in turn uniquely determine the RCV winner. Moreover, we can naturally model the voters as independent and identically distributed draws from a multinomial distribution over the set of possible ballot orderings. Using a well-known conjugacy relationship, we can obtain a posterior Dirichlet distribution over the ballot orderings when conditioning on the polling data, even if we default to a flat prior over ballot orderings. Sampling from the posterior gives a straightforward way to estimate the probability that each candidate triumphs in the eventual election. Throughout, we consider two recent elections which demonstrate the path-dependent nature of candidate elimination – and thus the challenges of uncertainty estimation – in ranked choice voting polls. The first election is the June 22, 2021 Democratic mayoral primary in New York City, in which Brooklyn Borough President Eric Adams won the final round by a narrow 0.8% margin. Many pre-election polls had suggested his competitor in the final round would be civil rights attorney Maya Wiley, whom Adams would have defeated comfortably, but Wiley was actually eliminated in the second-to-last round. Instead, former NYC Sanitation Commissioner Kathryn Garcia advanced to the final round and nearly defeated Adams. The second election is the August 16, 2022 U.S. House special in Alaska, which resulted in the election of Democrat Mary Peltola to Congress. The election exhibits an extreme form of path dependency: the first-eliminated candidate, Nick Begich III, actually would have defeated Peltola in a head-to-head election. For both elections, we use the cast vote record (CVR) – electronic records that list the full set of rankings for each voter who cast a ballot – to simulate unbiased polls ( Kuriwaki et al., 2024 ; Shirani-Mehr et al., 2018 ) . For the New York City race, we also obtain individual-level response data from the final poll conducted by the outlet Data for Progress, which correctly identified that Garcia would be highly competitive with Adams if she made it to the final round ( Data for Progress Tech Team, 2021 ) . The remainder of this paper proceeds as follows. Section 2 provides relevant background, including a literature review, notation and assumptions, and an introduction to the datasets for Alaska and NYC elections. Section 3 considers the challenges in using standard frequentist tools to assess uncertainty in ranked choice voting polls. Section 4 introduces our method, and Section 5 demonstrates its utility on the Alaska and NYC elections. Section 6 concludes. 2 Background 2.1 Notation & Assumptions In the sections to follow, we suppose we sample i=1,\dots,n

Read the complete text