Comparison of probabilistic nowcasts and forecasts of SARS-CoV-2 variant proportions made by hierarchical multinomial linear regression models
Isaac MacArthur, Thomas Robacker, Evan L. Ray, Benjamin W. Rogers, Nicholas G. Reich, Maryclare Griffin · 2026
Read Comparison of probabilistic nowcasts and forecasts of SARS-CoV-2 variant proportions made by hierarchical multinomial linear regression models by Isaac MacArthur, Thomas Robacker, Evan L. Ray, Benjamin W. Rogers, Nicholas G. Reich, Maryclare Griffin (2026) in the Tower of Babel, a free online library of public-domain works preserved in clean, searchable text. No sign-up. The full text is served as a plain-text file at a predictable URL, where text is present: https://antarctic-labs.com/tower-of-babel/arxiv-2605-22676.txt.
Introduction
MacArthur and others compare probabilistic nowcasts and forecasts of SARS-CoV-2 variant shares built from hierarchical multinomial logistic regression. Using two years of weekly retrospective predictions through the United States Variant Nowcast Hub framework, they test 12 model variants against a baseline. The hierarchical models beat the baseline on both probabilistic accuracy, measured by energy score, and point accuracy, measured by Brier score. Gains grow with data volume and model complexity in data rich places, while simpler variants win where data are thin, and no single model leads on every metric.
Catalog record
| CREATOR | Isaac MacArthur, Thomas Robacker, Evan L. Ray, Benjamin W. Rogers, Nicholas G. Reich, Maryclare Griffin |
|---|---|
| YEAR | 2026 |
| COLLECTION | PAPERS |
| FORMAT | TXT |
| FILE SIZE | 66345 |
| LICENSE | http://creativecommons.org/licenses/by/4.0/ |
| RIGHTS | CC BY |
| SOURCE | arXiv |
Source: https://arxiv.org/abs/2605.22676
Browse the full library · About the Tower of Babel
Full text
The opening of the work, from the library's hosted text:
Comparison of probabilistic nowcasts and forecasts of SARS-CoV-2 variant proportions made by hierarchical multinomial linear regression models Isaac MacArthur, Thomas Robacker, Evan L. Ray, Benjamin W. Rogers, Nicholas G. Reich, Maryclare Griffin Abstract Nowcasting and forecasting of infectious diseases have become increasingly important since the SARS-CoV-2 pandemic. In particular, methods for modeling the composition of circulating variants at a given time have seen more use in part due to a large increase in the frequency of genomic sequencing conducted as a part of routine surveillance. However, methods must take into account that locations have different amounts of data and sometimes have different trends. We discuss hierarchical multinomial logistic regression (HMLR), a commonly used method for forecasting SARS-CoV-2 variants, which allows for data sharing across locations. We show how it has been used in the literature, and define a class of HMLR models for SARS-CoV-2 variant nowcasting and forecasting. We rigorously test a subset of this class of models using the framework of the US SARS-CoV-2 Variant Nowcast Hub, a collaborative modeling project that launched in 2024. We created two years of weekly predictions based on retrospective datasets, with the prediction dates ranging from Wednesday, August 3, 2022, to Wednesday, August 7, 2024. We tested 12 HMLR models against a baseline model on these datasets. We found that the HMLR models outperformed the baseline both in terms of probabilistic accuracy, as measured by the energy score, as well as point accuracy, as measured by the Brier score. Overall, we find that HMLR models perform best with respect to the baseline model in locations with more data, and more complex HMLR models also showed more improvement in those high-data locations; however, there was no one best model across all metrics, and simpler HMLR models perform better in low-data locations. We find that HMLR models perform well in practice for nowcasting and forecasting SARS-CoV-2 variants. Key Contribution : We build off of work exploring the ability of models to capture the spread of different strains of infectious diseases. In particular, we define a class of popular statistical regression models and rigorously test their ability to accurately predict SARS-CoV-2 (COVID-19) variant proportions at the US state level. We evaluate the models both in terms of their average prediction error and their prediction uncertainty. 1 Introduction Forecasting and nowcasting of pathogen prevalence, as measured through genomic sequence data, has taken on increased importance due to the rise of new epidemic threats such as SARS-CoV-2 (the virus that causes COVID-19). Pathogens evolve and change over time, leading to the emergence of different variants, subtypes, or clades. As was seen during the COVID-19 pandemic, different variants can cause different public health burdens [ 13 , 26 ] . Therefore, accurate assessments of variant proportions in specific locations are one component of a well-informed public health response to outbreaks. This paper describes a class of hierarchical multinomial regression models that have been designed to nowcast (predict incomplete observations in the present and recent past) and forecast (predict observations in the future) variant proportions across multiple locations and compares the performance of different models in this class. This hierarchical structure is useful when there are wide disparities in quantities of data across locations or when not all locations observe all of the possible targets we are interested in. A key feature of these models is that the hierarchical structure allows for adaptive data sharing across locations, which lets locations with more data inform trends in locations with less data while still allowing for variation across locations [ 8 , 24 ] . Additionally, these models produce probability distributions for all locations that reflect nowcast and forecast uncertainty. Several data quality issues complicate the use of models for nowcasting and forecasting variant proportions across locations. One data quality issue is delayed reporting. Variant identification requires a viral specimen, such as a nasal swab, which then must be analyzed in a laboratory. Because the specimen collection, testing, and sequencing process takes time, obtaining complete real-time data is impossible. This leads to the need for models that can nowcast or forecast with reasonable accuracy using incomplete data, with recent data being most limited [ 17 ] . Another data quality issue is the quantity of sequences analyzed, which, for COVID-19, has decreased dramatically over time (Figure 1 ). This means that models have to create predictions with very sparse data. In 2022, there was an average of approximately 2,900 daily sequences reported across the United States. In 2024 up to November 4th, which is the last date we have data in that year when the data for this paper were finalized, there were approximately 265 daily sequences collected. Over just two years, sequences have dropped by an order of magnitude. Data quantity issues are magnified when attempting to make predictions at resolutions below the country level, e.g., at the state level in the US. That is because there is less data at these resolutions, and the data quantity and availability can vary dramatically by state (Figure 1 ). Lower counts of data can lead to noisier proportions which can be harder to model. Figure 1: Number of sequences per week for each of the 50 states, Puerto Rico, and Washington D.C. from the first MMWR week of 2022 to the week of November 4, 2024. Top : Data shown on natural scale; each line is a state. There is a large drop in the number of sequences after 2022 and the magnitudes of sequence counts vary widely across states. Bottom : Data shown on the logarithmic scale. Each state is shown separately with a gray line, with the median log number of sequences per week shown in a thicker red line. The log of the total data per week is shown in blue. Multinomial logistic regression (MLR) is often used to model SARS-CoV-2 variants [ 3 , 6 ] . These models assume the counts of the variants follow a multinomial distribution with probabilities that are often modeled as linear in time on the logit scale. To account for the differences across locations, hierarchical multinomial logistic regression (HMLR) can be used to allow for data sharing, which is an approach that has been used in the literature to model variants at the country level [ 22 , 1 ] . In this paper, we create a taxonomy for HMLR models that have been used to predict SARS-CoV-2 variant prevalences, review existing HMLR models in the literature, introduce several HMLR model variations, and compare their performance on retrospective datasets. We split this paper into the following sections. Section 2 gives a brief introduction to genomic SARS-CoV-2 data and how we created the retrospective datasets. Section 3 gives an overview of MLR and HMLR models and how they have previously been used in the literature, and introduces a framework for a general class of HMLR models. Section 4 contains a motivating example applying the framework to modeling state-level SARS-CoV-2 variant prevalences and evaluating models’ performance. Section 5 provides a brief discussion on the HMLR models and possible next steps. 2 Data Comparing nowcast and forecast performance of multiple models for SARS-CoV-2 variant prevalences requires careful construction of training and evaluation data that reflect the