Utilizing virus genomic surveillance to predict vaccine effectiveness Authors: Jiye Kwon, Ke Li, Joshua L. Warren, Sameer Pandya, Anne M. Hahn, Yale SARS-CoV-2 Genomic Surveillance Initiative, Virginia E. Pitzer, Daniel M. Weinberger, Nathan D. Grubaugh, Joel Wertheim, Joel Wertheim, Joel Wertheim, Joel Wertheim Published: 2026 ABSTRACT BackgroundSince the development of the first vaccines targeting the original SARS-CoV-2 virus sequence in 2020, mRNA-based vaccines have been updated three times: targeting Omicron BA.4/BA.5 in 2022, the XBB lineage in 2023, and the KP.2 variant in 2024. While genomic surveillance has advanced our understanding of pathogen diversity, gaps remain in incorporating genomic information to evaluate vaccine effectiveness (VE) against emerging variants. This study aims to characterize the relationship between VE and sequence-based genetic distance, to establish a framework for predicting near real-time changes in the level of vaccine protection from virus surveillance data.MethodsWe analyzed 10,156 whole genome sequences of SARS-CoV-2 cases from Connecticut, USA, between April 2021 to July 2024. We first assessed how genetic distance, specifically the number of amino acid substitutions in the spike gene between COVID-19 case sequences and the mRNA vaccine formulation sequence(s), correlates with vaccine protection levels. Incorporating data from over 1 million test-negative controls, we developed a Bayesian time-varying model with autoregressive terms to assess VE at a weekly level. The analysis was adjusted for ZIP-code-level income, age, sex, and prior vaccine doses received. We then employed a random effects meta-regression to explore the relationship between VE and amino acid distance over time. Finally, we used the meta-regression model to estimate potential vaccine protection against emerging variants.FindingsWe found that spike gene amino acid distance showed a negative correlation with VE over time. Stepwise increases in amino acid distance aligned with sharp VE declines during variant emergence, while accumulation of within-variant changes was also associated with gradual VE decline. Each 10 amino acid increase in distance in the spike gene corresponds to a predicted 15.4% (95% credible intervals (CrI): –2.0%, 34.6%) reduction in VE. For the 2023/24 updated vaccine, spike distance rose from 12.25 to 30.23, predicting a 43.4% (95% CrI: –5.7%, 90.1%) drop in VE using sequence information alone.ConclusionOur framework quantifies how the emergence of new variants is expected to affect VE for SARS-CoV-2. By quantifying the relationship between amino acid substitutions and time-varying VE, we leverage intrinsic pathogen features, such as spike amino acid distance, to inform future vaccine updates using genomic sequences. As genomic surveillance data becomes more widely available across pathogens, this framework can serve as a near-real time surveillance tool to infer population-level protection and offers valuable insights for vaccine update decisions. Introduction The antigenic evolution of pathogens, particularly RNA viruses, presents a persistent challenge for disease control and remains a major contributor to global disease burden [1–3]. As viruses evolve to escape population immunity, they can repeatedly infect individuals, potentially fueling recurrent epidemics [2,4]. Viral evolution and epidemiology are deeply interconnected, with transmission both driving and being shaped by viral adaptation [2,5]. Achieving population-level immunity through vaccination is a critical public health strategy [6]. However, when immunity is strain-specific, it leads to opportunities for viral adaptation through immune escape [7–9]. The resulting decline in population-level vaccine effectiveness (VE) necessitates periodic updates for certain vaccines. Influenza viruses serve as a well-established example, with global surveillance data guiding regular vaccine updates to maintain protection [10,11]. More recently, the rapid evolution of SARS-CoV-2 highlights yet another need for frequent vaccine updates. However, COVID-19 vaccine updates have been undertaken annually and largely ad hoc. This reflects a broader issue. As vaccines are developed for these and other fast-evolving viruses, determining when and how to update them—and what data should inform these decisions—remains a critical challenge. Addressing this gap is crucial for maintaining VE and optimizing long-term disease control. In the United States (US), the Advisory Committee on Immunization Practices (ACIP) issues recommendations for the use of updated COVID-19 mRNA vaccines, guided by a rigorous evaluation of VE data in conjunction with clinical, epidemiological, safety, and economic evidence [12]. The timeline for the 2024/25 COVID-19 vaccine update illustrates this process [13]. The 2023/24 XBB.1.5 mRNA vaccine became available in September 2023 [14]. In February 2024, ACIP reviewed VE data from the VISION and IVY networks [15], supplemented by genomic surveillance on SARS-CoV-2 lineage proportions (e.g., XBB, JN.1) from the Centers for Disease Control and Prevention (CDC) [15]. In June 2024, ACIP unanimously recommended the 2024/25 KP.2 mRNA vaccine formula for all individuals above 6 months old [12]; the Food and Drug Administration (FDA) gave full approval to the updated mRNA vaccines from Moderna and Pfizer in August 2024 [16]; and the vaccines became available to the public by October 2024 [17]. However, important gaps remain. Reduced VE of the XBB.1.5 vaccine against the JN.1 was identified in February 2024—months after JN.1 began circulating. Yet, the updated JN.1 lineage-based formula (e.g., KP.2) was not available until October. By this time, KP.3.1.1 had become the dominant lineage, and XEC—a recombinant of two JN.1 lineages—was on the rise [18], eroding the benefits of the updated vaccine. This delay underscores the need for a more adaptive vaccine update process. Moreover, proposed FDA guidelines requiring randomized controlled trials to license future COVID-19 updates for use in those under 65 years of age in the US [19] further underscore the need for evaluation tools that can assess both when to update the vaccine and the continued effectiveness of previous formulations when updated vaccines are not readily available to all age groups. Routine genomic surveillance data offer a crucial opportunity to bridge this gap by enabling timely detection of emerging variants with the potential for immune escape. Integrating genomic data with disease surveillance enhances our understanding of infection dynamics, identifies key drivers of change, and informs tailored intervention strategies, including vaccination [20]. A genomics-informed early warning system hinges on linking four key data sources: virus sequence data, epidemiological data, demographic data, and immunization data [21]. In this study, we leverage these sources of data to address the need for timely and adaptive vaccine updates. We propose a framework to guide decisions on vaccine updates, specifically for vaccines that stimulate high-affinity neutralizing antibodies against viral antigens. This framework addresses the challenges of rapidly evolving viruses, where antigenic changes in targets of neutralizing antibody can reduce population-level VE. Using COVID-19 data, we present a real-time VE assessment framework that combines data from SARS-CoV-2 genomic surveillance and VE estimates derived using a test-negative design. We achieve this in three main steps: 1) We explore how genetic distance can serve as an early warning signal for reduced VE, by independently analyzing genomic sequences and epidemiological data. 2) We quantify the relationship between spike gene amino acid distance (amino acid substitutions from COVID-19 case sequences relative to the vaccine formulation(s)) and VE, develop a model capable of predicting VE based on amino acid distance, and validate it using a one-month-out prediction framework; and 3) We generate testable predictions of VE in the absence of individual-level vaccination data, demonstrating that changes in vaccine protection can be inferred from genomic sequences alone. Results To investigate how SARS-CoV-2 genetic distance correlates with VE and responds to changes in vaccine formulation over time, we analyzed 10,156 SARS-CoV-2 genomes that we sequenced over 173 weeks through a hospital-based genomic surveillance system (Fig 1). Our longitudinal samples captured most of the variants of concern defined as of October 2024, ranging from Alpha to Omicron KP.3. Genomic sequences generated from SARS-CoV-2 cases in Connecticut, US across all vaccine periods (n = 10,156). The number of genomic sequences from SARS-CoV-2 cases is aggregated by week and plotted over the study period, from April 2021 to July 2024. Sequences are colored by different variants of concern (VOCs) prevalent during this period. Background colors represent different vaccine formulation updates: 2020 original monovalent vaccine formulation (white), 2022/2023 bivalent Omicron BA.4/BA.5 formulation (orange), 2023/2024 monovalent XBB 1.5 formulation (pink). The colored bar above x-axis denotes individual-level vaccination data availability: available (light blue) and grey (unavailable). The study period also captured three COVID-19 vaccine formulations and was divided into three blocks: 1) the original monovalent mRNA vaccine formulation (April 4, 2021 to September 14, 2022); 2) the bivalent (original formula + BA.4/BA.5) mRNA vaccine formulation (September 15, 2022 to September 14, 2023); and 3) the monovalent XBB.1.5 mRNA vaccine formulation (September 15, 2023 to July 27, 2024). Genetic distance as an early warning signal during the original vaccine formulation period To evaluate whether SARS-CoV-2 genetic distance can serve as an early warning signal for declining VE at population level, we first investigated both longitudinal genomic and epidemiological data separately. We analyzed 7,722 genomes from cases that we sequenced during the original vaccine formulation period (i.e., block 1) and examined weekly changes across three key aspects (Fig 2). Relationship between spike gene amino acid distance to original vaccine formulation and time-varying vaccine effectiveness for case sequences included in the model calibration, April 2021 to September 2022. Panels (A) and (B) display individual dots, where each dot represents a single sequenced case included in the model calibration. The y-axis indicates the number of amino acid substitutions in the spike gene from the case sequences relative to the original formulation of mRNA COVID-19 vaccines. (A) Comparison of sequences between unvaccinated (yellow) and recently vaccinated individuals (red; 14-90 days since the most recent dose). The red line represents the 3-week rolling average of (%) recently vaccinated individuals among sequenced infections over time; gaps in this line represent intervals with zero observations for this category. (B) Sequences colored by variants of concern assigned to each case sequence (Alpha, black; Delta, blue; Omicron BA.1, red; BA.2, orange; BA.4, purple; BA.5, magenta; XBB.1.5, yellow). Vertical dispersion of dots of the same color reflects within-variant genetic heterogeneity, while the presence of multiple colors in a single week indicates variant co-circulation. (C) Week-level vaccine effectiveness (VE) estimates with 95% credible interval from the time-varying VE model for the period 14-90 days since the most recent dose. Vertical grey boxes denote distinct emergence periods, while the dotted line indicates the introduction of the updated bivalent vaccine formulation. First, we investigated shifts in the proportion of vaccinated individuals among sequenced infections over time (Fig 2A). We defined vaccine breakthrough cases as individuals who had received at least one vaccine dose 14 or more days prior to a laboratory-confirmed SARS-CoV-2 infection. From mid-January to mid-February 2022, we observed a rapid rise in breakthrough cases among recently vaccinated individuals (i.e., 14–90 days post-last dose) during the Omicron BA.1 period, comprising roughly 20% of all sequences collected weekly (Fig 2A). Second, we analyzed the weekly average spike gene amino acid distance between the sequenced cases and the vaccine formulation sequence (Fig 2B). During the original vaccine formulation period, we showed that the weekly average genetic distance between case sequences and the vaccine sequence ranged from 10 to 34 amino acid substitutions in the spike gene. During the Delta emergence period, the amino acid distance showed little change compared to earlier variants. However, during the Omicron BA.1 emergence period, we observed that average weekly amino acid distance increased from 10.9 in the first week of December 2021 to 33.3 in the first week of January 2022. The amino acid distance remained relatively stable during the BA.2 and BA.4/BA.5 periods. Within-group variations were also evident both between variants and temporally throughout their respective periods of circulation (S2 Fig). Our analysis of the full spike gene captured a broader range of variations (Fig 2), offering a more comprehensive view than receptor binding domain alone (S3A and S3B Fig). We also tracked temporal changes in nucleotide differences relative to the NCBI reference sequence (S3C Fig). Overall, we demonstrated high correlation between the spike gene amino acid differences used in our main analysis and two alternative measures: restricting the analysis to amino acid substitutions in the receptor binding domain alone (S3B Fig) or extending the analysis to more granular, nucleotide changes within the spike region (S3D Fig). Third, we examined temporal changes in population-level VE (Fig 2C). Time-varying VE estimates for the period 14–90 days since the most recent dose gradually declined from 80% (95% credible interval (CrI): 74%, 85%) in April 2021 to around 60% spanning the 6-month period before BA.1 emergence. Following the emergence of BA.1, VE dropped sharply from 58% (95% CrI: 47%, 68%) in early December 2021 to 31% (95% CrI: 13%, 46%) by late January 2022. These low VE estimates persisted during the BA.2 and BA.4/BA.5 periods and could not be fully explained by bias from the depletion of susceptibles (S4 Fig). We also showed that after bivalent boosters were introduced in mid-September 2022, which reduced the spike amino acid distance between circulating variants and the vaccine formulation sequence, VE rebounded. In early October 2022, within three weeks of the bivalent booster introduction, mean VE increased by 12 percentage points to 40% (95% CrI: 6.22%, 63.19%), compared to 28% (95% CrI: -9.98%, 54.58%) in late August 2022. Quantifying the relationship between amino acid distance and vaccine effectiveness Based on the observed inverse relationship between the number of amino acid substitutions and VE over time (Fig 2), we hypothesized that population-level amino acid distance in the spike gene can serve as a proxy for vaccine protection. We therefore quantified their direct relationship using our meta-regression model and found that a mean distance of 10 amino acids in the spike gene corresponds to a 15.4% (95% CrI: -2.00%, 34.6%) decrease in predicted VE. To validate the model’s ability to predict VE using weekly amino acid distance data, we generated one-month-out predictions and compared them to observed VE values (Fig 3). We found that the model closely followed the observed VE trends across all prediction months (mean absolute error (MAE) = 3.33) and successfully captured changes surrounding the bivalent vaccine update. All VE values during the eight-month prediction window—four months before and after the vaccine update—fell within the 95% prediction intervals (Fig 3B). We also showed that this model outperformed a reference model that had the same autoregressive structure but excluded amino acid distance information (Fig 3C); the baseline AR model yielded a higher MAE (MAE = 5.86) and a higher continuous ranked probability score (CRPS) throughout most of prediction months (S5 Fig). Additionally, the baseline model produced markedly wider prediction intervals, reflecting increased uncertainty in its prediction. These findings highlight the added value of incorporating genomic information in enhancing the model's accuracy in predicting future VE compared to a model relying solely on historical VE data. Comparison of model stages and validation of one-month-ahead vaccine effectiveness (VE) predictions. (A) Comparison of first-stage time-varying VE estimates and corresponding 95% credible intervals (CrI) (i.e., Fig 2C) in green and “observed” VE estimates from the amino-acid-distance meta-regression model in purple. Vertical grey boxes denote variant emergence periods, and the dotted line indicates the bivalent vaccine introduction. (B - C) Validation of the observed VE (purple ribbons carried over from panel A) to (B) one-month-ahead predicted VE from the amino-acid-distance meta-regression model (red diamonds), which uses week-level amino acid distance as input, and (C) the baseline meta-regression model (orange diamonds), which does not incorporate amino acid distance information. Colored ribbons represent 95% CrI for observed (purple) and predicted (red and orange) values. Estimating changes in vaccine effectiveness for the XBB.1.5 vaccine formulation: simulating real-world scenarios without vaccination data After calibrating and validating our model (Fig 3), we then sought to translate these findings into a real-world framework to inform changes in predicted vaccine protection as new variants emerged. To evaluate how population-level amino acid distance from the sequence of different COVID-19 vaccine formulations changed across multiple vaccine updates, we extended our model across the different formulation periods. Throughout vaccine update blocks, we utilized only measured weekly amino acid distance as the input to predict the percent reduction in VE; we present VE estimates based on a 3-week rolling average of amino acid distance to enhance visualization. During the second vaccine (block 2), the increase in minimum amino acid distance to either formulation was more nuanced than in block 1. Block 2 was characterized by the prolonged co-existence of BA.5 and XBB strains, which led to a gradual rather than step-wise increase in population-level mean amino acid distance (Fig 4A). For instance, with the emergence of XBB strains, the mean distance rose from 12.2 in late-December 2022 to 18.2 in late-January 2023 and 23.7 by mid-September when the 2023/24 XBB vaccine (i.e., third vaccine) became available, marking the first annual COVID-19 vaccine update. This increase in amino acid distance predicted a 34.3% (95% CrI: -2.4%, 70.4%) reduction in VE against the second vaccine (2022/23 vaccine strains) by mid-September 2023. Amino acid differences in spike gene between case strains and the updated formulation of mRNA COVID-19 vaccines. (A) Weekly minimum amino acid substitutions in the spike gene between case strains and either of the two strains included in the bivalent mRNA COVID-19 vaccine formulation (May 2022 – September 2023). (B) Amino acid differences relative to the XBB.1.5. formulation of mRNA COVID-19 vaccines (May 2023 – July 2024). In both panels, each dot represents a single sequenced case and sequences are colored by different variants of concern prevalent during this period. The grey dotted line represents the introduction of the vaccine update. The grey shaded area represents sequences that were collected prior to updated vaccine availability. The red line represents the weekly mean predicted percent reduction in VE based on the 3-week rolling average of amino acid distance from the vaccine strain. For the third vaccine update (block 3), we observed a more than two-fold increase in mean amino acid distance, mirroring the pattern seen during the original vaccine formulation period (Fig 4B). Specifically, the mean amino acid distance rose from 12.3 in mid-December 2023 to 30.2 in mid-January 2024, corresponding to the transition from XBB to JN.1 dominance. Based on this increase in amino acid distance, we predicted a 43.4% (95% CrI: -5.7%, 90.1%) reduction in VE by mid-January 2024. Our findings also suggest a further 9.8% decline in VE against circulating variants by June 2024, coinciding with the emergence of KP lineages, reaching an estimated 53.2% (95% CrI: 7.0%, 110.4%) reduction compared to VE against the XBB.1.5 vaccine strain. To assess the generalizability of our findings, we evaluated temporal changes in amino acid distance across the Northeast United States using all publicly available sequences from the NCBI database. Although the precise timing of the abrupt increase in mean amino acid distance varied by state, the overall evolutionary trajectory of circulating strains relative to the vaccine formulation closely mirrored our observations in Connecticut (S6 Fig). This approach demonstrates how the model can support real-time surveillance by quantifying expected declines in vaccine protection as new variants emerge. Discussion Our analysis estimated time-varying COVID-19 VE at the population level and quantified its direct relationship with SARS-CoV-2 genomic data from community cases. The time-varying VE framework that we introduce is useful by itself for identifying and predicting temporal changes in VE. However, complementing the framework with genomic information provides additional precision for generating one-month-ahead predictions of VE. We found that virus genomic data, in the form of amino acid distance from the vaccine formulation sequence, can serve as an early warning to detect shifts in predicted VE and provides insights into the underlying causes of these changes. Combining time-varying VE estimates with the association between VE and amino acid distance allows us to quantify how the emergence of new variants is expected to affect VE. We demonstrated a clear association between increasing amino acid distance in the SARS-CoV-2 spike gene from the vaccine formulation and declining population-level VE. This aligns with a growing body of research highlighting the critical role of spike mutations on antibody neutralization and immune escape [22–24]. While many prior works on immune escape have focused on variant-specific analyses [25], in vitro characterization of specific mutations [26], or mapping of viral evolution across variants using antigenic cartography [27], our approach offers a complementary population-level perspective. We provide a variant-agnostic and practical metric for real-time monitoring of potential reductions in VE. This contrasts with traditional VE studies that often rely on retrospective analyses of observational data. For SARS-CoV-2, genetic distance to the vaccine sequence has previously been explored as a correlate of vaccine efficacy based on clinical trial data [28,29] and through predictive models using publicly available data [30]. Previous models focused on forecasting and characterizing specific mutations of concern [30]; our study expands the application by directly estimating VE using genomic surveillance data. A key strength of our study lies in the comprehensive surveillance data, which encompasses four years of SARS-CoV-2 genomic surveillance from a single hospital system, uniquely linked to detailed clinical metadata. This integration of epidemiological and genomic data—rather than relying on public databases—allows us to quantify the relationship between VE and temporal changes in amino acid distance, advancing our understanding of vaccine protection in an evolving antigenic landscape. Furthermore, our Bayesian approach to estimating time-varying VE with autoregressive terms enables us to provide robust and informative estimates even for weeks with limited sequence availability. Vaccine formulation updates are sometimes necessary to provide sufficient protection against emerging immune escape variants [31,32]. In the case of SARS-CoV-2, the emergence of antigenically distinct lineages has been characterized by the accumulation of a large number of mutations, which thus far has been difficult to predict [2]. COVID-19 vaccine formulation updates have generally been implemented annually since 2023. However, the degree of antigenic divergence from the existing vaccine formulation varied among the variants that prompted these updates. For instance, the emergence of Omicron lineages, characterized by over 30 amino acid substitutions in the spike protein alone compared to ancestral lineages, prompted the first vaccine update [33,34]. Our analysis showed that an increase in amino acid distance of approximately 30 substitutions following the emergence of Omicron BA.1 corresponded to an estimated 40% decrease in VE. The emergence of JN.1 variants in November-December 2023 was characterized by a similarly large increase in amino acid distance relative to the XBB.1.5 (2023/24 vaccine update) formulation, which we predict should have resulted in a similar ~40% decrease in VE. However, the antigenic divergence of XBB.1.5 from the preceding BA.4/BA.5 vaccine (2022/23 update) resulted in comparatively smaller predicted VE reduction, estimated at ~20% upon emergence in late December 2022 and ~35% when the updated vaccine was implemented (September 2023). Our framework could help identify when emerging variants are associated with large (vs small) declines in VE, better guiding when COVID-19 vaccine formulation updates are needed, as opposed to the current practice of updating the vaccine annually. This could enable preparedness efforts before clinical data fully accumulate, allowing for a more timely and dynamic response system in the future. The threshold amino acid distance dictating vaccine updates can be adjusted based on desired vaccine protection targets, but the key insight is that waiting for full laboratory and clinical confirmation may not be necessary to initiate a response. Instead, amino acid distance can serve as an effective early indicator, with additional data validating and refining decisions. Limitations to our study include the lack of disease severity information among outpatients; therefore, our VE estimates are not outcome specific (e.g., hospitalization, death, etc.) within this population. While outcome-specific VE would provide further insights, our focus on outpatient data aligns more closely with the population we aimed to study, namely people seeking healthcare due to COVID-19-related symptoms in the community setting. Inpatient data were excluded due to the potential for bias introduced by routine testing protocols prior to procedures (e.g., surgeries). Similarly, we identified individuals with high frequency of testing (more than 50 times between April 2021 and March 2023) as likely undergoing routine testing. Although we made efforts to flag and account for their potential influence in our models, some residual bias may remain. Such individuals may be more likely to test negative and either more likely to be vaccinated (if they represent very “COVID-aware” individuals) or less likely to be vaccinated (if routine testing was required by their employer as a condition of being unvaccinated). Furthermore, our VE estimates are not vaccine specific. We used the mRNA vaccine sequences for the Pfizer BNT162b2 vaccine, which were similar for the Moderna vaccine, to define amino acid distance. While these vaccines may not fully represent all COVID-19 vaccines used in our study population, they account for over 97% of doses administered in the US [35–37]. Additionally, we did not account for potential bias related to the depletion of susceptible people, which can occur when natural immunity from infection is acquired faster in the unvaccinated group than in the vaccinated group, potentially underestimating VE and leading to incorrect conclusions about time-varying effectiveness [38,39]. We mitigated this potential bias by focusing our primary analysis on recently vaccinated individuals (14–90 days), thereby capturing VE estimates before differential depletion could significantly skew the results [40]. Furthermore, the high reinfection rates of emerging variants provide a natural buffer against sustained depletion bias; as immune escape variants allow individuals with previous infection-induced immunity to re-enter the susceptible pool, this “refilling” effect reduces statistical artifacts associated with spurious waning [40], as demonstrated by our simulation-based sensitivity analysis. Finally, we implemented a two-stage approximation to a full hierarchical Bayesian model. While this remains an approximation, we addressed first-stage uncertainty through a meta-regression framework with autoregressive random effects. Although this approach likely resulted in wider credible intervals, it prevented the model from overestimating precision and minimized the risk of Type I errors. While specific VE estimates may vary depending on the population and setting, our approach provides a framework that is adaptable to other contexts, provided genomic surveillance data are available and can be linked to patient information for cases and controls. Uncertainties remain in the seasonality of SARS-CoV-2 [41,42] and the optimal frequency of COVID-19 vaccine updates. Our study provides a framework for the early identification of emerging variants associated with declines in vaccine protection, which could allow for more adaptive decision-making on COVID-19 vaccine updates. Currently, committees like the ACIP play a pivotal role in making policy recommendations based on comprehensive review of clinical, epidemiological, safety, and economic data [12]. Our framework supplements current work as we demonstrate how genomic data can be integrated with more traditional epidemiological data sources to address the need for timely, reliable evidence to guide vaccine updates. It also provides reassurance during periods when the current vaccine is expected to remain effective, strengthening public confidence in VE messaging. Ultimately, vaccine protection is shaped by a complex interplay of factors, including vaccine properties, evolutionary dynamics of the virus, biological factors influencing host immunity, and selective pressure within a population [41]. This highlights the need for continuous monitoring and robust data. Genomic surveillance is integral to this process, enabling more informed decision-making and effective public health strategies. Materials and methods Ethics statement The study protocols for pathogen genomic sequencing of remnant diagnostic samples (IRB Protocol ID: 2000033281) and impact of SARS-CoV-2 genetic variants on immune escape and vaccine breakthroughs (IRB Protocol ID: 2000031374) was reviewed and approved by the Yale University institutional review board. Data sources and genetic sequences We used whole genome sequencing (WGS) data collected from the Yale New Haven Hospital (YNHH) system in Connecticut (CT), US between the week of 4th April 2021 to the week of 21st July 2024 through the Yale SARS-CoV-2 Genomic Surveillance Initiative. Sample collection, RT-qPCR, and sequencing protocols have been described in detail elsewhere [43,44]. Metadata and vaccination records were obtained from the YNHH system and Center for Outcomes Research and Evaluation and matched to WGS data using unique sample identifiers. We used standardized ZIP-code-level CT income data as a potential covariate, with raw data obtained from the US Census Bureau [45]. We highlighted emergence periods for better visualization and understanding of variant timelines. For uniformity, we applied the same emergence period definitions previously established in Chen et al.[44] In short, these periods represent short intervals during which two variants co-circulated, defined as the time from when a variant accounted for 5% of Global Initiative on Sharing All Influenza Data (GISAID)-reported cases in CT to when it reached its maximum frequency in the population [44]. Epidemiological data Our study focused on CT residents to ensure consistency in surveillance and vaccination policies. Cases were defined as individuals who tested positive for SARS-CoV-2 infection via PCR and who had samples sequenced at the WGS level. To maintain a consistent definition of VE, only samples taken from outpatient settings were included. We excluded samples for whom WGS information was not available or did not meet the required genome sequence coverage (i.e., genome coverage >95%). Other exclusion criteria included duplicate samples from an individual (to exclude chronic infections) and samples from non-CT residents. Given the vaccine rollout and eligibility timelines differed across age groups, we only included adult patients (18 + years) at the time of sample collection. Cases were aggregated at the week level to reduce sparsity, and subsequent analyses were conducted at the week level. To assess VE over the first 103 weeks, corresponding to the first two years of the data collection (April 4, 2021 to March 19, 2023), we obtained individual-level metadata from test-negative controls. Controls were selected from samples taken from individuals in outpatient settings who met all criteria for the YNHH system testing initiative, but who tested negative for SARS-CoV-2 infection via PCR. If an individual had both negative and positive test results, we only included the positive test as a case. Any subsequent negative test from the same individual within two weeks of a positive test was excluded to avoid potential misclassification. A patient’s vaccination status was determined at the time of sample collection, and time since last vaccination was calculated as the difference between the sample collection date and date of last vaccine receipt. Primary analyses were conducted based on time since last vaccination to account for waning immunity, and uniform criteria were applied regardless of the vaccine manufacturer or number of doses received. Time since last vaccination was categorized as: < 14 days, 14–90 days, 91–180 days, ≥181days. The total number of doses received more than 14 days prior to sample collection was also counted for each individual and included as a covariate in our model. For visualization, we plotted 3-week rolling averages to show the proportion of recently vaccinated individuals among both the cases with collected sequences and test-negative controls over time. This allows us to observe trends in vaccine coverage in both groups. To ensure that our controls were representative of the population, vaccine coverage among controls was compared against available population vaccine coverage data in CT (S1 Fig). We obtained data on the CT vaccination trends from the CDC [46]. Vaccine updates and corresponding sequences Comirnaty (Pfizer-BioNTech) or Spikevax (Moderna Tx.) were the most widely available and used COVID-19 vaccines in the US. Updates to these two mRNA-based vaccines mostly followed a similar timeline throughout the study period with three updates as of October 2024 [47]. Vaccine blocks were defined based on FDA approval dates, though the exact cut-off dates were selected arbitrarily for analysis purposes. The FDA authorized the use of the bivalent (original formula + BA.4 / BA.5) vaccine as a booster dose on August 31, 2022 [48]; we assigned September 15, 2022 as the start of bivalent vaccine availability, regardless of the vaccine manufacturer [49]. The monovalent XBB.1.5 formulation was approved on September 11, 2023 [50]; we assigned September 15, 2023 as the beginning of the third block. Genetic distance model We defined genetic distance as the number of amino acid substitutions between the case and mRNA vaccine formulation spike gene sequences. We aligned sequences using nextclade [51], extract the spike gene region from aligned WGS, we used bedtools [52] to trim the specified genomic coordinates at the nucleotide level. We then translated the nucleotide sequences to amino acid. We measured genetic distance using Hamming distance, which calculates the number of mismatched positions between aligned sequences [53]. Hamming distance was selected as it has been shown to correlate well with antigenic distances and has been effectively used in influenza vaccine research [53–55]. For nucleotide-level comparisons, we calculated the distance between each case sequence and the NCBI reference genome (MN908947), the basis for the original vaccine formulation. For each vaccine block, we compared case sequences to the corresponding vaccine sequence available during that time period. For example, sequences from block 1 were compared against the original mRNA vaccine sequence, while sequences from block 3 were compared against the 2023/2024 XBB.1.5 formulation. For block 2, we used the minimum amino acid differences between the case strain and either of the two strains in the bivalent vaccine. Time-varying vaccine effectiveness (VE) model We assessed time-varying VE using a hierarchical Bayesian time-series method, building on the widely used test-negative design that compares the prevalence of vaccination among SARS-CoV-2 cases and test-negative controls. The binary outcome variable for an individual i at time t (Yit) is equal to one if the individual is a case and zero if they are a control. We used logistic regression to model the probability of being a case or control for each individual and time point (pit) as a function of vaccination status and other covariates. Additionally, we extended the conventional test-negative design approach by incorporating correlated random effects to allow the association between vaccination status and case/control probability to smoothly change across time. Specifically, the model is given as: where β0t is the time-varying intercept parameter that accounts for changes in baseline risk of SARS-CoV-2 infection for each week t; Zijt is an indicator variable for the vaccination category (0 (reference): unvaccinated, 1: < 14 days, 2: 14 – 90 days, 3: 91 days – 6 months, 4: > 6 months) of individual i in week t; βjt is the time-varying regression parameter that describes the association between vaccination category j and the probability of being a case; and 𝐱i is a vector of covariates for individual i for which the corresponding effect estimates do not change across time. The vector of other covariates includes age group, standardized income at the zip-code level, gender, number of vaccine doses received before sample collection, and a “routine flag” (binary variable) to indicate individuals who are thought to be testing routinely (defined as 1 for individuals with more than 50 testing records over the 103 weeks included in our dataset and 0 otherwise). The time-varying parameters, β0t and βjt, were modeled as a function of a “global” fixed effect parameter and independent (across parameter) autoregressive correlated random effects, such that: The autoregressive structure specified for the θjt parameters allows both intercept and coefficients to evolve dynamically while borrowing strength across nearby time points. We allow the data to determine the strength of temporal correlation by estimating the ρj parameters. To complete the model structure, we assigned prior distributions to the remaining model parameters. Specifically, we assigned independent log-gamma(3, 2) priors to the precision parameters (1τj2) of the random effects. For the fixed effects, including η and βj, we used weakly informative Normal(0, 103) priors. Additionally, we selected independent Uniform(-1, 1) distributions for the autoregressive parameters (ρj). We used R-INLA (integrated nested Laplace approximations) (www.r-inla.org) [56,57] to fit the model. R-INLA is a computationally efficient approximation to a widely used Markov chain Monte Carlo (MCMC) approach, and provides marginal posterior inference for the included model parameters [58]. We generated 10,000 samples from an approximated marginal posterior distribution for each parameter in parallel using pbmcapply and parallel R packages. Along with posterior means of βjt, the quantile based, equal tailed 95% credible intervals (CrI) of βjt were constructed for each vaccination category. For better visualization, both the posterior mean and CrI for 1- exp(βjt) were also calculated and plotted, representing VE (%) at each week. Quantifying the relationship between amino acid distance and vaccine effectiveness We used a random effects meta-regression model fitted in the Bayesian setting to quantify the relationship between amino acid distance and VE over time, focusing on the 14–90 days post-vaccination category (j = 2) to represent short-term vaccine-induced immunity. We modeled the outcome variable, the observed log OR of infection at time t (β^2t) from the time-varying VE model as following a normal distribution centered around the latent true log OR (β2t), with variance defined by the squared posterior standard deviations (σ^t2). Then, the true but unobserved log OR is modeled as a function of amino acid distance and random effects. Specifically, the full model is given as: where γ1 is the key regression parameter that quantifies the association between amino acid distance and the relative risk of infection; γ0 is the baseline intercept that accounts for variations in baseline risk across all time points; αt captures time-varying random effects with an autoregressive structure similar to the first-stage model; and εt is an independent error term that follows a zero-mean normal distribution. To complete the model structure, we assigned weakly informative priors to the remaining parameters. Specifically, we assigned Normal(0, 103) priors for the fixed effects, including γ0 and γ1. For the random effects (αt), we assigned a Uniform(-1, 1) prior to the autoregressive parameter (ρA), consistent with our first-stage model, and a Gamma(0.01, 0.01) prior to the precision parameter governing the variability. We used MCMC methods to fit the model and sampled from the joint posterior distribution of all model parameters using the rjags package [59] in R. We initialized four MCMC chains with an adaptive phase of 500,000 iterations, followed by 100,000 iterations after convergence. Convergence was assessed via Geweke diagnostics, which yielded Z-scores of -0.648 for γ0 and 0.675 for γ1, indicating no obvious signs of non-convergence. Posterior inference was based on posterior means and a 95% CrI for key parameters including γ1. Model validation and prediction. We assessed the predictive performance of the random effects meta-regression model using a one-month-out validation framework. This approach was designed to simulate real-world scenarios where genomic surveillance data are available, but individual-level patient metadata are limited. In such contexts, amino acid distance data serve as the primary input for predicting VE, which is derived from estimates of β2t from the meta-regression model. We generated predictions over an eight-month time period from June 2022 to January 2023, spanning four months before and after the bivalent vaccine update. Specifically, for each held-out month k, we excluded the observed β^2t values from the model and used only amino acid distance data for that month as input. The observed β^2t values from months 1 to k-1 were retained in the model to inform the posterior distribution of the time-varying parameters. The model was used to predict β2t for month k, given the amino acid distance data for that month. For example, to predict the β2t for June 2022, the model was given β^2t data up to May 2022 and was asked to predict the β2t for June 2022 based on the amino acid distance data for June 2022. This process was repeated for each month in the validation period. We fit the meta-regression model described in the previous section separately for each leave-out month using MCMC methods. We implemented the model using four MCMC chains with 50,000 iterations followed by 10,000 iterations after convergence. The model’s predicted β2t values were compared to the observed β^2t to assess its predictive performance. The MAE was used as the primary metric to quantify prediction error. A baseline autoregressive model, using a similar one-month-out validation framework and MCMC settings, was also evaluated; this model did not incorporate amino acid distance information, instead predicting VE based only on the autoregressive terms. To compare the predictive performance of these two models, we calculated CRPS. Unlike the MAE, which compares point predictions to observed values, the CRPS is a generalized MAE that evaluates the entire predictive distribution [60,61]. We computed CRPS for each one-month-out prediction for both models to provide a more comprehensive assessment of their probabilistic forecasting capabilities. Simulation-based sensitivity analysis. To address concerns over the potential magnitude and timescale of bias in estimates of the time-varying VE due to the differential depletion of susceptible unvaccinated versus vaccinated individuals [38,39], we developed a simple compartmental SIRS model simulation using parameters that resemble SARS-CoV-2-like characteristics (S1 Table). We compared two scenarios: Model 1 (SIRS / refilling pool): Recovered individuals from both vaccinated and unvaccinated groups re-enter susceptible pool (waning immunity: 90 days). This model reflects the high reinfection rates characteristic of the Omicron era. Model 1 (SIRS / refilling pool): Recovered individuals from both vaccinated and unvaccinated groups re-enter susceptible pool (waning immunity: 90 days). This model reflects the high reinfection rates characteristic of the Omicron era. Model 2 (SIR/ Sustained depletion): This model assumes that recovered individuals remain immune. Model 2 (SIR/ Sustained depletion): This model assumes that recovered individuals remain immune. The model diagrams and equations are provided in the S1 File. Our results demonstrate that across a range of transmission intensities, Model 1 (which is more representative of the short duration of immunity against reinfection with SARS-CoV-2) consistently yields VE estimates that track close to the true VE. The estimated VE initially dips below the true VE (~75%) as differential depletion begins but recovers toward the true VE (~90%) as the susceptible pools are progressively replenished. This non-monotonic behavior demonstrates that the refilling mechanism effectively attenuates the bias over the course of the epidemic. In contrast, Model 2 (in which we assume no waning of immunity) leads to a progressive underestimation of VE as the susceptible denominator is artificially exhausted. In the absence of waning immunity, the bias is sustained and monotonically increasing; the estimated VE progressively diverges from the true VE as unvaccinated susceptible individuals are preferentially depleted. Supporting information Vaccine coverage trends in Connecticut (April 2021 – May 2023). Weekly vaccine coverage data for Connecticut, USA, based on publicly available CDC data. Colors indicate different administered dose categories: dose 1, primary series completion, and additional doses. Coverage is presented as the percentage of the population receiving each dose type over time. Coverage among cases (blue line) is presented as 3-week rolling average. (TIF) Temporal dynamics of within-variant heterogeneity. The panels display the 30-day rolling standard deviation of amino acid substitutions in the spike gene, faceted by variants of concern. (JPG) Amino acid differences in the receptor binding domain relative to the original mRNA COVID-19 vaccine strain, April 2021 to September 2022. (A) Weekly aggregated amino acid differences in the receptor binding domain region between the case strain and the original formulation of mRNA COVID-19 vaccines; each dot represents a single sequenced case. (B) Correlation between amino acid differences in the spike gene and receptor binding domain. (C) Weekly aggregated nucleotide differences in the spike gene between the case strain and reference SARS-CoV-2 sequence (NCBI Accession: MN908947). (D) Correlation between amino acid differences in the spike gene and nucleotide differences in the spike gene. Sequences are colored by the predominant variants of concern prevalent during this period (Alpha, black; Delta, blue; Omicron BA.1, red; BA.2, orange; BA.4, purple; BA.5, magenta). Spearman correlation coefficients are annotated in panels (B) and (D). (JPG) Simulation-based sensitivity analysis results. Figure displays the SIRS-model simulation results for model 1 (blue), which assumes recovered individuals from both vaccinated and unvaccinated groups re-enter susceptible pool (waning immunity: 90 days), and model 2 (maroon), which shows no waning from the recovered state. Results are shown for three different effective reproductive number (Reff). The horizontal dotted line represents the assumed “true” vaccine effectiveness parameter. (TIF) Continuous ranked probability score (CRPS) model comparison. Figure displays the CRPS values for the amino acid (AA) distance informed model (red line) and the baseline autoregressive (AR) model (orange) over the eight-month prediction and validation period. Lower CRPS values indicate better performance. (TIFF) Amino acid substitutions in spike gene between case strains in the Northeast US (n = 49,266) and the XBB. 1.5 formulation of mRNA COVID-19 vaccines. Sequences are aggregated by week from Jun 15, 2023, to August 30, 2024. Each dot represents a single sequenced case. The grey dotted line represents the introduction of the XBB.1.5. vaccine update. The grey shaded area represents sequences that were collected prior to XBB.1.5 vaccine availability. (A) All northeast sequences combined and colored by Nextclade lineage assignment. (B) Comparison of mean amino acid substitutions over time between Northeast sequences (red) versus Connecticut (blue) sequences. (C) State-level comparisons, where sequences from each of the Northeast states are plotted against Connecticut (blue) sequences to highlight local variations in the timing and magnitude of amino acid substitutions. (JPG) Fixed model parameter values. (DOCX) Supplementary Methods. (DOCX) EPI_SET ID for the sequences used in the study. (CSV) 1 Oct 2025 -->PCOMPBIOL-D-25-01498 Utilizing virus genomic surveillance to predict vaccine effectiveness PLOS Computational Biology Dear Dr. Kwon, Thank you for submitting your manuscript to PLOS Computational Biology. After careful consideration, we feel that it has merit but does not fully meet PLOS Computational Biology's publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript within 60 days Dec 01 2025 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at ploscompbiol@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pcompbiol/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript: * A rebuttal letter that responds to each point raised by the editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'. This file does not need to include responses to formatting updates and technical items listed in the 'Journal Requirements' section below. * A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'. * An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'. If you would like to make changes to your financial disclosure, competing interests statement, or data availability statement, please make these updates within the submission form at the time of resubmission. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter We look forward to receiving your revised manuscript. Kind regards, Joel O. Wertheim Academic Editor PLOS Computational Biology Thomas Leitner Section Editor PLOS Computational Biology Journal Requirements: 1) Please ensure that the CRediT author contributions listed for every co-author are completed accurately and in full. At this stage, the following Authors/Authors require contributions: Jiye Kwon, Ke Li, Joshua L. Warren, Sameer Pandya, Anne M. Hahn, Yale SARS-CoV-2 Genomic Surveillance Initiative, Virginia E. Pitzer, Daniel M. Weinberger, and Nathan D. Grubaugh. Please ensure that the full contributions of each author are acknowledged in the "Add/Edit/Remove Authors" section of our submission form. The list of CRediT author contributions may be found here: https://journals.plos.org/ploscompbiol/s/authorship#loc-author-contributions 2) We ask that a manuscript source file is provided at Revision. Please upload your manuscript file as a .doc, .docx, .rtf or .tex. If you are providing a .tex file, please upload it under the item type u2018LaTeX Source Fileu2019 and leave your .pdf version as the item type u2018Manuscriptu2019. 3) Please provide an Author Summary. This should appear in your manuscript between the Abstract (if applicable) and the Introduction, and should be 150-200 words long. The aim should be to make your findings accessible to a wide audience that includes both scientists and non-scientists. Sample summaries can be found on our website under Submission Guidelines: https://journals.plos.org/ploscompbiol/s/submission-guidelines#loc-parts-of-a-submission 4) We do not publish any copyright or trademark symbols that usually accompany proprietary names, eg ©, ®, or TM (e.g. next to drug or reagent names). Therefore please remove all instances of trademark/copyright symbols throughout the text, including: - ® on page: 14. 5) Your manuscript is missing the following section: Methods. Please ensure all required sections are present and in the correct order. Make sure section heading levels are clearly indicated in the manuscript text, and limit sub-sections to 3 heading levels. An outline of the required sections can be consulted in our submission guidelines here: https://journals.plos.org/ploscompbiol/s/submission-guidelines#loc-parts-of-a-submission Note: The Methods section should be included in the main file of the manuscript. 6) Please upload all main figures as separate Figure files in .tif or .eps format. For more information about how to convert and format your figure files please see our guidelines: https://journals.plos.org/ploscompbiol/s/figures 7) We notice that your supplementary Figures are included in the manuscript file. Please remove them and upload them with the file type 'Supporting Information'. Please ensure that each Supporting Information file has a legend listed in the manuscript after the references list. 8) Please modify your Competing Interests statement in the online submission form and declare all competing interests beginning with the statement "I have read the journal's policy and the authors of this manuscript have the following competing interests:" Note: If the reviewer comments include a recommendation to cite specific previously published works, please review and evaluate these publications to determine whether they are relevant and should be cited. There is no requirement to cite these works unless the editor has indicated otherwise. Reviewers' comments: Reviewer's Responses to Questions Comments to the Authors: Please note that two reviews are uploaded as attachments. Reviewer #1: Review comments are attached as a PDF Reviewer #2: Review uploaded as attachment. ********** Have the authors made all data and (if applicable) computational code underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data and code underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data and code should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data or code —e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: No: The provided GitHub repository (https://github.com/jiyekwon/Yale_COVIDVE current commit: a91c067) does not contain any code or data as claimed in the data and materials availability. This must be updated before publication. Additionally, the authors do not provide an EPI_SET ID to access the sequences used in the analysis. Reviewer #2: No: As I mention in my review, it does not seem that either the code or the data is available, despite this being stated in the Data and Code Availability statement. I looked through the GitHub repository and found that it contained, aside from the usual README and License documents, no actual code. It did contain an .Rproj file, but this did not contain the code or data either. ********** PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] Figure resubmission: While revising your submission, we strongly recommend that you use PLOS’s NAAS tool (https://ngplosjournals.pagemajik.ai/artanalysis) to test your figure files. NAAS can convert your figure files to the TIFF file type and meet basic requirements (such as print size, resolution), or provide you with a report on issues that do not meet our requirements and that NAAS cannot fix. -->-->After uploading your figures to PLOS’s NAAS tool - https://ngplosjournals.pagemajik.ai/artanalysis, NAAS will process the files provided and display the results in the "Uploaded Files" section of the page as the processing is complete. If the uploaded figures meet our requirements (or NAAS is able to fix the files to meet our requirements), the figure will be marked as "fixed" above. If NAAS is unable to fix the files, a red "failed" label will appear above. When NAAS has confirmed that the figure files meet our requirements, please download the file via the download option, and include these NAAS processed figure files when submitting your revised manuscript.-->--> Reproducibility: To enhance the reproducibility of your results, we recommend that authors of applicable studies deposit laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols--> Submitted filename: PCOMPBIOL-D-25-01498 05-Sep-25.pdf Submitted filename: review_comments.pdf 19 Jan 2026 Submitted filename: PCOMPBIOL-Response_Jan26.pdf 10 Mar 2026 PCOMPBIOL-D-25-01498R1 Utilizing virus genomic surveillance to predict vaccine effectiveness PLOS Computational Biology Dear Dr. Kwon, Thank you for submitting your manuscript to PLOS Computational Biology. After careful consideration, we feel that it has merit but does not fully meet PLOS Computational Biology's publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Please submit your revised manuscript by May 10 2026 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at ploscompbiol@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pcompbiol/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript: * A letter that responds to each point raised by the editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'. This file does not need to include responses to formatting updates and technical items listed in the 'Journal Requirements' section below. * A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'. * An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'. If you would like to make changes to your financial disclosure, competing interests statement, or data availability statement, please make these updates within the submission form at the time of resubmission. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. We look forward to receiving your revised manuscript. Kind regards, Joel O. Wertheim Academic Editor PLOS Computational Biology Thomas Leitner Section Editor PLOS Computational Biology Additional Editor Comments: Thank you for your thorough response. Both Reviewers have recommended acceptance once the last comments from Reviewer #2 have been adequately addressed. Reviewers' comments: Reviewer's Responses to Questions Comments to the Authors: Please note here if the review is uploaded as an attachment. Reviewer #1: Thank you for your thorough response to my review. Reviewer #2: I find that the authors have adequately addressed my concerns. As such, I now recommend publication of the manuscript. Even so, allow me to attach a few comments: * Regarding the authors comment about gamma_1: it is plausible that gamma_1 is the main source of the uncertainty in question, however I am not sure if this comment was supposed to alleviate any concerns? gamma_1 is, in a sense, the most salient parameter. * In the context of the potential impact on differential depletion of susceptibles, the authors write: "Rather than performing a "back-of-the-envelope" calculation, we have opted to provide a qualitative assessment of the potential magnitude of this bias based on an established simulation framework for pathogens with SARS-CoV-2-like characteristics. We believe this is a more robust approach, as it avoids making several unverifiable assumptions." This, I think, represents a bit of a misunderstanding. Broadly referring to a qualitative result does not involve fewer difficult assumptions than would an idealized model calculation. The difference being that, in the latter case, one could more easily state the assumptions. Stated assumptions are, on the whole, superior to implied ones. For example, the authors write that, on the one hand "our assessment suggests that the magnitude of this bias is primarily mitigated by focusing our primary analysis to recently vaccinated individuals (14-90 days since their last dose)". On the other hand, they write "Furthermore, the high reinfection rates characteristic of the Omicron era provides [sic] a natural buffer against sustained and monotonic depletion bias." However, it is altogether unclear whether the latter effect is of sufficient magnitude - on the timescale in question - to truly wash out the effects of differential depletion. I still believe the paper would benefit from a clearer treatment of this phenomenon, even if in a highly idealized model. However, take it as a suggestion. ********** Have the authors made all data and (if applicable) computational code underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data and code underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data and code should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data or code —e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes ********** PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] Figure resubmission: -->While revising your submission, we strongly recommend that you use PLOS’s NAAS tool (https://ngplosjournals.pagemajik.ai/artanalysis) to test your figure files. NAAS can convert your figure files to the TIFF file type and meet basic requirements (such as print size, resolution), or provide you with a report on issues that do not meet our requirements and that NAAS cannot fix.-->--> After uploading your figures to PLOS’s NAAS tool - https://ngplosjournals.pagemajik.ai/artanalysis, NAAS will process the files provided and display the results in the "Uploaded Files" section of the page as the processing is complete. If the uploaded figures meet our requirements (or NAAS is able to fix the files to meet our requirements), the figure will be marked as "fixed" above. If NAAS is unable to fix the files, a red "failed" label will appear above. When NAAS has confirmed that the figure files meet our requirements, please download the file via the download option, and include these NAAS processed figure files when submitting your revised manuscript.--> Reproducibility: To enhance the reproducibility of your results, we recommend that authors of applicable studies deposit laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols 28 Apr 2026 Submitted filename: REV2_response_letter.pdf 13 May 2026 Dear Dr Kwon, We are pleased to inform you that your manuscript 'Utilizing virus genomic surveillance to predict vaccine effectiveness' has been provisionally accepted for publication in PLOS Computational Biology. Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests. Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated. IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript. Should you, your institution's press office or the journal office choose to press release your paper, you will automatically be opted out of early publication. We ask that you notify us now if you or your institution is planning to press release the article. All press must be co-ordinated with PLOS. Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Computational Biology. Best regards, Joel O. Wertheim Academic Editor PLOS Computational Biology Thomas Leitner Section Editor PLOS Computational Biology *********************************************************** PCOMPBIOL-D-25-01498R2 Utilizing virus genomic surveillance to predict vaccine effectiveness Dear Dr Kwon, I am pleased to inform you that your manuscript has been formally accepted for publication in PLOS Computational Biology. Your manuscript is now with our production department and you will be notified of the publication date in due course. The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript. Soon after your final files are uploaded, unless you have opted out, the early version of your manuscript will be published online. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers. For Research, Software, and Methods articles, you will receive an invoice from PLOS for your publication fee after your manuscript has reached the completed accept phase. If you receive an email requesting payment before acceptance or for any other service, this may be a phishing scheme. Learn how to identify phishing emails and protect your accounts at https://explore.plos.org/phishing. Thank you again for supporting PLOS Computational Biology and open-access publishing. We are looking forward to publishing your work! With kind regards, Anita Estes PLOS Computational Biology | Carlyle House, Carlyle Road, Cambridge CB4 3DN | United Kingdom ploscompbiol@plos.org | Phone +44 (0) 1223-442824 | ploscompbiol.org | @PLOSCompBiol