Skip to main content
Advertisement
  • Loading metrics

Association between primary or booster COVID-19 mRNA vaccination and Omicron lineage BA.1 SARS-CoV-2 infection in people with a prior SARS-CoV-2 infection: A test-negative case–control analysis

  • Margaret L. Lind ,

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Validation, Visualization, Writing – original draft, Writing – review & editing

    Margaret.Lind@yale.edu (MLL); Albert.Ko@yale.edu (AIK)

    Affiliation Department of Epidemiology of Microbial Diseases, Yale School of Public Health, New Haven, Connecticut, United States of America

  • Alexander J. Robertson,

    Roles Conceptualization, Data curation, Formal analysis, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Department of Epidemiology of Microbial Diseases, Yale School of Public Health, New Haven, Connecticut, United States of America

  • Julio Silva,

    Roles Conceptualization, Writing – review & editing

    Affiliation Department of Immunobiology, Yale University School of Medicine, New Haven, Connecticut, United States of America

  • Frederick Warner,

    Roles Data curation, Writing – review & editing

    Affiliations Section of Cardiovascular Medicine, Department of Internal Medicine, Yale School of Medicine, New Haven, Connecticut, United States of America, Center for Outcomes Research and Evaluation, Yale-New Haven Hospital, New Haven, Connecticut, United States of America

  • Andreas C. Coppi,

    Roles Conceptualization, Writing – review & editing

    Affiliations Section of Cardiovascular Medicine, Department of Internal Medicine, Yale School of Medicine, New Haven, Connecticut, United States of America, Center for Outcomes Research and Evaluation, Yale-New Haven Hospital, New Haven, Connecticut, United States of America

  • Nathan Price,

    Roles Data curation, Writing – review & editing

    Affiliations Section of Cardiovascular Medicine, Department of Internal Medicine, Yale School of Medicine, New Haven, Connecticut, United States of America, Center for Outcomes Research and Evaluation, Yale-New Haven Hospital, New Haven, Connecticut, United States of America

  • Chelsea Duckwall,

    Roles Data curation, Project administration, Writing – review & editing

    Affiliation Department of Epidemiology of Microbial Diseases, Yale School of Public Health, New Haven, Connecticut, United States of America

  • Peri Sosensky,

    Roles Project administration, Writing – review & editing

    Affiliation Department of Epidemiology of Microbial Diseases, Yale School of Public Health, New Haven, Connecticut, United States of America

  • Erendira C. Di Giuseppe,

    Roles Project administration, Writing – review & editing

    Affiliation Department of Epidemiology of Microbial Diseases, Yale School of Public Health, New Haven, Connecticut, United States of America

  • Ryan Borg,

    Roles Project administration, Writing – review & editing

    Affiliation Department of Epidemiology of Microbial Diseases, Yale School of Public Health, New Haven, Connecticut, United States of America

  • Mariam O. Fofana,

    Roles Writing – review & editing

    Affiliation Department of Epidemiology of Microbial Diseases, Yale School of Public Health, New Haven, Connecticut, United States of America

  • Otavio T. Ranzani,

    Roles Writing – review & editing

    Affiliations Barcelona Institute for Global Health, ISGlobal, Universitat Pompeu Fabra (UPF), Barcelona, Spain, CIBER Epidemiología y Salud Pública (CIBERESP), Madrid, Spain, Pulmonary Division, Heart Institute, Hospital das Clínicas, Faculdade de Medicina, São Paulo, Brazil

  • Natalie E. Dean,

    Roles Writing – review & editing

    Affiliation Department of Biostatistics & Bioinformatics, Rollins School of Public Health, Emory University, Atlanta, Georgia, United States of America

  • Jason R. Andrews,

    Roles Writing – review & editing

    Affiliation Division of Infectious Diseases and Geographic Medicine, Stanford University, Stanford, California, United States of America

  • Julio Croda,

    Roles Writing – review & editing

    Affiliations Department of Epidemiology of Microbial Diseases, Yale School of Public Health, New Haven, Connecticut, United States of America, Fiocruz Mato Grosso do Sul, Fundação Oswaldo Cruz, Campo Grande, Brazil, Universidade Federal de Mato Grosso do Sul, Campo Grande, Brazil

  • Akiko Iwasaki,

    Roles Supervision, Writing – review & editing

    Affiliations Department of Immunobiology, Yale University School of Medicine, New Haven, Connecticut, United States of America, Howard Hughes Medical Institute, Chevy Chase, Maryland, United States of America

  • Derek A. T. Cummings ,

    Roles Conceptualization, Investigation, Methodology, Supervision, Writing – original draft

    ‡ These authors are joint senior authors and contributed equally to this work.

    Affiliations Department of Biology, University of Florida, Gainesville, Florida, United States of America, Emerging Pathogens Institute, University of Florida, Gainesville, Florida, United States of America

  • Albert I. Ko ,

    Roles Conceptualization, Investigation, Methodology, Supervision, Writing – review & editing

    Margaret.Lind@yale.edu (MLL); Albert.Ko@yale.edu (AIK)

    ‡ These authors are joint senior authors and contributed equally to this work.

    Affiliations Department of Epidemiology of Microbial Diseases, Yale School of Public Health, New Haven, Connecticut, United States of America, Instituto Gonçalo Moniz, Fundação Oswaldo Cruz, Salvador, Brazil

  • Matt D. T. Hitchings ,

    Roles Conceptualization, Investigation, Methodology, Supervision, Writing – original draft, Writing – review & editing

    ‡ These authors are joint senior authors and contributed equally to this work.

    Affiliation Department of Biostatistics, College of Public Health and Health Professions & College of Medicine, University of Florida, Gainesville, Florida, United States of America

  •  [ ... ],
  • Wade L. Schulz

    Roles Conceptualization, Data curation, Writing – review & editing

    ‡ These authors are joint senior authors and contributed equally to this work.

    Affiliations Department of Internal Medicine, Yale School of Medicine, New Haven, Connecticut, United States of America, Department of Laboratory Medicine, Yale University School of Medicine, New Haven, Connecticut, United States of America

  • [ view all ]
  • [ view less ]

Abstract

Background

The benefit of primary and booster vaccination in people who experienced a prior Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) infection remains unclear. The objective of this study was to estimate the effectiveness of primary (two-dose series) and booster (third dose) mRNA vaccination against Omicron (lineage BA.1) infection among people with a prior documented infection.

Methods and findings

We conducted a test-negative case–control study of reverse transcription PCRs (RT-PCRs) analyzed with the TaqPath (Thermo Fisher Scientific) assay and recorded in the Yale New Haven Health system from November 1, 2021, to April 30, 2022. Overall, 11,307 cases (positive TaqPath analyzed RT-PCRs with S-gene target failure [SGTF]) and 130,041 controls (negative TaqPath analyzed RT-PCRs) were included (median age: cases: 35 years, controls: 39 years). Among cases and controls, 5.9% and 8.1% had a documented prior infection (positive SARS-CoV-2 test record ≥90 days prior to the included test), respectively. We estimated the effectiveness of primary and booster vaccination relative to SGTF-defined Omicron (lineage BA.1) variant infection using a logistic regression adjusted for date of test, age, sex, race/ethnicity, insurance, comorbidities, social venerability index, municipality, and healthcare utilization. The effectiveness of primary vaccination 14 to 149 days after the second dose was 41.0% (95% confidence interval (CI): 14.1% to 59.4%, p 0.006) and 27.1% (95% CI: 18.7% to 34.6%, p < 0.001) for people with and without a documented prior infection, respectively. The effectiveness of booster vaccination (14 days after booster dose) was 47.1% (95% CI: 22.4% to 63.9%, p 0.001) and 54.1% (95% CI: 49.2% to 58.4%, p < 0.001) in people with and without a documented prior infection, respectively. To test whether booster vaccination reduced the risk of infection beyond that of the primary series, we compared the odds of infection among boosted (14 days after booster dose) and booster-eligible people (150 days after second dose). The odds ratio (OR) comparing boosted and booster-eligible people with a documented prior infection was 0.79 (95% CI: 0.54 to 1.16, p 0.222), whereas the OR comparing boosted and booster-eligible people without a documented prior infection was 0.54 (95% CI: 0.49 to 0.59, p < 0.001). This study’s limitations include the risk of residual confounding, the use of data from a single system, and the reliance on TaqPath analyzed RT-PCR results.

Conclusions

In this study, we observed that primary vaccination provided significant but limited protection against Omicron (lineage BA.1) infection among people with and without a documented prior infection. While booster vaccination was associated with additional protection against Omicron BA.1 infection in people without a documented prior infection, it was not found to be associated with additional protection among people with a documented prior infection. These findings support primary vaccination in people regardless of documented prior infection status but suggest that infection history may impact the relative benefit of booster doses.

Author summary

Why was this study done?

  • mRNA COVID-19 vaccines provide lower levels of protection against Omicron (BA.1 lineage) infections than previously circulating variants.
  • Prior to the emergence of the Omicron variant, primary vaccination (first two mRNA vaccine doses) afforded protection against reinfection among people with prior infections.
  • The benefit of primary and booster vaccination against Omicron (BA.1 lineage) infections remains unclear among people with prior infections.

What did the researchers do and find?

  • We evaluated the benefit of primary series and booster mRNA vaccine doses against Omicron (BA.1 lineage, defined by S-gene target failure) infection among people with and without documented prior infections.
  • We found that primary vaccination was associated with statistically significant but low levels of protection against Omicron (BA.1 lineage) infection among people with and without a documented prior infection.
  • Booster vaccination was found to be associated with protection beyond that afforded by the primary series among people without a documented prior infection, but we did not observe a significant increase in protection among people with a documented prior infection.

What do these findings mean?

  • Primary vaccination provides limited but significant protection against Omicron (BA.1 lineage) infection regardless of prior infection history.
  • The relative benefits of a booster dose may be affected by a person’s history of prior SARS-CoV-2 infection.

Introduction

Although Coronavirus Disease 2019 (COVID-19) vaccines provide lower levels of protection against the B.1.1.529 (Omicron) than the B.1.617.2 (Delta) variant of Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2), current evidence indicates that primary and booster mRNA (third) vaccination significantly reduces the risk of Omicron-related infection and poor outcomes in the general population [16]. However, the benefit of vaccination in people with a prior SARS-CoV-2 infection remains uncertain. Previous studies, conducted prior to the Omicron epidemic wave, found that primary vaccination (two doses) afforded protection against reinfection beyond that provided by a prior infection [710] and that a booster dose significantly increase such protection [11]. In contrast, Shrestha and colleagues found that primary vaccination did not provide additional protection (hazard ratio, 0.77, 95% confidence interval (CI): 0.53 to 1.12) against SARS-CoV-2 reinfection among previously infected people during the first month of the Omicron wave [12]. Furthermore, evidence is lacking for the additional benefit of booster vaccination against Omicron infection in people with a documented prior infection, which is needed to inform vaccination policies for this subpopulation.

In this study, we analyzed data from a large cohort of people receiving care in the Yale New Haven Health system who underwent molecular testing for S-gene target failure (SGTF) to evaluate the benefit of primary series and booster doses in the context of the Omicron wave. Specifically, we estimated the effectiveness of primary and booster vaccination against Omicron (lineage BA.1) infection among people with and without a documented prior SARS-CoV-2 infection. We also examined whether booster vaccination reduced the risk of Omicron (lineage BA.1) infection beyond that afforded by primary vaccination among people with and without a prior documented infection.

Methods

Study setting and population

We conducted a test-negative case–control (TNCC) analysis using data collected as part of the Studying COVID-19 Outcomes after SARS-CoV-2 Infection and Vaccination (SUCCESS) Study in the Yale New Haven Health System (YNHH). The study was designed in January 2022 and executed in May 2022. As part of the peer review process, Wald test P values were extracted from the described regressions, the unadjusted analyses were performed, and the bias indicator was added. The YNHH is a large academic health system comprising five hospital delivery networks and associated outpatient clinics in Connecticut, New York, and Rhode Island. We chose the TNCC design because it has been shown to provide effectiveness estimates consistent with those from randomized controlled trials, has been widely applied to estimate real-world effectiveness for COVID-19 vaccines, and mitigates the risk of confounding introduced by differences in care-seeking and testing access [1,1316].

The study population comprised vaccine-eligible (5 years of age) people who were alive at the beginning of the study period and had at least one SARS-CoV-2 test in the electronic medical records (EMRs). We identified SARS-CoV-2 reverse transcription PCR (RT-PCR) tests that were collected from the study population and performed with the TaqPath COVID-19 (Thermo Fisher Scientific) diagnostic assay between November 1, 2021 and April 30, 2022, the period prior to and during the Omicron (lineage BA.1) epidemic wave in Connecticut (Fig 1). At the beginning of the study, Delta was the predominant variant in Connecticut, accounting for 99.63% (3,808 of 3,822) of the sequenced samples deposited in the GISAID database that were collected between November 1 and November 28, 2021 [17]. We used the TaqPath assay to select tests as cases and controls since its S-gene probe, which fails for Omicron (lineage BA.1) but not for Delta, allows for prediction of an Omicron (lineage BA.1) infection when the primary circulating variants are Omicron (lineage BA.1) and Delta [18].

We excluded tests that were performed after receiving a heterologous primary vaccination (i.e., different first and second dose manufacturers) or an Ad26.COV2 vaccine dose. Additionally, we excluded tests that were performed among people who received booster doses prior to eligibility (defined as five months since second primary vaccine dose and after booster vaccination approval in the US [September 22, 2021]) [19]. We excluded tests that were performed in the 90 days after a positive SARS-CoV-2 test (rapid antigen or RT-PCR), had a positive reflex result with an inconclusive SGTF finding, were obtained from people with more than one prior SARS-CoV-2 infection or with missing confounder data, or occurred after a second booster (fourth) dose (Fig 2).

The Yale Computational Health Platform was used to extract demographic, comorbidity, COVID-19 vaccination, and SARS-CoV-2 testing data from EMR [20,21]. As an organization in EPIC’s Care Everywhere Network, YNHH’s EMR contains records from all participating health systems and organizations [22]. Additional COVID-19 vaccination records from the state vaccination registry were linked to the YNHH medical records and extracted through the same platform. The Yale Institutional Review Board approved this study and waived the need for informed consent (ID# 2000030222). This study is reported as per the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) guideline (S1 STROBE Checklist).

thumbnail
Fig 1. Daily Omicron lineage BA.1 (SGTF) and other variant (non-SGTF) SARS-CoV-2 infections identified during TaqPath testing at the YNHH between November 1, 2021 and April 30, 2022.

TaqPath COVID-19 (Thermo Fisher Scientific) confirmed SARS-CoV-2 infections among vaccine-eligible individuals. Infections were classified as Omicron (lineage BA.1) based on presence of SGTF. COVID-19, Coronavirus Disease 2019; SARS-CoV-2, Severe Acute Respiratory Syndrome Coronavirus 2; SGTF, S-gene target failure; YNHH, Yale New Haven Health System.

https://doi.org/10.1371/journal.pmed.1004136.g001

thumbnail
Fig 2. Selection of tests for the case–control analysis.

The sample was limited to RT-PCRs run on the TaqPath COVID-19 (Thermo Fisher Scientific) assay among vaccine-eligible individuals. Case status was defined based on the reflex results. We included all positive tests (cases) and up to three negative tests (controls) per person. Cases and controls were stratified by presence of a documented prior infection (a positive RT-PCR or rapid antigen test at least 90 days before the included test). aVaccine eligibility was defined as age ≥5 years. bThe first SGTF defined Omicron (BA.1 lineage) variant infection in the study population was identified on November 11, 2021. cSamples with a positive reflex RT-PCR but that did not meet our SGTF definition (an ORF1ab Ct value of <30 and S-gene Ct–ORF1ab Ct value ≥5; or 2] ORF1ab Ct value <30 and S-gene Ct value ≥40. dExcluded tests that were performed after a person was given a booster dose before FDA authorization or that was given less than 150 days after primary vaccination completion. eThe median time between the 640 dropped positives and the prior positive was 5 days (first-third quartiles: 3 to 7 days). fThere were 134 people with missing SVI data, 40 people with missing sex data and none with missing age data. People were allowed to contribute up to three negative tests to the control sample. If they had more than three negative tests over the study period, three tests were randomly selected. If a person had more than one negative test within a 7-day period, one test performed within that period was randomly selected. COVID-19, Coronavirus Disease 2019; RT-PCR, reverse transcription PCR; SGTF, S-gene target failure.

https://doi.org/10.1371/journal.pmed.1004136.g002

Exposures

Our exposure of interest was time from completion of primary (two doses) and booster (third dose) vaccination with mRNA-1273 or BNT162b2. We stratified vaccination by time since dose (<14 days since second dose, 14 to 149 days since second dose, ≥150 days since second dose but prior to booster dose, <14 days since booster dose, 14 to 59 days since booster dose, 60 to 89 days since booster dose and ≥90 days since booster dose). Tests were further stratified by a history of a documented prior SARS-CoV-2 infection, defined as a positive RT-PCR or rapid antigen test result in the medical record ≥90 days before the included test (with testing going back to March 2020).

Case and control definition and selection

A case of test-positive Omicron (lineage BA.1) infection was a positive SARS-CoV-2 RT-PCR test with SGTF, defined as (1) an ORF1ab Ct value of <30 and S-gene Ct–ORF1ab Ct value ≥5; or (2) ORF1ab Ct value <30 and S-gene Ct value ≥40 [18,23]. We defined eligible controls as negative SARS-CoV-2 RT-PCR test collected ≥7 days prior to a positive test or in the absence of a prior positive test and ≥7 days prior to the end of the study period (to account for test reporting delays). People were allowed to contribute both cases and controls, and our sample included all eligible cases and up to three negative tests (controls) per person during the study period. If a person had more than one negative test within a seven-day period, one random test was selected during the period as a control.

Statistical analysis

We conducted two primary analyses, each stratified by documented prior SARS-CoV-2 infection status. First, using all identified cases and controls, we estimated vaccine effectiveness as one minus the odds ratio (OR) of vaccination among cases and controls. Under the assumption of the TNCC design, the OR from this analysis estimates the effectiveness of vaccination against infection [24]. Second, we examined whether a booster dose was associated with increased protection beyond that afforded by the primary series by comparing the odds of infection among recently boosted people (14 to 59 days after booster dose) to the odds among booster-eligible people. In alignment with CDC booster dose recommendations at the time of analysis [25], we defined booster-eligible people as people aged ≥12 years who completed their primary series ≥150 days (five months) prior to the included test and had not received a booster dose. For this analysis, we were interested in the level of protection associated with a booster dose. For that reason, we limited our analysis to booster eligible persons (aged ≥12 years) and to the first documented infection after booster dose administration by excluding case and control tests performed after the first recorded infection following booster dose administration.

As a secondary analysis, we evaluated whether the odds of infection changed over time after the administration of a booster dose by comparing the odds of infection among recently boosted people (14 to 59 days after booster dose) to the odds of infection among people who received their booster dose 60 to 89 and ≥90 days prior to testing [26]. Further, to test if changes in the odds of infection over time since booster dose receipt resulted in a loss of protection relative to booster-eligible individuals, we compared the odds of infection among people who received their booster dose 60 to 89 and ≥90 days prior to testing to the odds of infection among booster-eligible people. Since there was a limited number of boosted people with a prior SARS-CoV-2 infection (n = 680), the secondary analysis was restricted to cases and controls identified among people without a documented prior infection.

A mixed effects generalized additive logistic regression was used to evaluate associations. We included the following a priori selected covariates: date of test (continuous), age (continuous), sex, race/ethnicity (self-reported record in EMR), Charlson comorbidity score as of December 2020 (categorized as 0, 1–2, 3–4, 5+) [27], number of nonemergent YNHH encounters in the year prior to vaccine rollout in Connecticut (December 2020; categorized as 0, 1–2, 3–4, 5+), insurance group (uninsured, Medicaid, Medicare, other), social vulnerability index (SVI) of residential zip code (continuous), and municipality of residence (as captured in the EMR). Continuous factors were modeled using a natural spline with 3 knots, and we included a random intercept for municipality [28,29]. SVI is an estimate of a community’s vulnerability that comprises 15 factors including poverty level, access to transportation, and crowded housing [30]. To account for waning infection-mediated immunity, we included time since prior SARS-CoV-2 infection as a continuous factor in analyses limited to people with a documented prior infection. Significance was defined using an alpha of 0.05 and all tests were two-sided. All analyses were conducted in R, version 4.1.2 [31].

Bias indicator and sensitivity analyses

To examine the extent of unmeasured confounding in our analysis, we compared the odds of infection among recently vaccinated people (1 to 13 days after first dose administration) to the odds of infection among unvaccinated people. As outlined in Hitchings and colleagues, the comparison of vaccinated and unvaccinated people during this period can be interpreted as the relative difference in infection risk between vaccinated and unvaccinated groups due to factors other than vaccination [32]. This analysis was performed among all cases and controls and among cases and controls stratified by a documented prior infection.

We performed multiple sensitivity analyses to ensure our findings were robust to alternative study design, data cleaning, and modeling assumptions. Specifically, we tested the robustness of our findings to the following scenarios: 1:1 matching with replacement, exclusion of heterologous booster doses, inclusion of tests among people with more than one documented prior infection, exclusion of discordant test results, inclusion of positive TaqPath results with inconclusive SGTF (included as negative tests), and inclusion of all controls. To examine if the temporality of prior SARS-CoV-2 infection and vaccinations impacted estimates of vaccine effectiveness among people with a documented prior infection, we conducted an analysis where we excluded tests performed among people whose prior SARS-CoV-2 infection occurred after the first dose of primary vaccination. Additionally, to evaluate whether waning of protection associated with primary vaccination influenced the risk comparisons between boosted and booster-eligible people, we conducted sensitivity analyses that were restricted to tests collected among people who completed primary vaccination ≥150 days prior to testing and adjusted for time since completion of primary vaccination. For a detailed description, see Supporting information S1 Text.

Results

Study population

Between November 1, 2021, and April 30, 2022, we identified 174,259 SARS-CoV-2 tests performed with the TaqPath assay on samples obtained from 121,967 unique people in the YNHH system (Fig 2). The first SGTF-defined Omicron (lineage BA.1) infection in the study population was identified on November 11, 2021 (Fig 1). Of the 152,109 eligible tests, 11,307 were identified as Omicron (lineage BA.1) infections (cases), contributed from 11,307 unique people. From the 140,802 negative RT-PCRs, we randomly selected up to three negative tests (controls) per person, resulting in 130,041 controls (Fig 2). The average number of controls per person were similar among people who contributed a case (1.47, SD: 0.75) and people who did not contribute a case (1.31, SD: 0.62).

Cases and controls had similar characteristics with respect to age, sex, SVI of residential zip code, and Charlson comorbidity score (Table 1). However, a larger proportion of Omicron (lineage BA.1) cases occurred among non-Hispanic black people (16.1% versus 10.2% in controls) and those who were uninsured (11.2% versus 7.6% in controls) or received Medicaid (22.2% versus 13.3% in controls). Among boosted people, the median time between booster vaccination and testing was similar for cases (57 days [first-third quartile: 29 to 83 days]) and controls (47 days [first-third quartile: 26 to 76 days]). Among cases and controls, 5.9% (672/11,307) and 8.1% (10,473/130,041) had a prior SARS-CoV-2 infection. The time between a documented prior infection and testing was similar for cases (375 days [first-third quartile: 296 to 420 days]) and controls (332 days [first-third quartile: 256 to 391 days]; Table 1) The vast majority (98.7%, 11,002/11,145) of prior documented infections occurred before the emergence of Omicron in November 2021 and 99.6% (11,097/11,145) occurred before Omicron became the dominate circulating variant in Connecticut [17,33].

thumbnail
Table 1. Characteristics of SARS-CoV-2 tests included as cases or controls between November 1, 2021 and April 30, 2022.

https://doi.org/10.1371/journal.pmed.1004136.t001

Risk of Omicron (lineage BA.1) infection among boosted and booster-eligible people

During the period prior to booster eligibility (14 to 149 days after second dose), the effectiveness of primary mRNA vaccination against Omicron (lineage BA.1) infection was 41.0% (95% CI: 14.1% to 59.4%, p 0.006) and 27.1% (95% CI: 18.7% to 34.6%, p < 0.001) for people with and without a documented prior infection, respectively. During the period of booster eligibility (150+ days after second dose), the effectiveness of primary vaccination was 32.1% (95% CI: 16.6% to 44.7%, p < 0.001) for people with and 13.6% (95% CI: 8.7% to 18.2%, p < 0.001) for people without a documented prior infection. Vaccine effectiveness in the period 14 to 59 days after a booster dose was 47.1% (95% CI: 22.4% to 63.9%, p 0.001) and 54.1% (95% CI: 49.2% to 58.4%, p < 0.001) for people with and without a documented prior infection, respectively (Fig 3).

Among people without a documented prior infection, the odds of Omicron (lineage BA.1) infection were 0.54 (95% CI: 0.49 to 0.59, p < 0.001) times lower for boosted than booster-eligible people. Conversely, the odds of infection did not differ significantly between boosted and booster-eligible people with a documented prior infection (OR: 0.79, 95% CI: 0.54 to 1.16, p 0.222). Ten controls (negative RT-PCR tests) were collected among people with a documented prior infection that occurred after they received their booster dose and were excluded from this analysis (Table 2).

thumbnail
Table 2. Risk of SARS-CoV-2 Omicron (BA.1 lineage) variant infection among people who received booster vaccination relative to booster-eligible people, according to history of a documented prior SARS-CoV-2 infection.

https://doi.org/10.1371/journal.pmed.1004136.t002

In the secondary analysis that was restricted to people without a documented prior infection, the odds of Omicron (lineage BA.1) infection increased over time since booster vaccination and were significantly higher 90+ days after a booster dose relative to the period 14 to 59 days after the dose (OR: 1.78, 95% CI: 1.41 to 2.25, p < 0.001) (S1 Table). Yet, the odds of infection among boosted people 90+ days after the booster dose was lower than the odds among booster-eligible people (OR: 0.80, 95% CI: 0.66 to 0.98, p 0.030) (Table 3).

thumbnail
Table 3. Risk of SARS-CoV-2 Omicron (BA.1 lineage) variant infection among people who received booster vaccination relative to booster-eligible peoplea, according to time after receiving a booster vaccine dose.

https://doi.org/10.1371/journal.pmed.1004136.t003

thumbnail
Fig 3. Effectiveness of primary and booster vaccination with COVID-19 mRNA vaccines against SARS-CoV-2 Omicron (BA.1 lineage) variant infections, stratified by the history of a documented prior SARS-CoV-2 infection.

Forest plot depicting vaccine effectiveness against Omicron (lineage BA.1) infections for US-approved mRNA vaccines (BNT162b2 and mRNA-1273) among people with and without a documented prior infection. A documented prior infection was defined as a positive RT-PCR or rapid antigen test at least 90 days before the included test. Omicron (lineage BA.1) infection was defined as the presence of SGTF defined as ORF1ab Ct <30 and S-gene–ORF1ab ≥ 5, or ORF1ab <30 and S-gene ≥ 40. Vaccine effectiveness was estimated as one minus the OR from a model adjusted for date of test, age, sex, race/ethnicity, Charlson comorbidity score, number of nonemergent visits in the year prior to the vaccine rollout in Connecticut, insurance status, municipality, and SVI of residential zip code in all analyses and time between testing and last documented prior infection in analyses of people with a documented prior infection. COVID-19, Coronavirus Disease 2019; OR, odds ratio; RT-PCR, reverse transcription PCR; SARS-CoV-2, Severe Acute Respiratory Syndrome Coronavirus 2; SGTF, S-gene target failure; SVI, social vulnerability index.

https://doi.org/10.1371/journal.pmed.1004136.g003

Bias indicator and sensitivity analyses

We estimated the reduction in infection risk during the 13 days after first dose administration as an indicator of potential bias. From this analysis, we observe some difference in risk among our groups during this period but with low precision (all tests: 23.2%, 95% CI: −8.8% to 45.8%, p 0.138) (S2 Table).

In sensitivity analyses, the effectiveness of booster vaccination against Omicron (lineage BA.1) infection (≥14 days after the booster dose) ranged from 35.7% to 50.7% for people with a documented prior infection and from 51.3% to 55.9% for people without a documented prior infection (Figs A-H in S1 Text). Compared with the primary analysis, we observed a smaller sample size and lower precision (wider CIs) from our matched (1:1 with replacement) analysis (matched analysis CIs were ≥3.4 units wider than primary analysis; Fig A in S1 Text). Following the exclusion of tests collected among people whose documented prior infection occurred after their first vaccine dose, we observed nonsignificantly lower effectiveness estimates for primary (14 to 149 days after second dose: 39.5%, 95% CI: 12.0% to 58.4%, p 0.009) and booster (≥14 days after booster dose: 45.7%, 95% CI: 20.3% to 62.9%, p 0.002) vaccination (Fig H in S1 Text). Adjusting for time between testing and completion of primary vaccination did not significantly alter the estimated association between booster doses and Omicron (lineage BA.1) infections among people with a documented prior infection (OR: 0.75, 95% CI: 0.50 to 1.13, p 0.165) or without a documented prior infection (OR: 0.57, 95% CI: 0.51 to 0.63, p < 0.001) (Table A in S1 Text).

Discussion

Leveraging data from a large population of Connecticut and nearby state residents, we examined the effectiveness of primary and booster mRNA vaccination against Omicron (lineage BA.1) infections among vaccine-eligible people with and without a documented prior infection. We found that primary vaccination was associated with significant but low levels of protection among people with and without a documented prior infection. While booster vaccination was associated with protection beyond that afforded by the primary series in people without a documented prior infection, we did not identify a significant increase in protection among people with a documented prior infection.

Contrary to the findings of Shrestha and colleagues [12], our analysis, which ascertained Omicron (lineage BA.1) infection in cases by the presence of SGTF and had increased precision for vaccine effectiveness, found that primary vaccination was associated with a significant reduction in the risk (41.0%, 95% CI: 14.1% to 59.4%, p 0.006) of Omicron (lineage BA.1) infection among people with a documented prior infection. Though we found the level of protection afforded by primary vaccination to be low, our findings suggest that primary vaccination may be warranted regardless of documented prior infection status.

Our estimate of booster vaccination effectiveness among people with a documented prior infection had a smaller sample size and reduced precision (37 cases, 95% CI: 22.4% to 63.9%) compared to the estimate for people without a documented prior infection (549 cases, 95% CI: 49.2% to 58.4%). However, in a parallel analysis, the odds of infection did not differ significantly (OR: 0.79, 95% CI: 0.54 to 1.16, p 0.222) between boosted and booster-eligible people with a documented prior SARS-CoV-2 infection but differed significantly for people without a prior documented infection (OR: 0.54, 95% CI: 0.49 to 0.59, p < 0.001).

While differences in the estimates for people with and without a documented prior infection may be partially driven by differences in care-seeking behaviors, together, these findings suggest that the benefit of booster doses among booster-eligible individuals without a documented prior infection may be greater than the benefit among booster-eligible people with a documented prior infection. They further suggest that boosters may not confer additional protection beyond that afforded by primary vaccination among previously infected people. However, another study looking at the same question among staff and residents of correctional facilities found that booster doses provided significant additional protection among people with prior infections [34]. While their population is highly specific, these alternative findings, along with the reduced precision of our estimates among people with a documented prior infection, indicate the need for additional research examining the benefits of booster doses within this subpopulation.

In alignment with prior studies [1,8,35], we found the risk of Omicron (lineage BA.1) infection among boosted people without a documented prior infection increased significantly three months after booster dose administration. However, the odds of infection among boosted people remained significantly lower than the odds among booster-eligible people (OR: 0.80, 95% CI: 0.66 to 0.98, p 0.030). Thus, even with the decline in protection, booster vaccination appears to provide additional protection beyond that conferred by primary vaccination in people without a documented prior SARS-CoV-2 infection.

Weekly testing for certain unvaccinated professionals, such as employees of healthcare facilities that accept Medicare and/or Medicaid or Connecticut state employees, was required by the state and federal government during the study period [36,37]. Because such requirements resulted in increased testing among unvaccinated but not vaccinated persons, our vaccine effectiveness estimates are likely conservative. Further, this may explain the higher proportion of unvaccinated people we observed compared to the state vaccination coverage (unvaccinated cases: 50%, unvaccinated controls; 48%, state vaccination coverage [April 27, 2022]: range between 48.8% for people 5 to 11 years old and 100% for people 65 to 74 years old) [38]. However, the bias introduced by required testing does not extend to the comparisons among vaccinated groups and our findings comparing boosted to booster-eligible people are likely to be unaffected by testing policies.

Our analysis was limited to a population of Connecticut residents and was reliant on medical record data that is subject to misclassification. In the place of whole genome sequence data, we used SGTF status to ascertain Omicron infections as cases. SGTF as a proxy for Omicron status has been widely used during the Omicron epidemic wave in the winter of 2021 to 2022 and has been recommended as an indicator of Omicron lineage BA.1 infection by WHO [23]. However, the use of this variant designation resulted in our analysis being limited to Omicron lineage BA.1 and may have resulted in the exclusion of coinfections (infection with both Omicron lineage BA.1 and another SARS-CoV-2 variant without SGTF) that did not meet our outcome definition. TaqPath testing was primarily employed in the YNHH outpatient setting and thus disproportionately represents mild cases of SARS-CoV-2 infection. However, our SGTF definition required Ct values <30, which may be biased towards more severe illness. These sampling restrictions may impact the generalizability of our findings.

We did not have adequate sample to evaluate the level of protection conferred by two or more documented prior infections (n = 77) or to examine vaccine effectiveness among people who received two booster doses. We expect a proportion of prior SARS-CoV-2 infections may have gone undetected and that ascertainment of documented prior infection history may be subject to misclassification. Nevertheless, our analyses that are restricted to people with a documented prior infection are unaffected by such misclassification. For the OR comparing vaccination between test-positive cases and test-negative controls to equal the vaccine effectiveness against infection, the following assumptions must hold: (1) vaccination must be uncorrelated with exposure or susceptibility to infection; (2) testing behaviors must be uncorrelated with vaccination status; and (3) vaccination must confer all-or-nothing protection. Despite accounting for numerous factors that either confound the relationship between vaccination and exposure or between vaccination and testing (including recent healthcare utilization and SVI), residual confounding and differential healthcare-seeking behavior may persist. However, our bias indicator (the association between recent vaccination [1 to 13 days after first dose administration] and infection) did not indicate any sizeable bias. Though we could not test if the mechanism of protection was all-or-nothing, this assumption is fundamental to vaccine effectiveness analyses (including randomized control trials) and would remain applicable under an alternative design approach [24].

Prior theoretical work has cautioned that if vaccination reduces disease severity, the results of a TNCC study may be subject to bias. While we did not have adequate sample to restrict our analysis to symptomatic infections (1,584 cases) and reduce the potential for this bias, the small sample size stems from the mild disease presentation in our examined sample (as discussed previously). If we assume that vaccination reduces severity, this overrepresentation of mild infections would likely result in a disproportionately high number of infections among vaccinated people and could result in conservative effectiveness estimates. Finally, the analyses were not powered to test associations for severe COVID-19; we therefore cannot exclude that booster vaccination may increase protection against such outcomes in people with a prior SARS-CoV-2 infection, as others have concluded [39].

Primary vaccination with two COVID-19 mRNA vaccine doses provided significant but limited protection against Omicron (lineage BA.1) infection among people with and without a prior SARS-CoV-2 infection. While booster vaccination resulted in additional protection beyond that afforded by the primary vaccination among people without a documented prior infection, it did not result in additional protection among previously infected people. These findings support primary vaccination regardless of prior infection history but suggest that a person’s history of prior SARS-CoV-2 infection may affect the relative benefit of booster doses.

Supporting information

S1 Text. Sensitivity analyses.

Supporting information holding the description and results from the sensitivity analyses discussed in the manuscript. Fig A in S1 Text. Forest plot of vaccine effectiveness from matched analysis, stratified by the history of a prior SARS-CoV-2 infection. Fig B in S1 Text. Number of events among boosted individual by primary and booster dose vaccine brand. Fig C in S1 Text. Forest plot of vaccine effectiveness exclusive of test among people with a heterologous booster dose, stratified by the history of a prior SARS-CoV-2 infection. Fig D in S1 Text. Forest plot of vaccine effectiveness following the inclusion of tests collected after multiple prior positives, stratified by the history of a prior SARS-CoV-2 infection. Fig E in S11 Text. Forest plot of vaccine effectiveness exclusive of discordant Thermo Fisher and reflex resulted tests, stratified by the history of a prior SARS-CoV-2 infection. Fig F in S1 Text. Forest plot of vaccine effectiveness following the inclusion of inconclusive SGTF as controls, stratified by the history of a prior SARS-CoV-2 infection. Fig G in S1 Text. Forest plot of vaccine effectiveness inclusive of all controls, stratified by the history of a prior SARS-CoV-2 infection. Fig H in S1 Text. Forest plot of vaccine effectiveness following the exclusion of tests among people with prior infections after a vaccine dose, stratified by the history of a prior SARS-CoV-2 infection. Table A in S1 Text. Association between booster dose and risk of SARS-CoV-2 Omicron variant infection by prior SARS-CoV-2 infection history.

https://doi.org/10.1371/journal.pmed.1004136.s002

(DOCX)

S1 Table. Duration of booster dose protection.

Risk of SARS-CoV-2 Omicron variant infection ≥60 days after booster vaccination relative to people who received a booster 14–59 days prior to testing.

https://doi.org/10.1371/journal.pmed.1004136.s003

(XLSX)

S2 Table. Bias indicator.

Results from the bias indicator analysis described in the manuscript.

https://doi.org/10.1371/journal.pmed.1004136.s004

(XLSX)

References

  1. 1. Accorsi EK, Britton A, Fleming-Dutra KE, Smith ZR, Shang N, Derado G, et al. Association Between 3 Doses of mRNA COVID-19 Vaccine and Symptomatic Infection Caused by the SARS-CoV-2 Omicron and Delta Variants. JAMA. 2022 [cited 2022 Jan 26]. pmid:35060999
  2. 2. Andrews N, Stowe J, Kirsebom F, Toffa S, Rickeard T, Gallagher E, et al. Effectiveness of COVID-19 vaccines against the Omicron (B.1.1.529) variant of concern. medRxiv. 2021. p. 2021.12.14.
  3. 3. Johnson AG. COVID-19 Incidence and Death Rates Among Unvaccinated and Fully Vaccinated Adults with and Without Booster Doses During Periods of Delta and Omicron Variant Emergence—25 U.S. Jurisdictions, April 4–December 25, 2021. MMWR Morb Mortal Wkly Rep. 2022;71. pmid:35085223
  4. 4. Thompson MG. Effectiveness of a Third Dose of mRNA Vaccines Against COVID-19–Associated Emergency Department and Urgent Care Encounters and Hospitalizations Among Adults During Periods of Delta and Omicron Variant Predominance—VISION Network, 10 States, August 2021–January 2022. MMWR Morb Mortal Wkly Rep. 2022;71. pmid:35085224
  5. 5. Sheikh A, McMenamin J, Taylor B, Robertson C. SARS-CoV-2 Delta VOC in Scotland: demographics, risk of hospital admission, and vaccine effectiveness. Lancet. 2021;397:2461–62. pmid:34139198
  6. 6. Chemaitelly H, Ayoub HH, AlMukdad S, Coyle P, Tang P, Yassine HM, et al. Duration of mRNA vaccine protection against SARS-CoV-2 Omicron BA.1 and BA.2 subvariants in Qatar. medRxiv. 2022. p. 2022.03.13.22272308. pmid:35654888
  7. 7. Hall V, Foulkes S, Insalata F, Saei A, Kirwan P, Atti A, et al. Effectiveness and durability of protection against future SARS-CoV-2 infection conferred by COVID-19 vaccination and previous infection; findings from the UK SIREN prospective cohort study of healthcare workers March 2020 to September 2021. medRxiv. 2021. p. 2021.11.29.21267006.
  8. 8. Hall V, Foulkes S, Insalata F, Kirwan P, Saei A, Atti A, et al. Protection against SARS-CoV-2 after Covid-19 Vaccination and Previous Infection. N Engl J Med. 2022;386:1207–1220. pmid:35172051
  9. 9. Nordström P, Ballin M, Nordström A. Risk of SARS-CoV-2 reinfection and COVID-19 hospitalisation in individuals with natural and hybrid immunity: a retrospective, total population cohort study in Sweden. Lancet Infect Dis. 2022;22. pmid:35366962
  10. 10. León TM. COVID-19 Cases and Hospitalizations by COVID-19 Vaccination Status and Previous COVID-19 Diagnosis—California and New York, May–November 2021. MMWR Morb Mortal Wkly Rep. 2022:71. pmid:35085222
  11. 11. Cerqueira-Silva T, Andrews JR, Boaventura VS, Ranzani OT, Oliveira V de A, Paixão ES, et al. Effectiveness of CoronaVac, ChAdOx1, BNT162b2 and Ad26.COV2.S among individuals with prior SARS-CoV-2 infection in Brazil. medRxiv. 2021. p. 2021.12.21.21268058.
  12. 12. Shrestha NK, Burke PC, Nowacki AS, Terpeluk P, Gordon SM. Necessity of COVID-19 Vaccination in Persons Who Have Already Had COVID-19. Clin Infect Dis Off Publ Infect Dis Soc Am. 2022:ciac022. pmid:35028662
  13. 13. De Serres G, Skowronski DM, Wu XW, Ambrose CS. The test-negative design: validity, accuracy and precision of vaccine efficacy estimates compared to the gold standard of randomised placebo-controlled clinical trials. Euro Surveill Bull Eur Sur Mal Transm Eur Commun Dis Bull. 2013;18:20585. pmid:24079398
  14. 14. Dean NE, Hogan JW, Schnitzer ME. Covid-19 Vaccine Effectiveness and the Test-Negative Design. N Engl J Med. 2021;385:1431–1433. pmid:34496195
  15. 15. Hitchings MDT, Ranzani OT, Dorion M, D’Agostini TL, de Paula RC, de Paula OFP, et al. Effectiveness of ChAdOx1 vaccine in older adults during SARS-CoV-2 Gamma variant circulation in São Paulo. Nat Commun. 2021;12:6220. pmid:34711813
  16. 16. Ranzani OT, Hitchings MDT, Dorion M, D’Agostini TL, de Paula RC, de Paula OFP, et al. Effectiveness of the CoronaVac vaccine in older adults during a gamma variant associated epidemic of covid-19 in Brazil: test negative case-control study. BMJ 2021;374:n2015. pmid:34417194
  17. 17. Elbe S, Buckland-Merrett G. Data, disease and diplomacy: GISAID’s innovative contribution to global health. Glob Chall. 2017;1:33–46. pmid:31565258
  18. 18. Chaguza C, Coppi A, Earnest R, Ferguson D, Kerantzas N, Warner F, et al. Rapid emergence of SARS-CoV-2 Omicron variant is associated with an infection advantage over Delta in vaccinated persons. medRxiv. 2022. p. 2022.01.22.22269660. pmid:35399324
  19. 19. Commissioner O of the. FDA Authorizes Booster Dose of Pfizer-BioNTech COVID-19 Vaccine for Certain Populations. In: FDA [Internet]. FDA; 2021 Sep 22 [cited 2021 Nov 1]. Available from: https://www.fda.gov/news-events/press-announcements/fda-authorizes-booster-dose-pfizer-biontech-covid-19-vaccine-certain-populations.
  20. 20. McPadden J, Durant TJ, Bunch DR, Coppi A, Price N, Rodgerson K, et al. Health Care and Precision Medicine Research: Analysis of a Scalable Data Science Platform. J Med Internet Res. 2019;21:e13043. pmid:30964441
  21. 21. Schulz WL, Durant TJS Jr, CJT , Hsiao AL, Krumholz .. Agile Health Care Analytics: Enabling Real-Time Disease Surveillance With a Computational Health Platform. J Med Internet Res. 2020;22:e18707. pmid:32442130
  22. 22. EPIC Systems Corporation. Care Everywhere Network. Verona, WI; 2022. Available from: https://www.epic.com/careeverywhere/.
  23. 23. European Centre for Disease Prevention and Control, Europe WHORO for. Methods for the detection and identification of SARS-CoV-2 variants, March 2021. World Health Organization. Regional Office for Europe; 2021. Report No.: WHO/EURO:2021-2148-41903-57493. Available from: https://apps.who.int/iris/handle/10665/340067.
  24. 24. Lewnard JA, Tedijanto C, Cowling BJ, Lipsitch M. Measurement of Vaccine Direct Effects Under the Test-Negative Design. Am J Epidemiol. 2018;187:2686–97. pmid:30099505
  25. 25. CDC. COVID-19 Booster Shot. In: Centers for Disease Control and Prevention [Internet]. 2022 Apr 1 [cited 2022 Apr 5]. Available from: https://www.cdc.gov/coronavirus/2019-ncov/vaccines/booster-shot.html
  26. 26. Lipsitch M, Goldstein E, Ray GT, Fireman B. Depletion-of-susceptibles bias in influenza vaccine waning studies: how to ensure robust results. Epidemiol Infect. 2019;147:e306. pmid:31774051
  27. 27. Charlson ME, Pompei P, Ales KL, MacKenzie CR. A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987;40:373–83. pmid:3558716
  28. 28. Kahan BC, Rushton H, Morris TP, Daniel RM. A comparison of methods to adjust for continuous covariates in the analysis of randomised trials. BMC Med Res Methodol. 2016;16:42. pmid:27068456
  29. 29. Groenwold RHH, Klungel OH, Altman DG, van der Graaf Y, Hoes AW, Moons KGM. Adjustment for continuous confounders: an example of how to prevent residual confounding. CMAJ Can Med Assoc J. 2013;185:401–6. pmid:23401401
  30. 30. U.S. Department of Health & Human Services. CDC/ATSDR SVI Data and Documentation Download | Place and Health | ATSDR. 2021 Aug 27 [cited 2022 Apr 5]. Available from: https://www.atsdr.cdc.gov/placeandhealth/svi/data_documentation_download.html.
  31. 31. R Core Team. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing; 2021. Available from: https://www.R-project.org/.
  32. 32. Hitchings MDT, Lewnard JA, Dean NE, Ko AI, Ranzani OT, Andrews JR, et al. Use of recently vaccinated individuals to detect bias in test-negative case-control studies of COVID-19 vaccine effectiveness. 2021 Jul. p 2021.06.23.21259415.
  33. 33. Grubaugh ND, Pham K. Connecticut SARS-CoV-2 variant surveillance–Report 2022-10-04. Yale University; 2022 Oct. Available from: https://kphamyale.shinyapps.io/covidtrackerct/.
  34. 34. Chin ET, Leidner D, Lamson L, Lucas K, Studdert DM, Goldhaber-Fiebert JD, et al. Protection against Omicron conferred by mRNA primary vaccine series, boosters, and prior infection. medRxiv. 2022. p. 2022.05.26.22275639. pmid:35665013
  35. 35. Ferdinands JM. Waning 2-Dose and 3-Dose Effectiveness of mRNA Vaccines Against COVID-19–Associated Emergency Department and Urgent Care Encounters and Hospitalizations Among Adults During Periods of Delta and Omicron Variant Predominance—VISION Network, 10 States, August 2021–January 2022. MMWR Morb Mortal Wkly Rep. 2022;71. pmid:35176007
  36. 36. Lamont N. STATE OF CONNECTICUT BY HIS EXCELLENCY NED LAMONT EXECUTIVE ORDER NO. 13G. 2021. Available from: https://portal.ct.gov/-/media/Office-of-the-Governor/Executive-Orders/Lamont-Executive-Orders/Executive-Order-No-14B.pdf.
  37. 37. Government Connecticut. Workplaces Subject to COVID-19 Vaccine Requirements. In: CT.gov—Connecticut’s Official State Website [Internet]. 2022 Jan 14 [cited 2022 Apr 7]. Available from: https://portal.ct.gov/Coronavirus/Covid-19-Knowledge-Base/Workplace-Vaccine-Requirements.
  38. 38. Connecticut Department of Health. COVID-19 Vaccinations by Age Group | Connecticut Data. In: data.ct.gov [Internet]. 2022 Aug 11 [cited 2022 Aug 11]. Available from: https://data.ct.gov/Health-and-Human-Services/COVID-19-Vaccinations-by-Age-Group/vjim-iz5e
  39. 39. Altarawneh HN, Chemaitelly H, Ayoub HH, Tang P, Hasan MR, Yassine HM, et al. Effects of Previous Infection and Vaccination on Symptomatic Omicron Infections. N Engl J Med. 2022;387:21–34. pmid:35704396