Covid-19 vaccine effectiveness against general SARS-CoV-2 infection from the omicron variant: A retrospective cohort study

Study Design and Population

The study population consists of students and employees undergoing mandatory weekly testing between January 3^rd and January 31^st at Clemson University in South Carolina (SC). The study sample was restricted to young-adult students between 18 and 24 years and university employees between 18 and 64 years. Exclusion criteria is provided in Figure 1, and consists of student athletes, recipient of a vaccine dose other than BNT162b2 or mRNA-1273, individuals receiving the second dose of BNT162b2 less than 21 days after their first dose or second dose of mRNA-1273 less than 28 days after first dose, recipient of a booster dose less than 5 months after the second dose of the mRNA-1273 or BNT162b2, and individuals with invalid vaccination cards. Per surveillance testing protocols, individuals testing positive were not required to partake in mandatory pre-arrival or surveillance testing for 90 days since the original positive test result, and are therefore excluded from analyses.⁶ Individuals who have self-reported conditions impacting immune response, including HIV, cancer, lupus, rheumatoid arthritis, or solid organ or bone marrow transplant, and who have self-reported medication use of steroids, chemotherapy, or immunosuppressants, were excluded from the sample. Students vaccinated prior to March 31^st, 2021, and employees vaccinated prior to March 8^th, 2021, were excluded, since only high-risk individuals were eligible to be vaccinated in SC during this time period. Ethical review for this study was obtained by the Institutional Review Board (IRB) of Clemson University (IRB # 2021-043-02).

• Download figure
• Open in new tab

Figure 1:

Flowchart of sample selection process for students and employees in main analysis during follow-up period between January 3^rd, 2022 and January 31^st, 2022.

*By end of follow-up (Jan 31^st, 2022)

^† Booster eligible individuals are those receiving their 2^nd mRNA dose prior to August 24, 2021

The fully vaccinated, booster eligible cohort could consist of a mix of fully vaccinated individuals (completion of 2-dose mRNA series) and boosted individuals (completion of 3-dose mRNA series), and are therefore excluded. The fully vaccinated, booster ineligible cohort consists of individuals vaccinated within 5 months of end of follow-up (Jan 31^st, 2022) and were therefore not eligible to receive the booster dose.

Vaccination Status

Vaccine information was collected through voluntary upload of vaccination cards through Clemson University’s COVID-19 Voluntary Vaccine Upload Tool. Financial incentives were provided to individuals uploading proof of complete vaccination during the Fall 2021 semester.⁷ Individuals also had the option to upload information on booster doses at any point. While this was encouraged through university communications, financial incentives were not offered for booster upload. Vaccination data includes vaccine manufacturer and administration dates of first, second, and booster doses.

Individuals who were not affiliated with the University during the Fall 2021 semester were excluded from analyses, since this population was not eligible to participate in the University’s financial incentive program for voluntary upload of Covid-19 vaccination and is therefore subject to underreporting. The incentive program only required proof of full vaccination (e.g., completion of 2-dose mRNA series). Many individuals likely received a booster dose after uploading proof of full vaccination. Because financial incentives were not offered for booster upload, those reporting full vaccination likely contain a mixture of individuals completing the 2-dose and 3-dose mRNA vaccination series. From the fully vaccinated cohort (i.e., people reporting only a 2-dose mRNA vaccination series), we excluded all individuals who received their 2^nd dose more than 5 months prior to the end of the follow-up (Jan 31^st, 2022). This ensures that the resulting fully vaccinated cohort would be devoid of boosted individuals since its constituents would not be eligible to receive the mRNA booster dose during the study period.

Vaccination status was coded as partially vaccinated if 14-days had passed since the first dose of mRNA-1273 or BNT162b2, fully vaccinated if at least 14 days had passed since the second dose of BNT162b2 or mRNA-1273,⁸ and boosted if 7 days had passed since the receipt of a the BNT162b2 or mRNA-1273 booster dose.⁹ The analytic sample was restricted to individuals reporting no vaccination, completion of the 2-dose mRNA vaccination series within 5 months of end of follow-up (fully vaccinated), and receipt of an mRNA booster dose (boosted).

SARS-CoV-2 Testing

Pre-arrival testing was required for all individuals between January 3^rd and January 12^th (in-person instruction), followed by weekly surveillance testing. Residential students were also required to test upon arrival to residence halls (beginning January 9^th). All students had the option of receiving a SARS-CoV-2 test on campus or obtaining their test elsewhere and uploading their result to the University’s Covid-19 test upload portal. Accepted methods included nasal, throat, or saliva-based polymerase-chain-reaction (PCR) tests.¹⁰ Testing was available on-campus through the University’s high-complexity CLIA-certified clinical diagnostics lab, which utilized saliva-based PCR tests. This compromised the majority of tests conducted during the study follow-up period (N=101,982; 92.9% of all tests). Test results with quantification cycle (Cq) values under 33 were considered positive for SARS-CoV-2 (test sensitivity ≥ 95%, test specificity ≥ 99.5%).^11,12 Testing was mandated for all university-affiliated individuals; access to campus facilities was restricted until a negative test result was obtained. Pre-arrival and surveillance testing protocols for previous semesters, including clinical descriptions of testing procedures, are described elsewhere.^6,11 It is estimated that 99.2% of all SARS-CoV-2 infections in South Carolina were caused by the omicron variant in January of 2022.¹³

Propensity Score Matching

Propensity-score matching was used to adjust for confounding of vaccine effectiveness estimates due to reporting bias and differences in health-seeking behavior. To achieve covariate balance while preserving sample size, matching was conducted using a common-referent approach.¹⁴ In the student sample, 1:1 nearest neighbor caliper matching was conducted between boosted and fully vaccinated individuals and 1:2 nearest neighbor caliper matching was conducted between boosted and unvaccinated individuals.^15,16 The post-matched student sample consists of unvaccinated and fully vaccinated individuals who had a common match with a boosted individual.¹⁴ In the employee study sample, 1:4 nearest neighbor caliper matching was conducted between fully vaccinated and boosted individuals and 1:4 nearest neighbor caliper matching was conducted between fully vaccinated and unvaccinated individuals. The post-matched employee sample consists of boosted and unvaccinated individuals who had a common match with a fully vaccinated individual. The caliper width was set to 0.20 times the standard deviation of the logit of the propensity scores.¹⁷ Variables in the propensity score model included age, sex, affiliation (students: residential or non-residential living, employees: faculty or staff), graduate student status (students only), race/ethnicity, self-reported pre-existing conditions (high blood pressure, heart disease, diabetes, overweight or obesity, kidney disease or dialysis, previous stroke or other neurological condition affecting ability to cough, liver disease, or lung disease), use of tobacco or nicotine products, number of SARS-CoV-2 tests in Fall 2020, Spring 2021, and Fall 2021 semesters, and history of previous SARS-CoV-2 infection.

Statistical Analyses

Demographic and clinical characteristics are provided for the analytic sample and stratified by vaccination status in Table 1A/B. Differences between unvaccinated, fully vaccinated, and boosted individuals were assessed using ANOVA for continuous variables and chi-squared tests for categorical variables. Time-varying Cox proportional hazard models were used to estimate the relative risk (RR) of SARS-CoV-2 infection by vaccination status during the follow-up period (1/3/2022-1/31/2022). The outcome was days between start of follow-up and date of first SARS-CoV-2 positive test (event date). Individuals who did not test positive during the follow-up period were right censored at their last negative test date (censoring date). Vaccination status was modeled as a time-varying exposure variable. Because university students tend to engage in high-density social interactions which result in exposure to higher viral loads,¹⁸ models were run independently for student and employee populations. We adjust for all potential confounders included in the propensity score models to account for residual imbalance after matching.¹⁹ Specifically, models were adjusted for previous SARS-CoV-2 infection history, age, race, gender, residential status, self-reported pre-existing conditions, use of nicotine or other smoking products, and number of previous SARS-CoV-2 tests (surrogate for health-seeking behavior).^20,21 Vaccine effectiveness was estimated by 1-RR.⁶ Overall mRNA vaccine protection was estimated via Model 1.1 (Appendix 1). Effectiveness by vaccine manufacturer was estimated via Model 1.2 (Appendix 1).

To evaluate vaccine effectiveness by previous infection history, an interaction term between vaccine status and previous infection was included in separate models (Appendix 1, Models 1.3-1.4). To account for heavy censoring of event times, we apply Firth’s penalized likelihood method.²² Waning vaccine effectiveness over time was evaluated by including time since vaccination as a predictor (Appendix 2, Models 2.1-2.2). Time-adjusted RR of SARS-CoV-2 infection between the boosted and fully vaccinated groups were estimated via Model 2.3 (Appendix 2). Additional model details are provided in the Appendix. All analyses were conducted using R version 4.1.2.

Vaccine Effectiveness

Estimates of vaccine effectiveness for students and employees are presented in Table 2A/B and Figure 2. The median time between full vaccination and end of follow-up was 4.49 months for students (range: 0.66-5.25) and 4.43 months for employees (range: 0.79-5.21). Protection from the 2-dose mRNA vaccination series was 7.7% among students (95% CI: −11.5-23.5%; P = .409) and 25.6% among employees (95% CI: −17.6-52.9%; P = 0.205). Differences between manufacturers were not statistically significant for students (P = .328) or employees (P = .626).

• Download figure
• Open in new tab

Figure 2:

Estimates of vaccine protection against any SARS-CoV-2 infection caused by the omicron variant in university students (left) and employees (right).

The median time between booster dose and end of follow-up was 1.31 months for students (range: 0.39-3.51) and 2.03 months for employees (range: 0.52-4.00). Protection from the mRNA booster dose was 45.4% among students (95% CI = 30.0-57.4%; P < .001) and 66.4% among employees (95% CI = 46.1-79.0%; P < .001). Differences between booster manufacturers were not statistically significant for students (P = .652) or employees (P = .417). Furthermore, statistically significant differences were not observed between individuals who mixed and matched (i.e., 2-dose primary series and booster dose from different manufacturers) and those completing the 3-dose BNT16b2 sequence (students: P = .360, employees P = .985), or those completing the 3-dose mRNA-1273 sequence (students: P = .353, employees: P = .589).

Compared to completion of the 2-dose mRNA series, receipt of the mRNA booster dose increased protection by 37.7% among students (95% CI: 15.3-60.2%; P = .001) and 40.8% among employees (95% CI: 5.4-76.2%; P = .024). In a separate analysis accounting for time since vaccination, we directly compare protection among individuals receiving the mRNA booster dose to those completing the 2-dose mRNA series (Appendix 2, Model 2.3). Relative to the 2-dose series, the (time-adjusted) risk of SARS-CoV-2 infection for those receiving the mRNA booster dose was 2.16 times lower for students (95% CI: 1.47-3.18, P <.001) and 1.52 times lower for employees (95% CI: 0.66-3.46, P =.324); however, we did not have enough evidence to conclude statistical significance for the latter effect.

We did not have evidence to conclude that mRNA vaccine protection varied by previous infection history. Significant interactions were not observed between previous SARS-CoV-2 infection and the 2-dose mRNA vaccination series (students: P = .130, employees: P = .184) or mRNA booster dose (students: P = .599, employees: P = .085). Months since completion of the 2-dose mRNA vaccination series was not a statistically significant predictor of SARS-CoV-2 infection from Omicron among students (RR = 0.93, 95% CI: 0.86-1.02; P = .110) or employees (RR = 0.99, 95% CI: 0.82-1.19; P = .549). A significant decline in mRNA booster protection was not observed among students (RR = 1.27, 95% CI: 0.81-1.98; P = .304) or employees (RR = 1.03, 95% CI: 0.65-1.65; P = .886).