Effectiveness of mRNA-1273 against Delta, Mu, and other emerging variants ========================================================================= * Katia J. Bruxvoort * Lina S. Sy * Lei Qian * Bradley K. Ackerson * Yi Luo * Gina S. Lee * Yun Tian * Ana Florea * Michael Aragones * Julia E. Tubert * Harpreet S. Takhar * Jennifer H. Ku * Yamuna D. Paila * Carla A. Talarico * Hung Fu Tseng ## ABSTRACT **Background** Real-world studies have found high vaccine effectiveness (VE) of mRNA-based COVID-19 vaccines, but reduced VE against the Delta variant and waning protection have been reported, with few studies examining mRNA-1273 variant-specific VE. **Methods** We conducted a test-negative case-control study at Kaiser Permanente Southern California. Whole genome sequencing was conducted for SARS-CoV-2 positive specimens collected from 3/1/2021 to 7/27/2021. Test-positive cases were matched 1:5 to test-negative controls on age, sex, race/ethnicity, and specimen collection date. Outcomes included SARS-CoV-2 infection and hospitalization. Exposures were 2 doses or 1 dose of mRNA-1273 ≥14 days prior to specimen collection versus no COVID-19 vaccination. Conditional logistic regression was used to compare odds of vaccination among cases versus controls, adjusting for confounders. VE was calculated as (1-odds ratio)x100%. **Results** The study included 8,153 cases and their matched controls. Two-dose VE (95% confidence interval) was 86.7% (84.3-88.7%) against Delta infection, 98.4% (96.9-99.1%) against Alpha, 90.4% (73.9-96.5%) against Mu, 96-98% against other identified variants, and 79.9% (76.9-82.5%) against unidentified variants. VE against Delta declined from 94.1% (90.5-96.3%) 14-60 days after vaccination to 80.0% (70.2-86.6%) 151-180 days after vaccination. Waning was less pronounced for non-Delta variants. VE against Delta was lower among individuals aged ≥65 years (75.2% [59.6-84.8%]) than those aged 18-64 years (87.9% [85.5-89.9%]). VE against Delta hospitalization was 97.6% (92.8-99.2%). One-dose VE was 77.0% (60.7-86.5%) against Delta infection. **Conclusions** Two doses of mRNA-1273 were highly effective against all SARS-CoV-2 variants. However, VE against Delta moderately declined with increasing time since vaccination. **Trial Registration Number** Not applicable **Funding** Moderna Inc. Keywords * COVID-19 * SARS-CoV-2 * mRNA-1273 * vaccine effectiveness * variants * test-negative design ## INTRODUCTION Vaccines to prevent coronavirus disease 2019 (COVID-19) were developed rapidly in response to the COVID-19 pandemic. In clinical trials, mRNA-based COVID-19 vaccines, mRNA-1273 (Moderna Inc, Cambridge, USA) and BNT162b2 (Pfizer Inc, New York, USA; BioNTech Manufacturing GmbH, Mainz, Germany) were highly efficacious (94% and 95%, respectively) against symptomatic COVID-19.1,2 After receiving emergency use authorization in the United States (US) in December 2020,3,4 these vaccines were deployed in phased mass vaccination programs for high risk and general populations. Subsequently, multiple real-world studies conducted before the SARS-CoV-2 Delta variant (B.1.617.2 and AY lineage) became predominant reported high vaccine effectiveness (VE) of mRNA-based vaccines against COVID-19 infection (e.g., 82%-100%)5-8 and COVID-19 hospitalization (e.g., 87-96%).9,10 Few of these studies identified variant-specific VE. In a study in Qatar, VE of mRNA-1273 against infection with Alpha (B.1.1.7) and Beta (B.1.351) SARS-CoV-2 variants was 100% and 96.4%, respectively.11 A study in Canada found VE of mRNA-based vaccines against Alpha and Beta/Gamma (P.1) infection of 90% and 88%, respectively.12 However, as Delta became predominant, concerns arose that mRNA-based vaccines could be less effective.13,14 The higher transmissibility of Delta led to a surge in infections, hospitalizations, and deaths in the US.15 These cases have occurred overwhelmingly among unvaccinated individuals but have also included breakthrough cases.16,17 Although studies have found sustained VE of mRNA-based vaccines against COVID-19 hospitalization during periods overlapping with or during the Delta surge,18-20 decreased VE against infection with Delta in some studies has been reported (e.g., 51-75%).20-22 It is unclear if these findings are due to lower protection against Delta, waning vaccine immunity over time, or other factors. Furthermore, few studies have examined VE specifically for mRNA-1273 against Delta or other SARS-CoV-2 variants. Such studies are critically needed to inform ongoing decisions around booster doses and development of vaccines that may offer broad protection against SARS-CoV-2 variants. Thus, we evaluated the VE of mRNA-1273 against variants including Delta by time since vaccination at Kaiser Permanente Southern California (KPSC). ## METHODS ### Study setting KPSC is an integrated health care system with 15 hospitals and associated medical offices across Southern California. The population of over 4.6 million members with diverse sociodemographic characteristics is generally representative of the underlying population.23 Comprehensive electronic health records (EHR) provide detailed data on all aspects of clinical care, including diagnoses, laboratory tests, procedures, and pharmacy records. The KPSC Institutional Review Board approved this study. KPSC began administering COVID-19 vaccines on December 18, 2020, following state guidelines for vaccine prioritization.24 COVID-19 vaccinations received outside KPSC are regularly imported into the EHR from external sources, including the California Immunization Registry (CAIR),25 CalVax (Cal Poly Pomona mass vaccination site), Care Everywhere (system on the Epic EHR platform that allows different health care systems to exchange patient medical information), claims (e.g., retail pharmacies), and member self-report (with valid documentation). ### Laboratory methods Molecular diagnostic testing for SARS-CoV-2 is widely available at KPSC for symptomatic and asymptomatic individuals and is required prior to procedures or hospital admission. Specimens are primarily collected using nasopharyngeal/oropharyngeal swabs or saliva (asymptomatic individuals only) and tested using the RT-PCR TaqPath™ COVID-19 High-Throughput Combo Kit (Thermo Fisher Scientific, California, USA). Beginning in March 2021, KPSC began sending all positive SARS-CoV-2 specimens from both symptomatic and asymptomatic individuals, regardless of cycle threshold (Ct) values, to a commercial laboratory (Helix, California, USA) for whole genome sequencing (WGS), as described in **Supplementary Methods**. ### Study design The study used a test-negative design to examine VE of mRNA-1273 against SARS-CoV-2 variants. Individuals who had a SARS-CoV-2 positive test sent for WGS or a negative test from March 1, 2021 to July 27, 2021 were eligible for inclusion in the study if they were age ≥18 years and had ≥12 months of KPSC membership as of the specimen collection date. Individuals were excluded if they received a COVID-19 vaccine other than mRNA-1273, received 2 doses of mRNA-1273 <24 days apart or <14 days prior to specimen collection date, received >2 doses of mRNA-1273 prior to the specimen collection date, or had a positive SARS-CoV-2 test or COVID-19 diagnosis code between 12/18/2020 and 2/28/2021 or ≤90 days prior to positive test date. Separate analyses were conducted for each SARS-CoV-2 variant, selected based on scientific relevance and prevalence in the KPSC population. These included Delta (B.1.617.2, AY.*), Alpha (B.1.1.7), Epsilon (B.1.427, B.1.429), Gamma (P.1, P.1.1, P.1.2), Iota (B.1.526, B.1.526.1, B.1.526.2), Mu (B.1.621, B.1.621.1), and other (Beta, Eta, Kappa, and any other variants). Test-positive cases were defined as the first positive SARS-CoV-2 specimen identified by WGS. Cases for which WGS failed were examined as a separate category (“unidentified variants”). COVID-19 hospitalized test-positive cases were defined as a variant with specimen collection date ≤7 days before or during COVID-19 hospitalization confirmed by chart review. Test-negative controls were selected from eligible individuals with a negative SARS-CoV-2 test. Cases and controls were matched 1:5 on age (18–44 years, 45–64 years, 65–74 years, and ≥75 years), sex, race/ethnicity (Non-Hispanic White, Non-Hispanic Black, Hispanic, Non-Hispanic Asian, and Other/Unknown), and specimen collection date (±10 days). The exposure of interest was receipt of 2 doses administered ≥24 days apart or 1 dose of mRNA-1273 ≥14 days prior to specimen collection date. Demographic and clinical covariates were extracted from EHR (**Table S1**). Variables assessed at specimen collection date included socioeconomic status (Medicaid, neighborhood median household income), medical center area, pregnancy status, and KPSC physician/employee status. Variables assessed in the 2 years prior to specimen collection date included smoking and body mass index (BMI). Variables assessed in the year prior to specimen collection date included Charlson comorbidity score, autoimmune conditions, health care utilization (virtual, outpatient, emergency department, and inpatient encounters), preventive care (other vaccinations, screenings, and well-visits), chronic diseases (kidney disease, heart disease, lung disease, liver disease, diabetes), and frailty index. Other variables included history of SARS-CoV-2 molecular test performed from March 1, 2020 to specimen collection date (irrespective of result), history of COVID-19 diagnosis (SARS-CoV-2 positive molecular test or a COVID-19 diagnosis code) from March 1, 2020 to specimen collection date, and immunocompromised status. ### Statistical analyses The distribution of variants was described by vaccination status and by calendar time. Characteristics of cases and controls for each analysis were described and compared using the χ2 test or Fisher’s exact test for categorical variables and the two-sample t-test or Wilcoxon rank-sum test for continuous variables. Conditional logistic regression was used to estimate the odds ratios (OR) and 95% confidence interval (95% CI) for vaccination, comparing cases and controls. Analyses were adjusted for potential confounders, determined by absolute standardized differences (ASD) >0.1 and p-value <0.1, or scientific relevance. VE was calculated as (1 – adjusted OR) x 100%. Variants with at least 20 cases were selected for analyses according to power calculations (**Supplementary Methods**). Analyses of VE by time since receipt of second dose of mRNA-1273 (14-60 days, 61-90 days, 91-120 days, 121-150 days, 151-180 days, and >180 days) were conducted for Delta (overall and by age), non-Delta variants, and unidentified variants. All analyses were conducted using SAS software version 9.4 (Cary, USA). ## RESULTS The study included 8,153 test-positive cases, with variants identified for 5,186 cases (63.6% overall, of which 39.4% were Delta, 27.7% Alpha, 11.4% Epsilon, 6.9% Gamma, 2.2% Iota, 1.4% Mu, and 11.1% Other) (**Table 1 and Figures S1-2**). Among fully vaccinated cases, 85.0% of identified variants were Delta. Approximately 36% of specimens failed WGS. Compared to successfully sequenced specimens, specimens that failed sequencing were more often from fully vaccinated cases (11.0% vs. 5.3%), collected via saliva from asymptomatic individuals (9.3% vs. 3.3%), and had Ct values >27 (65.5% vs. 13.7%), suggesting that low viral load coupled with the limits of detection of current molecular assays contributed to sequence failures. Additionally, some specimens that failed sequencing exhibited S gene target failure and positive results for the two other gene targets, suggesting that some unidentified variants may belong to the Alpha lineage.26-28 View this table: [Table 1.](http://medrxiv.org/content/early/2021/10/01/2021.09.29.21264199/T1) Table 1. Sequencing characteristics of SARS-CoV-2 specimens, by sequencing status and mRNA-1273 vaccination Among the 2,027 Delta cases matched to 10,135 controls (**Table 2**), 66.2% were aged 18-44 years, 55.9% were female, and 42.7% were Hispanic. Delta cases and controls had similar distributions of lung disease, autoimmune conditions, median neighborhood income, and KPSC physician/employee status. Compared to controls, Delta cases had lower comorbidity and frailty indices and less commonly had kidney disease, heart disease, liver disease, diabetes, immunocompromised status, pregnancy, and history of COVID-19 diagnosis, but more commonly had history of SARS-CoV-2 molecular testing and Medicaid. Delta cases also had fewer health care visits in the prior year than controls, and less commonly had preventive care. In addition, there were some differences by medical center, month of specimen collection, and specimen type. Characteristics of cases and matched controls for non-Delta and unidentified variants are described in **Tables S2-S8**. View this table: [Table 2.](http://medrxiv.org/content/early/2021/10/01/2021.09.29.21264199/T2) Table 2. Characteristics of SARS-CoV-2 test-positive cases for Deltaa variant and test-negative controls (2-dose analysis) Among Delta cases, 232 (11.4%) were fully vaccinated **(Figure 1 and Table S9)**. Among controls matched to Delta cases, 4,588 (45.3%) were fully vaccinated. In comparison, only 0.9% of Alpha cases and 24.4% of Alpha controls were fully vaccinated. VE (95% CI) against infection with Delta was 86.7% (84.3-88.7%), moderately lower than the high VE against Alpha (98.4% [96.9-99.1%]). VE against Mu was 90.4% (73.9-96.5%). VE against other identified non-Delta variants ranged from 95.5-97.6%, while VE against unidentified variants was 79.9% (76.9-82.5%). VE of 1 dose of mRNA-1273 was lower against all variants, ranging from 45.8% (0.0-88.9%) against Mu to 90.1% (82.9-94.2%) against Alpha (**Table S10**). ![Figure 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/10/01/2021.09.29.21264199/F1.medium.gif) [Figure 1:](http://medrxiv.org/content/early/2021/10/01/2021.09.29.21264199/F1) Figure 1: Vaccine effectiveness of 2 doses of mRNA-1273 against infection with SARS-CoV-2 variants In analyses of VE against Delta infection by time since receipt of second dose, VE was highest at 14-60 days (94.1% [90.5-96.3%]) and declined moderately, with VE of 80.0% (70.2-86.6%) at 151-180 days (**Figure 2 and Table S11**). VE against non-Delta infection also declined, with increasing time since vaccination, though not as sharply as for Delta (98.6% [97.3-99.3%] at 14-60 days to 88.7% [73.2-95.2%] at 121-150 days); analyses could not be done for later time points due to decline in prevalence. VE against unidentified variants was 83.6% (79.5-86.9%) at 14-60 days, declining to 68.5% (51.3-79.6%) at 151-180 days. ![Figure 2:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/10/01/2021.09.29.21264199/F2.medium.gif) [Figure 2:](http://medrxiv.org/content/early/2021/10/01/2021.09.29.21264199/F2) Figure 2: Vaccine effectiveness of 2 doses of mRNA-1273 against infection with SARS-CoV-2 variants by time since vaccination In analyses by age group, VE of 2 doses of mRNA-1273 against Delta infection was 87.9% (85.5-89.9%) among individuals aged 18-64 years and 75.2% (59.6-84.8%) among individuals aged ≥65 years (**Figure S3**). Among those aged 18-64 years, VE against Delta declined from 95.1% (91.8-97.1%) at 14-60 days to 79.4% (68.8-86.3%) at 151-180 days. Among individuals aged ≥65 years, confidence intervals were wide due to fewer cases in this age group, making trends less apparent. However, during the study period robust protection was observed against hospitalization for Delta. Among hospitalized Delta cases and controls, 5 (3.5%) and 4,815 (40.1%) were fully vaccinated, respectively (**Table 3**). VE against hospitalization for Delta was high at 97.6% (92.8-99.2%). Similarly, VE against hospitalization for unidentified variants was 96.6% (89.4-98.9%). VE against hospitalization for non-Delta variants was not estimated due to 0 hospitalizations with non-Delta variants identified among vaccinated individuals. View this table: [Table 3.](http://medrxiv.org/content/early/2021/10/01/2021.09.29.21264199/T3) Table 3. Vaccine effectiveness of 2 doses of mRNA-1273 against COVID-19 hospitalization with Delta, non-Delta or unidentified variants ## DISCUSSION This real-world study provides evidence of high VE of 2 doses of mRNA-1273 against multiple SARS-CoV-2 variants, including Delta. Although prior studies of BNT162b2 and other COVID-19 vaccines have examined VE against Delta,13,29-33 few studies of mRNA-1273 have reported variant-specific VE.31,33 Our study addresses this gap, finding that mRNA-1273 was protective against infection with Delta and other identified SARS-CoV-2 variants (Alpha, Epsilon, Gamma, Iota, Mu, and others). VE against Delta infection was moderately lower than VE against identified non-Delta variants (86.7% vs. 90.4-98.4%), as observed in several other studies.13,30 During the Delta phase of the pandemic, breakthrough infections among fully vaccinated individuals have occurred,16,17 but VE of COVID-19 vaccines against severe disease has remained robust.18,19,31,34 In our study, VE against hospitalization with Delta was high (97.6%). Only 5 fully vaccinated Delta cases were hospitalized, no fully vaccinated non-Delta cases were hospitalized, and no hospitalized deaths occurred among any fully vaccinated cases. This finding is consistent with prior studies suggesting that fully vaccinated individuals with breakthrough infections tend to have attenuated viral load, fewer symptoms, and shorter illness duration, though severe outcomes can still occur.7,35,36 In this study, variants were unidentified for the substantial proportion of specimens that failed sequencing, possibly due to lower viral loads, timing of specimen collection relative to symptom onset, or poor specimen quality. The higher proportion of failed vs. successfully sequenced specimens that were fully vaccinated, saliva specimens (used only for asymptomatic testing at KPSC), and specimens with higher Ct values, altogether suggest less severe disease, which may help explain the lower VE against infection observed for this group (79.9%). Despite the lower VE against infection, VE against hospitalization with unidentified variants remained high (96.6%). Our study identified modest waning of mRNA-1273 VE against Delta infection; VE decreased from 94.1% in the 14-60 days after vaccination to 80.0% in the 151-180 days after vaccination. Similar reductions were observed among individuals aged 18-64 years, but among those aged ≥65 years, 95% CIs for VE by time since vaccination were wide. Other observational studies have found reduced VE of mRNA-based vaccines against infection in periods before and after Delta became predominant, some of which identified steeper declines than observed in our study.20,21,29,32 We also identified a decline in VE of mRNA-1273 against non-Delta infections but this reduction was less pronounced than for Delta or for unidentified variants. Declines in VE might also be partly due to differences in characteristics and behaviors of individuals vaccinated earlier vs. later in phased vaccine rollout. Our real-world findings complement existing immunogenicity and Phase 3 trial follow-up data of mRNA-1273 protection against SARS-CoV-2 variants, including Delta. High levels of neutralizing antibodies to Delta and other variants were elicited following 2-doses of mRNA-1273.37 These antibodies were found to persist 6 months after vaccination, albeit at reduced levels compared with peak activity. Among Phase 3 trial participants, incidence rates of COVID-19 and severe COVID-19 during the months when Delta was predominant were lower among those who were vaccinated with mRNA-1273 more recently (median 8 months after first dose) compared to those vaccinated initially (median 13 months after first dose).38 The findings of this study have implications for booster doses, which have been authorized in certain populations. Questions remain over the benefits of booster doses in different populations and optimal approaches for boosting immunity. Several studies have identified higher VE for mRNA-1273 after 1 and 2 doses compared to BNT162b2,12,39 suggesting different booster strategies could be appropriate depending on product. However, efforts to deploy booster doses must not replace efforts to reach unvaccinated individuals, who comprise most COVID-19 hospitalizations and deaths. Booster dose strategies must also prioritize global vaccine production and allocation. Our study had multiple strengths. We systematically collected positive SARS-CoV-2 specimens across KPSC care settings and sent specimens for WGS regardless of Ct value. Test-positive cases were matched to test-negative controls on demographic factors and calendar time, reducing secular confounding due to differences over time in transmission, vaccination rollout, and testing. We examined mRNA-1273 VE against multiple variants, including Delta and Mu. We also evaluated VE against Delta hospitalization. With data up to 6 months following receipt of two doses of mRNA-1273, we stratified analyses of duration of protection by variant type and age group. Our study also had several limitations. Although test-negative designs might reduce bias due to factors associated with care-seeking,40 this design was generalizable to individuals who were tested and was therefore less generalizable to individuals with mild or no symptoms who did not seek testing. The detailed KPSC EHR enabled adjustment for comprehensive sociodemographic and clinical covariates, but there could still be residual confounding due to unmeasured factors associated with both testing and vaccination. Misclassification of case/control status could occur due to false positives or negatives, although sensitivity and specificity of PCR testing was high. Misclassification of vaccine exposure was also possible but unlikely due to comprehensive KPSC and external COVID-19 vaccination records. Sample size was limited in the subgroup aged ≥65 years for the analysis of VE against Delta infection by time since vaccination. In conclusion, this study found high VE of mRNA-1273 against infection due to SARS-CoV-2 variants, including Delta, adding to the limited literature specific for mRNA-1273. VE against hospitalization for Delta was also high. This study provides reassuring evidence of the effectiveness of 2 doses of mRNA-1273 in preventing infection and COVID-19 hospitalization due to variants including Delta. Moderate declines in VE were observed against Delta infection. Additional research is required to inform booster dose strategies over time. ## Supporting information Supplementary [[supplements/264199_file03.pdf]](pending:yes) ## Data Availability Individual-level data reported in this study are not publicly shared. Upon request, and subject to review, KPSC may provide the deidentified aggregate-level data that support the findings of this study. Deidentified data (including participant data as applicable) may be shared upon approval of an analysis proposal and a signed data access agreement. ## AUTHOR CONTRIBUTIONS Conceptualization, KJB, LSS, LQ, CAT, HFT; acquisition, analysis, or interpretation of data, KJB, LSS, LQ, BKA, YL, AF, JHK, CAT, HFT; Drafting of the manuscript, KJB, LSS; Critical revision of the manuscript for important intellectual content, LQ, BKA, YL, GSL, YT, AF, MA, JET, HST, JHK, YDP, CAT, HFT; Statistical analysis, LQ, YL, YT, JET; Obtained funding, CAT, HFT; Administrative, technical, or material support, LSS, GSL, MA, HST, CAT, YDP; Supervision, CAT, HFT. All authors approved the final version of the manuscript. ## DATA SHARING Individual-level data reported in this study are not publicly shared. Upon request, and subject to review, KPSC may provide the deidentified aggregate-level data that support the findings of this study. Deidentified data (including participant data as applicable) may be shared upon approval of an analysis proposal and a signed data access agreement. ## DECLARATION OF INTERESTS KJB, LSS, LQ, BKA, YL, GSL, YT, AF, MA, JET, HST, JHK, and HFT are employees of Kaiser Permanente Southern California, which has been contracted by Moderna for the conduct of this present study. CAT and YDP are employees of and shareholders in Moderna Inc. KJB received funding from GlaxoSmithKline, Dynavax, Pfizer, Gilead, and Seqirus unrelated to this manuscript. LSS received funding from GlaxoSmithKline, Dynavax, and Seqirus unrelated to this manuscript. LQ received funding from GlaxoSmithKline and Dynavax unrelated to this manuscript. BKA received funding from GlaxoSmithKline, Dynavax, Seqirus and Pfizer unrelated to this manuscript. YL received funding from GlaxoSmithKline, Dynavax, Seqirus and Pfizer unrelated to this manuscript. GSL received funding from GlaxoSmithKline unrelated to this manuscript. YT received funding from GlaxoSmithKline unrelated to this manuscript. AF received funding from Pfizer, GlaxoSmithKline, CDC, and Gilead unrelated to this manuscript. MA received funding from Pfizer unrelated to this manuscript. JET received funding from Pfizer unrelated to this manuscript. HST received funding from GlaxoSmithKline, Pfizer, ALK, and Wellcome unrelated to this manuscript. JHK received funding from GlaxoSmithKline unrelated to this manuscript. HFT received funding from GlaxoSmithKline and Seqirus unrelated to this manuscript; HFT also served in advisory boards for Janssen and Pfizer. ## REQUIRED STATEMENTS 1. Research protocol was approved by KPSC IRB 2. Waiver of informed consent obtained from KPSC IRB due to research posing no more than minimal risk to subjects 3. Registration number and registry name in text – Not applicable 4. Accession numbers and repository names for studies containing microarrays – Not applicable 5. Name of person who analyzed the data – Lei Qian and Yi Luo ## ACKNOWLEDGMENTS This study was funded by Moderna Inc. Medical writing and editorial assistance was provided by Srividya Ramachandran, PhD, and Jared Mackenzie, PhD, of MEDiSTRAVA in accordance with Good Publication Practice (GPP3) guidelines, funded by Moderna Inc, and under the direction of the authors. The authors would like to acknowledge the following Kaiser Permanente Southern California staff: Donald Kaplan, PharmD, Daniel Ehrlich, PharmD, Dale Timothy, PharmD, Patrick Kerrigan, PharmD, David Cheng, PharmD, Kevin Ohara, Pharm D, Joel Christian, PharmD, Danny Byun, PharmD, Erin Matsushita, PharmD, Dennis Curtis, PharmD, Victoria Hong, PharmD, and Arthur Librea, PharmD, for their role in COVID-19 vaccine logistics and coordination; Soon Kyu Choi, Jennifer Charter, Joy Gelfond, Radha Bathala, and Lee Childs for their coordination in processing SARS-CoV-2 specimens; and Raul Calderon, Kourtney Kottman, Ana Acevedo, Elmer Ayala, and Jonathan Arguello for their technical and laboratory support in processing SARS-CoV-2 specimens. The authors would like to acknowledge Helix OpCo, LLC, for their whole genome sequencing of SARS-CoV-2 specimens. The authors would also like to acknowledge the contributions by Moderna staff: Groves Dixon, PhD, and Julie Vanas. The authors thank the patients of Kaiser Permanente for their partnership with us to improve their health. Their information, collected through our electronic health record systems, leads to findings that help us improve care for our members and can be shared with the larger community. * Received September 29, 2021. * Revision received September 29, 2021. * Accepted October 1, 2021. * © 2021, Posted by Cold Spring Harbor Laboratory The copyright holder for this pre-print is the author. All rights reserved. The material may not be redistributed, re-used or adapted without the author's permission. ## REFERENCES 1. 1.Baden LR, El Sahly HM, Essink B, et al. Efficacy and Safety of the mRNA-1273 SARS-CoV-2 Vaccine. N Engl J Med 2021; 384(5): 403–16. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa2035389&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F10%2F01%2F2021.09.29.21264199.atom) 2. 2.Polack FP, Thomas SJ, Kitchin N, et al. Safety and Efficacy of the BNT162b2 mRNA Covid-19 Vaccine. N Engl J Med 2020; 383(27): 2603–15. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa2034577&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F10%2F01%2F2021.09.29.21264199.atom) 3. 3.United States Food and Drug Administration. Moderna COVID-19 Vaccine. December 18 2020. [https://www.fda.gov/emergency-preparedness-and-response/coronavirus-disease-2019-covid-19/moderna-covid-19-vaccine](https://www.fda.gov/emergency-preparedness-and-response/coronavirus-disease-2019-covid-19/moderna-covid-19-vaccine) (accessed July 19 2021). 4. 4.United States Food and Drug Administration. Pfizer-BioNTech COVID-19 Vaccine. December 11 2020. [https://www.fda.gov/emergency-preparedness-and-response/coronavirus-disease-2019-covid-19/pfizer-biontech-covid-19-vaccine](https://www.fda.gov/emergency-preparedness-and-response/coronavirus-disease-2019-covid-19/pfizer-biontech-covid-19-vaccine) (accessed July 19 2021). 5. 5.Paris C, Perrin S, Hamonic S, et al. Effectiveness of mRNA-BNT162b2, mRNA-1273, and ChAdOx1 nCoV-19 vaccines against COVID-19 in healthcare workers: an observational study using surveillance data. Clin Microbiol Infect 2021. 6. 6.Andrejko KL, Pry J, Myers JF, et al. Prevention of COVID-19 by mRNA-based vaccines within the general population of California. Clinical Infectious Diseases 2021. 7. 7.Thompson MG, Burgess JL, Naleway AL, et al. Prevention and Attenuation of Covid-19 with the BNT162b2 and mRNA-1273 Vaccines. N Engl J Med 2021; 385(4): 320–9. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMOA2107058&link_type=DOI) 8. 8.Butt AA, Omer SB, Yan P, Shaikh OS, Mayr FB. SARS-CoV-2 Vaccine Effectiveness in a High-Risk National Population in a Real-World Setting. Ann Intern Med 2021. 9. 9.Thompson MG, Stenehjem E, Grannis S, et al. Effectiveness of Covid-19 Vaccines in Ambulatory and Inpatient Care Settings. New England Journal of Medicine 2021. 10. 10.Moline HL, Whitaker M, Deng L, et al. Effectiveness of COVID-19 Vaccines in Preventing Hospitalization Among Adults Aged ≥65 Years - COVID-NET, 13 States, February-April 2021. MMWR Morb Mortal Wkly Rep 2021; 70(32): 1088–93. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.15585/mmwr.mm7032e3&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=34383730&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F10%2F01%2F2021.09.29.21264199.atom) 11. 11.Chemaitelly H, Yassine HM, Benslimane FM, et al. mRNA-1273 COVID-19 vaccine effectiveness against the B.1.1.7 and B.1.351 variants and severe COVID-19 disease in Qatar. Nat Med 2021. 12. 12.Chung H, He S, Nasreen S, et al. Effectiveness of BNT162b2 and mRNA-1273 covid-19 vaccines against symptomatic SARS-CoV-2 infection and severe covid-19 outcomes in Ontario, Canada: test negative design study. BMJ 2021; 374: n1943. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE4OiIzNzQvYXVnMjBfMjUvbjE5NDMiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8xMC8wMS8yMDIxLjA5LjI5LjIxMjY0MTk5LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 13. 13.Lopez Bernal J, Andrews N, Gower C, et al. Effectiveness of Covid-19 Vaccines against the B.1.617.2 (Delta) Variant. New England Journal of Medicine 2021; 385(7): 585–94. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F10%2F01%2F2021.09.29.21264199.atom) 14. 14.Mallapaty S. COVID vaccines slash viral spread - but Delta is an unknown. Nature 2021; 596(7870): 17–8. 15. 15.Scobie HM, Johnson AG, Suthar AB, et al. Monitoring Incidence of COVID-19 Cases, Hospitalizations, and Deaths, by Vaccination Status - 13 U.S. Jurisdictions, April 4-July 17, 2021. MMWR Morb Mortal Wkly Rep 2021; 70(37): 1284–90. 16. 16.Brown CM, Vostok J, Johnson H, et al. Outbreak of SARS-CoV-2 Infections, Including COVID-19 Vaccine Breakthrough Infections, Associated with Large Public Gatherings - Barnstable County, Massachusetts, July 2021. MMWR Morb Mortal Wkly Rep 2021; 70(31): 1059–62. 17. 17.Keehner J, Horton LE, Binkin NJ, et al. Resurgence of SARS-CoV-2 Infection in a Highly Vaccinated Health System Workforce. New England Journal of Medicine 2021. 18. 18.Tenforde MW, Self WH, Naioti EA, et al. Sustained Effectiveness of Pfizer-BioNTech and Moderna Vaccines Against COVID-19 Associated Hospitalizations Among Adults - United States, March-July 2021. MMWR Morb Mortal Wkly Rep 2021; 70(34): 1156–62. 19. 19.Bajema KL, Dahl RM, Prill MM, et al. Effectiveness of COVID-19 mRNA Vaccines Against COVID-19-Associated Hospitalization - Five Veterans Affairs Medical Centers, United States, February 1-August 6, 2021. MMWR Morb Mortal Wkly Rep 2021; 70(37): 1294–9. 20. 20.Rosenberg ES, Holtgrave DR, Dorabawila V, et al. New COVID-19 Cases and Hospitalizations Among Adults, by Vaccination Status - New York, May 3-July 25, 2021. MMWR Morb Mortal Wkly Rep 2021; 70(37): 1306–11. 21. 21.Fowlkes A GM, Groover K, et al. . Effectiveness of COVID-19 Vaccines in Preventing SARS-CoV-2 Infection Among Frontline Workers Before and During B.1.617.2 (Delta) Variant Predominance — Eight U.S. Locations, December 2020–August 2021. MMWR Morb Mortal Wkly Rep 2021; 70:1167–1169. 22. 22.Nanduri S, Pilishvili T, Derado G, et al. Effectiveness of Pfizer-BioNTech and Moderna Vaccines in Preventing SARS-CoV-2 Infection Among Nursing Home Residents Before and During Widespread Circulation of the SARS-CoV-2 B.1.617.2 (Delta) Variant - National Healthcare Safety Network, March 1-August 1, 2021. MMWR Morb Mortal Wkly Rep 2021; 70(34): 1163–6. 23. 23.Koebnick C, Langer-Gould AM, Gould MK, et al. Sociodemographic characteristics of members of a large, integrated health care system: comparison with US Census Bureau data. Perm J 2012; 16(3): 37–41. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.7812/TPP/12-031&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23012597&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F10%2F01%2F2021.09.29.21264199.atom) 24. 24.CDPHA. Updated COVID-19 Vaccine Eligibility Guidelines. California Department of Public Health 2021. 25. 25.CCVP.Reporting Doses Administered: California COVID-19 Vaccination Program. California Department of Public Health. 26. 26.Mishra S, Mindermann S, Sharma M, et al. Changing composition of SARS-CoV-2 lineages and rise of Delta variant in England. EClinicalMedicine 2021; 39. 27. 27.Brown KA, Gubbay J, Hopkins J, et al. S-Gene Target Failure as a Marker of Variant B.1.1.7 Among SARS-CoV-2 Isolates in the Greater Toronto Area, December 2020 to March 2021. JAMA 2021; 325(20): 2115–6. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jama.2021.5607&link_type=DOI) 28. 28.Washington NL, Gangavarapu K, Zeller M, et al. Emergence and rapid transmission of SARS-CoV-2 B.1.1.7 in the United States. Cell 2021; 184(10): 2587-94.e7. 29. 29.Pouwels KB, Pritchard E, Matthews PC, et al. Impact of Delta on viral burden and vaccine effectiveness against new SARS-CoV-2 infections in the UK. medRxiv 2021: 2021.08.18.21262237. 30. 30.Nasreen S, Chung H, He S, et al. Effectiveness of COVID-19 vaccines against variants of concern in Ontario, Canada. medRxiv 2021: 2021.06.28.21259420. 31. 31.Tang P, Hasan MR, Chemaitelly H, et al. BNT162b2 and mRNA-1273 COVID-19 vaccine effectiveness against the Delta (B.1.617.2) variant in Qatar. medRxiv 2021: 2021.08.11.21261885. 32. 32.Tartof SY, Slezak JM, Fischer H, et al. Six-Month Effectiveness of BNT162B2 mRNA COVID-19 Vaccine in a Large US Integrated Health System: A Retrospective Cohort Study. Preprints with THE LANCET 2021. 33. 33.Andrews N, Tessier E, Stowe J, et al. Vaccine effectiveness and duration of protection of Comirnaty, Vaxzevria and Spikevax against mild and severe COVID-19 in the UK. Preprint 2021. 34. 34.Grannis SJ, Rowley EA, Ong TC, et al. Interim Estimates of COVID-19 Vaccine Effectiveness Against COVID-19-Associated Emergency Department or Urgent Care Clinic Encounters and Hospitalizations Among Adults During SARS-CoV-2 B.1.617.2 (Delta) Variant Predominance - Nine States, June-August 2021. MMWR Morb Mortal Wkly Rep 2021; 70(37): 1291–3. 35. 35.Havers FP, Pham H, Taylor CA, et al. COVID-19-associated hospitalizations among vaccinated and unvaccinated adults ≥18 years – COVID-NET, 13 states, January 1 – July 24, 2021. medRxiv 2021: 2021.08.27.21262356. 36. 36.Chia PY, Xiang Ong SW, Chiew CJ, et al. Virological and serological kinetics of SARS-CoV-2 Delta variant vaccine-breakthrough infections: a multi-center cohort study. medRxiv 2021: 2021.07.28.21261295. 37. 37.Pegu A, O’Connell S, Schmidt SD, et al. Durability of mRNA-1273 vaccine-induced antibodies against SARS-CoV-2 variants. Science 2021. 38. 38.Baden LR, El Sahly HM, Essink B, et al. Covid-19 in the Phase 3 Trial of mRNA-1273 During the Delta-variant Surge. medRxiv 2021: 2021.09.17.21263624. 39. 39.Self WH, Tenforde MW, Rhoads JP, et al. Comparative Effectiveness of Moderna, Pfizer-BioNTech, and Janssen (Johnson & Johnson) Vaccines in Preventing COVID-19 Hospitalizations Among Adults Without Immunocompromising Conditions - United States, March-August 2021. MMWR Morb Mortal Wkly Rep 2021; 70(38): 1337–43. 40. 40.Dean NE, Hogan JW, Schnitzer ME. Covid-19 Vaccine Effectiveness and the Test-Negative Design. New England Journal of Medicine 2021.