PT - JOURNAL ARTICLE AU - Roberts, Emily K. AU - Gu, Tian AU - Mukherjee, Bhramar AU - Fritsche, Lars G. TI - Estimating COVID-19 Vaccination Effectiveness Using Electronic Health Records of an Academic Medical Center in Michigan AID - 10.1101/2022.01.29.22269971 DP - 2022 Jan 01 TA - medRxiv PG - 2022.01.29.22269971 4099 - http://medrxiv.org/content/early/2022/01/31/2022.01.29.22269971.short 4100 - http://medrxiv.org/content/early/2022/01/31/2022.01.29.22269971.full AB - Importance Systematic characterization of the protective effect of vaccinations across time and at-risk populations is needed to inform public health guidelines and personalized interventions.Objective To evaluate the vaccine effectiveness (VE) over time and determine differences across demographic and clinical risk factors of COVID-19.Design, Setting, and Participants This test negative design consisted of adult patients who were tested or diagnosed for COVID-19 at Michigan Medicine in 2021. Variables extracted from Electronic Health Records included vaccination status, age, gender, race/ethnicity, comorbidities, body mass index, residential-level socioeconomic characteristics, past COVID-19 infection, being immunosuppressed, and health care worker status.Exposure The primary exposure was vaccination status and was categorized into fully vaccinated with and without booster, partially vaccinated, or unvaccinated.Main Outcomes and Measures The main outcomes were infection with COVID-19 (positive test or diagnosis) and having severe COVID-19, i.e., either being hospitalized or deceased. Based on these, VE was calculated by quarter, vaccine, and patient characteristics.Results Of 170,487 COVID-19 positive adult patients, 78,002 (45.8%) were unvaccinated, and 92,485 (54.2%) were vaccinated, among which 74,060 (80.1%) were fully vaccinated. COVID-19 positivity and severity rates were substantially higher among unvaccinated (12.1% and 1.4%, respectively) compared to fully vaccinated individuals (4.7% and 0.4%, respectively). Among 7,187 individuals with a booster, only 18 (0.3%) had a severe outcome. The covariate-adjusted VE against an infection was 62.1% (95%CI 60.3–63.8%), being highest in the Q2 of 2021 (90.9% [89.5–92.1%]), lowest in Q3 (60.1% [55.9–64.0%]), and rebounding in Q4 to 68.8% [66.3– 71.1%]). Similarly, VE against severe COVID-19 overall was 73.7% (69.6–77.3%) and remained high throughout 2021: 87.4% (58.1–96.3%), 92.2% (88.3–94.8%), 74.4% (64.8–81.5%) and 83.0% (78.8–86.4%), respectively. Data on fully vaccinated individuals from Q4 indicated additional protection against infection with an additional booster dose (VE-Susceptibility: 64.0% [61.1–66.7%] vs. 87.3% [85.0–89.2%]) and severe outcomes (VE-Severity: 78.8% [73.5–83.0%] vs. 94.0% [89.5–96.6%]). Comparisons between Pfizer-BioNTech and Moderna vaccines indicated similar protection against susceptibility (82.9% [80.7–84.9%] versus 88.1% [85.5– 90.2%]) and severity (87.1% [80.3–91.6%]) vs. (84.9% [76.2–90.5%]) after controlling for vaccination timing and other factors. There was no significant effect modification by all the factors we examined.Conclusions and Relevance Our findings suggest that COVID-19 vaccines offered high protection against infection and severe COVID-19, and showed decreasing effectiveness over time and improved protection with a booster.Question How do the rates of COVID-19 outcomes (infections or mild/severe disease) compare across vaccination status and quarters of 2021, after adjusting for confounders?Findings In this cohort of 170,487 adult patients tested for or diagnosed with COVID-19 during 2021, both COVID-19 positivity and severity rates were substantially higher in unvaccinated compared to fully vaccinated individuals. Vaccine effectiveness estimation was adjusted for covariates potentially related to both being vaccinated and COVID-19 outcomes; this also allowed us to determine if effectiveness differed across patient subgroups. The estimated vaccine effectiveness across the four quarters of 2021 was 62.1% against infection and was 73.7% against severe COVID-19 (defined as hospitalization, ICU admission, or death). There was no significant effect modification by all the factors we examined.Meaning These findings suggest COVID-19 vaccines had relatively high protection against infection and severe COVID-19 during 2021 for those who received two doses of an mRNA vaccine (Moderna or Pfizer-BioNTech) or one dose of the Janssen vaccine, of which the effectiveness decreased over time and improved with a booster.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThis study was funded by the University of Michigan Precision Health Initiative, University of Michigan Rogel Cancer Center, and Michigan Institute of Data Science. Dr Mukherjee's research was funded by grant No. NSF DMS 1712933 from the National Science Foundation, and Dr Fritsche's research was supported by grant No. CA 046592 from the National Cancer Institute, National Institutes of Health.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Ethical review and approval were waived for this study due to its qualification for a federal exemption as secondary research for which consent is not required. Determination for exemption made by the University of Michigan Medical School Institutional Review Board (IRBMED) (study ID: HUM00180294).I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe datasets generated during and/or analyzed during the current study are not publicly available due to MM privacy regulations.