ESTIMATING THE EFFECT OF VACCINATION ON THE CASE-FATALITY RATE FOR COVID-19

Objective To evaluate the effectiveness of vaccination on the case fatality rate (CFR) for COVID-19 infection. Unlike infection or mortality rates, CFR is not affected by unmeasured patient behaviors or environmental factors that affect the risk of exposure.

Methods Cases were identified through the COVID Shared Data Resource (CSDR) of the Department of Veterans Affairs. Patients were included in this study if they had baseline data available for risk stratification. The primary outcome was death within 60 days of the first positive nucleic acid amplification test (NAAT). A patient was considered fully vaccinated if they had received one dose of the Johnson & Johnson product or two doses of any other formulation, at least, 14 days prior to the NAAT. Cases diagnosed in July, August, or September of 2021 were considered to have the delta variant. We used novel methods to control for confounders in multiple domains of the electronic medical record, including ICD10 codes, vital signs, baseline laboratory tests and outpatient medications. These procedures included retrieving all entries more than 14 days prior to the NAAT; deriving summary measures of their contribution to the risk of death; and including these measures as covariates in a logistic regression model evaluating vaccine effectiveness. PDeathDx refers to the risk of death based on 153 root ICD10 codes previously shown to be independent predictors of mortality. PDeathLabs refers to the risk based on 49 parameters from 4 vital signs and 7 baseline laboratory tests. AggRiskDx refers to the aggregate effect of 8 drug classes shown to have protective effects. Other predictors in the model included demographic characteristics and comorbidity scores. Logistic regression was used to derive adjusted odds ratios for the vaccination and delta terms. Separate models were developed for early COVID variants and the delta variant. Split sample validation was used to determine if the estimates for vaccine and delta effects were stable across independent patient samples.

Results On September 30, 2021, there were 339,772 patients in the COVID CSDR who met the criteria for this study. 9.1% had been fully vaccinated, while 21.5% were presumed to have the delta variant. The median time from vaccination to diagnosis was 154 days. Overall, 18,120 patients (5.33%) died within 60 days of their diagnosis. Multivariate modeling showed that age, gender, race, ethnicity, veteran status, PDeathDx, PDeathLabs, AggRiskRx and 3 of 4 comorbidity measures were independent risk factors for death within 60 days. The adjusted odds ratio for delta infection was 1.87 ± 0.05, which corresponds to a relative risk of 1.78. The adjusted odds ratio for prior vaccination was 0.280 ± 0.011, corresponding to a relative risk of 0.291. Separate models showed that vaccination had even greater benefits for delta infections than for earlier variants. Split sample procedures showed that the estimates for vaccine and delta effects were stable across independent samples.

Conclusions Estimates of vaccine effectiveness are valid to the extent that they exclude non-vaccine effects and control for confounding. Infection and mortality rates depend upon the risk of exposure which, in turn, depends upon the extent to which the patient adheres to COVID precautions and environmental factors. Moreover, there are hundreds of confounders that may promote higher vaccination rates in those suspected to have poor outcomes if they contract the virus. Our study used CFR and novel procedures to mitigate these problems. Although delta is substantially more lethal than earlier variants, vaccination reduces the risk of death by over 70%. Moreover, the benefit of such was observed at a median of 5 months after vaccination. Our study using CFR confirms that vaccination is an effective means of preventing COVID death and suggests that CFR would better identify changes in virulence of new variants.