COVID-19 vaccines effectiveness against symptomatic SARS-CoV-2 Delta variant infection: a population-based case-control study in St. Petersburg, Russia

Introduction

Mounting evidence suggests that vaccines remain effective against new variants of SARS-CoV-2, the virus that started the COVID-19 pandemic. Studies of mRNA and vector-based vaccines used in different countries report acceptable levels of effectiveness against SARS-CoV-2 infection caused by the new variants of concern (VOC) [1–7]. Waning immunity against new VOCs is another emerging concern as the follow-up time after the start of the vaccination programmes increases [8]. Therefore, timely and ongoing monitoring of the real-world effects for all vaccines used in programmes worldwide is crucial, given the geographical and temporal variation in global vaccine uptake and the spread of the new virus variants [9].

Only several international studies assessed the vaccine effectiveness (VE) of Gam-COVID-Vac [10], a vaccine dominating the Russian COVID19 vaccination programme. A study conducted in Hungary provided data on comparative VE in a national population-based programme that used several vaccines, including Gam-COVID-Vac from Russia and HB02 from China [11]. Gam-COVID-Vac effectiveness against SARS-CoV-2 infection and COVID-19related mortality was comparable to mRNA vaccines and slightly superior to other vector-based vaccines. However, the Hungary study covers the period before the spread of the Delta VOC. The case-control study in St. Petersburg was the first available evidence of vaccine effectiveness (VE) against referral to hospital in patients with symptomatic SARS-CoV-2 infection in Russia during the spread of the Delta VOC [7]. However, that study had several limitations. The information on the vaccine type was not available, so the estimated VE represented an average effect of three vaccines used in St. Petersburg: Gam-COVID-Vac, EpiVacCorona [12], and CoviVac [13]. It was safe to assume that the St. Petersburg study approximated the effectiveness of Gam-COVID-Vac given that it accounted for 95% of city vaccinations during the period under study. However, the VE for the two other vaccines used in Russia – EpiVacCorona and CoviVac — remained unclear. More importantly, that study did not provide direct evidence on the VE against SARS-CoV-2 infection and symptomatic disease.

Another point of concern in observational studies of VE is the proportion of individuals with natural immunity which protects from reinfection [14, 15]. If case-control studies include individuals with immunity after infection as controls, that will likely underestimate the actual VE against SARS-CoV-2. To illustrate this point, more than 45% of the population have contracted the SARS-CoV-2 by the end of April, 2021 in St. Petersburg, Russia [16]. Preliminary study results show that seroprevalence in unvaccinated may be more than 75% in October, 2021 [17].

In this population-based case-control study, we aimed to estimate the effectiveness of the Russian COVID-19 vaccines against symptomatic SARS-CoV-2 during the recent outbreak caused by the Delta VOC in October 2021 in St. Petersburg, Russia.

Methods

Results

Overall, 1,198 cases and 2,747 controls were included in the final analysis. Study participants characteristics are presented in Table 1. Before October 2021, among cases, 268 (22.4%) received Gam-COVID-Vac (Sputnik V), 54 (4.5%) — one dose Sputnik Light, 17 (1.4%) — EpiVacCorona, and 36 (3.0%) — CoviVac. Similar proportions among controls were 937 (34.1%), 214 (7.8%), 15 (0.5%) and 88 (3.2%), respectively. Cases were on average older (27.5% were older than 60 years compared to 19.1% among controls) and the proportion of women was also higher among cases (63.3% among cases vs 43.7% among controls). Only 2 (0.2%) patients who were referred for LDCT triage had documented past COVID-19 confirmed by PCR test. The proportion of controls who reported positive PCR test in the past was 22.1%. Both cases and controls were relatively uniformly distributed across recruitment dates (October 6–14, 2021).

In the primary analysis without accounting for the history of confirmed COVID-19, the VE against symptomatic PCR-confirmed SARS-CoV-2 infection adjusted for age and gender was 50% (95% CI: 42–58) for Gam-COVID-Vac (Sputnik V), 51% (95% CI: 32–64) for 1-dose Gam-COVID-Vac (Sputnik V) or Sputnik Light, -64% (95% CI: 230–19)) for EpiVacCorona, and 33% (95% CI: -6–58) for CoviVac. In the analysis restricted to participants without a history of confirmed COVID-19, all point estimates of VE moved upwards, except for the Sputnik Light group. The VE was 58% (95% CI: 50–64) for Gam-COVID-Vac (Sputnik V), 50% (95% CI: 30–64) for 1-dose Gam-COVID-Vac (Sputnik V) or Sputnik Light, -40% (95% CI: -191–33)) for EpiVacCorona, and 38% (95% CI: 0–62) for CoviVac (Table 2).

Crude and adjusted VE against any lung injury following the LDCT assessment is presented in Table 3. In the analysis restricted to participants without a history of confirmed COVID-19, all point estimates of VE against lung injury also moved upwards.

The adjusted VE against symptomatic SARS-CoV-2 infection was slightly lower in women (52%, 95% CI: 41–62) than men (66%, 95% CI: 55–74). It was also higher in younger age (Table 4). However, in the analysis restricted to participants without a history of confirmed COVID-19, the differences in VE by age group were smaller.

In the sensitivity analysis, misclassification related to vaccine name and vaccination dates did not dramatically change VE estimates.

Discussion

This is the first study examining the comparative effectiveness of three COVID-19 vaccines used in Russia. Our study results assure that Gam-COVID-Vac is highly effective against symptomatic SARS-CoV-2 and severe COVID-19 pneumonia during the Delta VOC spread. We have shown that Gam-COVID-Vac provides at least 58% protection against symptomatic infection caused by the Delta VOC. However, the effectiveness is likely to be higher as it is difficult to account for all past SARS-CoV-2 infections in the Russian population. Furthermore, past COVID-19 is associated with decreased vaccine uptake in Russia. Our study’s apparent strength is the attempt to account for past infections in both cases and controls and show the resulting direction of possible bias. Assuming natural immunity is protective against re-infection, failure to account for it in populations with high seroprevalence would bias VE estimates downwards. Another possible representation of this is the change in Gam-COVID-Vac VE by age group after accounting for the history of confirmed COVID-19.

We have shown that the bias related to a significant number of unvaccinated individuals with a history of COVID-19 will likely lead to underestimating the effectiveness of vaccination from observational data. However, we remain uncertain about the possible magnitude of this bias. The individual-level data on past asymptomatic infection is challenging to obtain, if possible at all. Preliminary results show that seroprevalence in unvaccinated may be more than 75% in October, 2021 [17] in St. Petersburg. In countries with higher vaccine uptake and lower seroprevalence VE estimated in observational studies is higher [5], but these estimates are not directly comparable with our results. The Omicron VOC spread will likely make the interpretation of the VE studies even more difficult. Direct comparison similar to the Hungarian study will be needed for the new variants [11].

In contrast to Gam-COVID-Vac, two other vaccines, EpiVacCorona and CoviVac, were not similarly effective against symp-tomatic infection caused by Delta VOC of SARS-CoV-2 in our study. Both vaccines were relatively rare in the population of St. Petersburg, and our study was underpowered for them. However, our study provides reasonable doubts about possible effectiveness of EpiVacCorona against new emerging VOCs. CoviVac usefulness is also doubtful in the presence of highly effective Gam-COVID-Vac. More studies are needed to assess the VE of EpiVacCorona and CoviVac against new variants of SARS-CoV-2 for them to be used in the ongoing vaccination programme. Unfortunately, efficacy data is currently available only for Gam-COVID-Vac [22]. Booster campaigns that are now gaining more scientific support should only utilise vaccines with proven efficacy and effectiveness [23–25].

It is also worth mentioning that while the VE for CoviVac was beyond the VE for Gam-COVID-Vac, the estimate for EpiVacCorona VE was negative. The efficacy is not likely to be negative, so our results have two realistic explanations. First, individuals could change their behaviour after vaccination, but more likely negative VE is a marker for the bias arising from the undercounting of past COVID-19 in controls.

This is our second VE study in St. Petersburg, Russia, and it provides a promising independent and timely framework for assessing COVID-19 vaccines in Russia. Population-based case-control studies represent a critical post-registration tool to monitor VE against emerging SARS-CoV-2 VOCs. The Omicron VOC pandemic has not involved Russia by the end of 2021, but there are few doubts that it will affect the course of the pandemic in Russia as previously the Delta VOC had [16]. The lack of real-world evidence may be one of the reasons behind the modest uptake of vaccination in Russia. The majority in Russia does not deny the idea of vaccination but is hesitant [26].

Despite the wide use of case-control studies to assess VE, researchers should be aware of all possible biases arising from this study design. Unfortunately, the golden standard to estimate VE — randomised trials — are not applicable in the rapidly changing epidemiological situation, and we have to rely on observational study design. The varying VE against different SARS-CoV-2 variants is an example of a lack of generalizability for the results of randomised trials. Our study underlines the biases related to the population under study, but additional biases arise from the misclassification of exposure, e.g., vaccination status [27]. The self-reported vaccination status is an important limitation of our study. Several survey participants included in the control group have not reported the exact date of vaccination. While the overall number of such individuals was low, we assumed that the vaccination date for such individuals is likely to be several months from the interview date. However, we assigned them a “non-vaccinated” status in our sensitivity analysis, and the estimates were only slightly affected. Our definition for full vaccination status was also very conservative, as we decided to accept a minimum of six days between the second vaccine dose and study inclusion. While our decision was driven by the idea that we should not exclude participants without an exact date of vaccination, we do not think that this assumption would significantly bias the results. However, most of the studies choose 14-day period [5], and that should be taken into account when comparing our results to other studies.

We have undertaken additional attempts to identify cases (patients with symptomatic SARS-CoV-2 in October, 2021) who had the history of confirmed COVID-19 more than two months before the current episode. We were able to identify only two cases of re-infection. While underreporting may occur, it is also likely that a patient with re-infection that requires additional diagnostic followup is an infrequent event. Absolute risks of re-infection, especially of severe disease, are low for the Alpha, Beta, and Delta VOCs [28, 29]. However, more studies are needed to observe the risk of re-infection with new Omicron VOCs, as it is likely to be higher [30]. Overall, the risks may still be lower in absolute terms than for primary infection.

In our study, the VE in the Sputnik Light group was similar to two-dose Gam-COVID-Vac. However, the correction for the history of confirmed COVID-19 did not move the Sputnik Light VE upwards. Single Gam-COVID-Vac vaccination labelled as Sputnik Light was used as a booster after the COVID-19, so it is likely that the prevalence of past COVID-19 is higher is this group. The VE for Sputnik Light could represent the combination of single-dose boosted natural immunity mixed with single-dose vaccine.

Some of these limitations are inherent to observational study design. Still, other difficulties can be overcome by establishing a pre-existing framework for real-time assessment of vaccine effectiveness as a part of epidemiological surveillance.

In conclusion, Gam-COVID-Vac effectiveness against symptomatic SARS-CoV-2 infection caused by Delta VOC is at least 58%, but is likely to be higher. However, estimating effectiveness is difficult due to the high prevalence of natural immunity in the population. Nevertheless, Gam-COVID-Vac significantly outperforms two other Russian vaccines whose effectiveness against symptomatic SARS-CoV-2 infection caused by Delta VOC is yet to be shown.

Authors’ contributions

Anton Barchuk, Artemy Okhotin, and Mikhail Cherkashin conceived the study. Anton Barchuk, Artemy Okhotin, Mikhail Cherkashin, and Oksana Stanevich coordinated the study. Anton Barchuk, Artemy Okhotin, Dmitriy Skougarevskiy, and Anna Bulina drafted the first version of the manuscript. Mikhail Cherkashin, Natalia Berezina, Tatyana Rakova, Darya Kuplevatskaya, and Oksana Stanevich contributed to drafting sections of the manuscript. Mikhail Cherkashin, Natalia Berezina, Tatyana Rakova, Darya Kuplevatskaya collected data for analyses. Anna Bulina and Anton Barchuk did data analyses. All authors participated in the study design, helped draft the manuscript, contributed to the interpretation of data, and read and approved the final manuscript.

Declaration of interests

Anton Barchuk reports personal fees from AstraZeneca, MSD, and Biocad outside the submitted work. Other authors have no conflict of interest to declare.

Supplementary materials