Abstract
There is limited data directly comparing the effectiveness of COVID-19 vaccines. We compared rates of SARS-CoV-2 Omicron BA.1/2 infection in Australian adults during March to May 2022 who had received one of four COVID-19 vaccines in the last 14-63 days as either a primary course or a booster dose. As a primary course, compared to recipients of BNT162b2 mRNA vaccine, adjusted hazard ratios for SARS-CoV-2 infection were 1.03 (95%CI 0.82-1.30), 1.19 (0.95-1.49), 1.70 (1.46-1.97) for respectively mRNA-1273, ChAdOx-1 nCov-19 and NVX-CoV2373. For booster dose, respective adjusted hazard ratios compared to BNT162b2 mRNA vaccine were 1.02 (95%CI 1.00-1.04), 1.20 (1.10-1.32), 1.39 (1.20-1.60). Our findings suggest relatively higher effectiveness of ancestral strain mRNA vaccines against SARS-CoV-2 Omicron infection than viral vector and protein subunit vaccines, but further studies are required due to small numbers of recipients of ChAdOx-1 nCov-19 and NVX-CoV2373.
Background
There are currently 11 COVID-19 vaccines granted emergency use listing (EUL) by the World Health Organization (WHO)1. While all have been shown to be efficacious in controlled clinical trials in a primary course, data comparing effectiveness between vaccine types as a primary course and booster are limited. Direct comparisons between vaccine types are difficult because licensure and vaccine introduction into national programs has occurred at different time points during the SARS-CoV-2 pandemic; dominant virus variants and underlying population-level infection-induced immunity also differ. Additionally, clinical recommendations regarding use by vaccine type, such as the eligible population for primary and booster dosing, and intervals between doses have changed.
Four vaccines, BNT162b2 mRNA (Pfizer Comirnaty), mRNA-1273 (Moderna Spikevax), ChAdOx1 nCov-19 (Oxford-Astrazeneca Vaxzevria) and NVX-CoV2373 (Novavax Nuvaxovid) are available for use in Australian adults2. BNT162b2 mRNA and ChAdOx1 nCov-19 were available in early 2021; most of the Australian adult population received these vaccines in a homologous 2 dose primary course3. mRNA-1273 was available from October 2021 and NVX-CoV2373 from February 2022, meaning that substantially fewer individuals received these latter two vaccines as a primary course. Booster doses (third dose) of COVID-19 vaccines were recommended from late November 2021 in response to evidence of waning protection from primary vaccination and significant community transmission of the SARS-CoV-2 Omicron variant in Australia.
To address the limited data on comparative effectiveness of COVID-19 vaccine types, particularly for NVX-CoV2373, we sought to directly compare effectiveness of the four vaccines currently used in Australia against infection with SARS-CoV-2 during the period March-May 2022 when the Omicron BA.1 and BA.2 variants were circulating.
Methods
Study design, data sources, definitions
We constructed a cohort of individuals aged ≥18 years residing in the areas of Greater Sydney and Hunter New England in Australia’s most populous state, New South Wales (NSW). The cohort was defined using the Australian Immunisation Register (AIR), a national registry including all people in Australia registered with Australia’s national universal health insurance scheme (Medicare) as well as individuals not registered but who had received a COVID-19 vaccine. The AIR includes demographic information on individuals and vaccine details (brand, date of administration, dose number). Reporting of COVID-19 vaccination to the AIR was made mandatory prior to the COVID-19 vaccine program commencement.
The cohort was probabilistically linked (using name, date of birth, residential address and sex) to notifications of SARS-CoV-2 infections and death registrations. Notification of SARS-CoV-2 infection was mandatory to record in the NSW Notifiable Conditions Information Management System (NCIMS) with diagnoses made by polymerase chain reaction (PCR) tests or rapid antigen tests (RAT) included during the study period. Death registrations included all registered deaths in NSW and the date of death. The main study outcome was a SARS-CoV-2 infection, as based on NCIMS case notification. Vaccination data were obtained from each individual’s AIR record. Our analyses compared vaccine type for the primary course and the booster. For the primary course, we classified individuals as recipients of one of the four vaccine types if both dose 1 and 2 were the same vaccine type, heterologous primary course recipients were categorised separately. For the booster dose comparison we compared the vaccine type received for dose 3, regardless of the primary course type.
Statistical analysis
We conducted separate analyses for the primary course and for boosters. The study period commenced on 1 March 2022 and ended on 27 May 2022, a period corresponding to when the Omicron subvariants BA.1 and BA.2 were circulating4. For the main analyses we excluded individuals who prior to the study period had a COVID-19 case notification, death record, or had received more vaccine doses than were of interest for the analysis (dose 3 for the primary course analysis and dose 4 for the booster analysis). We used Cox-regression to estimate hazard ratios comparing infection rates between recipients of different vaccine types. Vaccination status, including type, dose and interval since receipt was treated as a time-varying variable. Analysis time commenced on 1 March 2022 and ended at either the date of COVID-19 notification, death, receipt of a 3rd dose (for the primary course analysis) or 4th dose (for the booster dose analysis) or the 27 May 2022 which was the last date of complete records.
To ensure comparability of the interval since receipt of vaccine, comparisons focused on the interval 14-63 days (2-6 weeks) after receipt of the second dose for the primary course analysis, and 14-63 days after receipt of the 3rd dose for the booster analysis. The BNT162b2 mRNA (Pfizer Comirnaty) vaccine was set as the reference group as this was the most widely used vaccine type for both primary and booster doses. Analyses were adjusted for age (in 2-year increments), gender, socioeconomic status (deciles based on an Australian index using residence and census data5), and number of comorbidities (based on ICD-10 coded hospitalisations with specified medical conditions in the 2 years prior to the analysis start date3).
We conducted subgroup analyses by age (<50 and ≥50 years), gender and socioeconomic status and also conducted two sensitivity analysis; 1) including individuals who had had a prior SARS-CoV-2 case notification and adjusting for prior infection and; 2) restricting analyses to the period from 1 April to 27 May 2022 when more individuals had had an opportunity to have NVX-CoV2373. This study was approved by the NSW Population and Health Services Research Ethics Committee (2022/ETH00584).
Results
After exclusions, the main study cohort for the primary course analysis included 2.27 million individuals and the booster analysis 4.61 million. However, for the main comparisons, of those who received 2 or 3 doses within 14-63 days, the number of individuals classified by the end of follow up was 5923 and 204748, respectively. Table 1 and 2 show characteristics of the cohort overall and by vaccine type as classified at the end of follow-up. The mean age in the primary course analysis was 44.0 years (standard deviation [SD] 17.6 years) and 47.7% were female; for the booster dose the mean age was 48.5 (SD 18.5 years) and 50.4% were women.
Of the 5923 who received the second dose of their primary course in the last 14-63 days by end of follow-up, BNT162b2 mRNA was mostly commonly received (N=3212) followed by NVX-CoV2373 (n=2082). NVX-CoV2373 recipients were older, more likely female, of higher socioeconomic status, but less likely to have a comorbidity than mRNA vaccine recipients. ChAdOx1 nCov-19 recipients were older, and less likely female than mRNA vaccine recipients. The interval between receipt of first and second doses of NVX-CoV2373 were shorter (median 24 days) than for mRNA vaccine recipients (median 35 days) and ChAdOx1 nCov-19 recipients (median 81 days).
Among the 204748 who were within 14-63 days of receipt of their first booster (3rd dose), the majority received an mRNA vaccine (BNT162b2=160363 (78%); mRNA-1273=40876 (20%)) with <1% receiving either of NVX-CoV2373 or ChAdOx1 nCov-19. Similar to the primary course, NVX-CoV2373 and ChAdOx1 nCov-19 booster recipients were older than mRNA booster recipients. NVX-CoV2373 recipients were also more likely to be women and were less likely socioeconomically disadvantaged than mRNA booster recipients. Most individuals had received BNT162b2 for their primary vaccine course although this differed by the booster vaccine type; 67.2% of BNT162b2 booster recipients also had a BNT162b2 primary course while only 4.5% of ChAdOx1 nCov-19 booster recipients had BNT162b2 as the primary course.
Figure 1 shows case numbers, crude rates, and adjusted hazard ratios (aHR) for SARS-CoV-2 infection by vaccine type of primary course or booster. The crude infection rate was slightly higher in booster dose recipients compared to primary course recipients. Among recent BNT162b2 recipients diagnosed with COVID-19, 49% (primary) and 50% (booster) were diagnosed using PCR; this was higher among recent NVX-CoV2373 recipients (53% for primary; 58% for booster). The relative SARS-CoV-2 infection rate by vaccine type was similar for both primary course and booster; similar infection rates were evident among mRNA vaccine recipients (comparing mRNA-1273 to BNT162b2, primary course aHR was 1.03 (95%CI 0.82-1.30); booster aHR 1.02 (95%CI 1.00-1.04)). Recipients of ChAdOx1 nCov-19 for both the primary and booster had slightly higher infection rates compared with BNT162b2, although not significantly different for the primary course (primary course aHR 1.19 (95%CI 0.95-1.49); booster aHR 1.20 (95%CI 1.10-1.39)). For NVX-CoV2373, the infection rates were higher than for BNT162b2 for both primary (aHR 1.70 (95%CI 1.46-1.97) and booster doses (aHR 1.39 (95%CI 1.20-1.60)). These infection rate differences by vaccine type were generally consistent in subgroups of individuals <50 and 50+ years of age, in men and women, and by lower or higher socioeconomic status (Supplementary Table 1).
Sensitivity analyses shown in Supplementary Tables 2 and 3 included an additional 424,033 (primary course) and 637,476 (booster) individuals who had previously been notified with SARS-CoV-2 infection. When prior infection was adjusted for, results were compatible with the main analyses. Similarly, when only the period from 1 April to 27 May was examined, while there were smaller numbers of individuals and events, results were also consistent.
Discussion
This study directly compares four of the WHO EUL COVID-19 vaccines, representing 3 different vaccine platforms, in the same calendar period of the SARS-CoV-2 pandemic, when the BA1 and BA.2 Omicron subvariants were circulating. We found, compared to the BNT162b2 mRNA vaccine, that mRNA-1273 had similar effectiveness against SARS-CoV-2 infection when used either as a primary course or as a booster. Adjusted hazard ratios for COVID-19 in recipients of the adenoviral vector vaccine, ChAdOx1 nCov-19, and protein subunit vaccine NVX-CoV2373 were higher than in those who received the mRNA vaccines when used either as a primary course or as a booster.
There are few studies comparing effectiveness of COVID-19 vaccine types, particularly protein subunit vaccines. A recent systematic review and meta-analysis compared vaccine efficacy or effectiveness (from trials and observational studies) between vaccine platform types (mRNA, viral vector, inactivated and protein subunit) against variants of concern prior to Omicron (Alpha, Beta, Gamma, Delta) for primary and booster vaccination and reported that VE for primary vaccination was higher with mRNA vaccines compared to all other types but did not separate the other vaccine platform types due to smaller numbers of studies6. Most studies examining effectiveness against the Omicron variant have focussed on mRNA vaccines given as a booster with studies suggesting similar effectiveness of the BNT162b2 and mRNA-1273 vaccines against severe disease7,8, regardless of the priming course7. However, one study suggested that mRNA-1273 elicited higher protection against infection with the Omicron variant when compared to BNT162b2 in individuals primed with BNT162b29. Our findings are mostly consistent with the meta-analyses and studies comparing the two mRNA vaccines and ChAdOx-1. However, this is the first report that directly compares effectiveness of the protein subunit vaccine NVX-CoV2373 to other COVID-19 vaccine types.
Our findings on comparative effectiveness by type of booster are somewhat consistent with published data from the COV-Boost randomised trial10 which compared immunogenicity to ancestral spike protein between seven vaccine types including all four vaccine types examined here, given as a booster in individuals primed with either ChAdOx1 nCov-19 or BNT162b2. COV-Boost found the highest spike IgG GMCs in those receiving mRNA-1273 followed by BNT162b2, NVX-CoV2373 and then ChAdOx1 nCov-19, noting that the mRNA-1273 dose used in the trial was double that registered and used in Australia (100μg vs 50μg). The relative neutralising antibody titres in this trial were also similar in individuals primed with ChAdOx1 nCov-19. Another study which compared neutralising activity of several COVID-19 vaccines against different Omicron sublineages found greater fold decreases of neutralisation against both BA.1 and BA.2 sublineages for NVX-CoV2373 compared to BNT162b2 and mRNA-127311.
A recent predictive model12 suggested that vaccine protection against SARS-CoV-2 infection decreases with increasing genetic distance from the original vaccine-type strain, but that the level of decrease differs according to vaccine technology platform; reduced protection from protein subunit vaccines compared to mRNA and viral vector vaccines was predicted. Our study results during a period of circulation of Omicron BA.1 and BA.2 strains, highly divergent from the ancestral virus, are consistent with this model’s findings.
It is important to note that we only examined infection and did not have information to confirm if this resulted in clinical disease. We lacked data on severe disease but, it is unlikely the relatively small numbers of individuals receiving primary or booster doses of NVX-CoV2373 or ChAdOx1 nCov-19 during the study period would have allowed sufficient statistical power to compare effectiveness across the 4 vaccine types for this outcome. Uncontrolled confounding by behavioural characteristics, such as differences in propensity to test, among those who preferred non-mRNA vaccine types cannot be excluded as a possible explanation for the differences we found. However, our results were consistent in subgroups of age, socioeconomic status and gender as well as in various sensitivity analyses. We also noted that while there were differences in the interval between receipt of dose 1 and 2 in the primary course analysis with recipients of NVX-CoV2373 having on average the shortest interval, the differences in disease risk between vaccine types were also observed in the booster dose analysis.
It is notable that the individuals receiving a primary course in this study period may have been vaccine hesitant given they had access to vaccination earlier in 2021; more than 91% of the adult Australian population was estimated to have received a primary course prior to 202213. However, our study was robust because we only compared vaccine types between individuals receiving a primary course in the same calendar period. In Australia all vaccines were recommended for use in a primary course, but booster recommendations preferenced mRNA vaccines over other vaccine types2, therefore those who received NVX-CoV2373 or ChAdOx1 nCov-19 may have also had some contraindication to mRNA vaccine receipt. Whether this could independently alter their risk of SARS-CoV-2 infection is unclear. Also, in considering NVX-CoV2373 as a booster, as this vaccine was introduced much later, those who received it may be systematically different to the majority of the population who received the other 3 vaccine types in ways that we were unable to measure. Finally, we only compared the interval 2-9 weeks since vaccine receipt as too few individuals receiving NVX-CoV2373 had received vaccine >9 weeks earlier, given the timing of NVX-CoV2373 introduction into Australia. So, it is unclear if the differences we observed would continue to be seen with longer observation time following vaccine receipt.
In summary, our findings suggest relatively higher effectiveness of mRNA vaccines against SARS-CoV-2 Omicron infection than viral vector and protein subunit vaccines, when all vaccines were based on the ancestral strain. The findings are consistent with available immunological data, models predicting vaccine effectiveness by vaccine platform, and data from observational studies of mRNA and ChAdOx1 nCov-19, but provide important new information on NVX-CoV2373. From an epidemiological perspective, given the relatively small numbers of individuals receiving the viral vector and protein subunit vaccine, it would be useful to see these comparative effectiveness analyses repeated in other settings. From a public health perspective, we emphasise that as all four vaccines have been shown to provide good protection against severe disease from SARS-CoV-2 regardless of the variant type, our findings should not change the messaging around the importance of using available COVID-19 vaccines to protect populations at risk.
Data Availability
All data produced in the present study are available upon reasonable request to the NSW Ministry of Health with appropriate ethical approvals.
Funding
Supported by NSW Ministry of Health
Declarations
All authors have no conflicts of interest to declare
Data Access
Data used in this analysis are accessible on application to the NSW Ministry of Health with appropriate ethical approvals.
Acknowledgements
We thank colleagues at NSW Health for their support and access to data and to the NSW Centre for Health Record Linkage for conducting the linkage.