Effectiveness of mRNA and ChAdOx1 COVID-19 vaccines against symptomatic SARS-CoV-2 infection and severe outcomes with variants of concern in Ontario ==================================================================================================================================================== * Sharifa Nasreen * Hannah Chung * Siyi He * Kevin A. Brown * Jonathan B. Gubbay * Sarah A. Buchan * Deshayne B. Fell * Peter C. Austin * Kevin L. Schwartz * Maria E. Sundaram * Andrew Calzavara * Branson Chen * Mina Tadrous * Kumanan Wilson * Sarah E. Wilson * Jeffrey C. Kwong * on behalf of the Canadian Immunization Research Network (CIRN) Provincial Collaborative Network (PCN) Investigators ## ABSTRACT SARS-CoV-2 variants of concern (VOC) are more transmissible and have the potential for increased disease severity and decreased vaccine effectiveness. We estimated the effectiveness of BNT162b2 (Pfizer-BioNTech Comirnaty), mRNA-1273 (Moderna Spikevax), and ChAdOx1 (AstraZeneca Vaxzevria) vaccines against symptomatic SARS-CoV-2 infection and COVID-19 hospitalization or death caused by the Alpha (B.1.1.7), Beta (B.1.351), Gamma (P.1), and Delta (B.1.617.2) VOCs in Ontario, Canada using a test-negative design study. Effectiveness against symptomatic infection ≥7 days after two doses was 89–92% against Alpha, 87% against Beta, 88% against Gamma, 82–89% against Beta/Gamma, and 87–95% against Delta across vaccine products. The corresponding estimates ≥14 days after one dose were lower. Effectiveness estimates against hospitalization or death were similar to, or higher than, against symptomatic infection. Effectiveness against symptomatic infection is generally lower for older adults (≥60 years) compared to younger adults (<60 years) for most of the VOC-vaccine combinations. ## Introduction Evolution of the SARS-CoV-2 virus over the course of the COVID-19 pandemic has resulted in the emergence of four variants of concern (VOC), Alpha (B.1.1.7), Beta (B.1.351), Gamma (P.1), and Delta (B.1.617.2), to date. Alpha was first detected in United Kingdom (UK) in September 2020, Beta in South Africa in May 2020, Gamma in Brazil in November 2020, and Delta in India in October 20201. As of 28 September 2021, 193, 142, 96, and 187 countries, territories, and areas globally have reported Alpha, Beta, Gamma, and Delta cases respectively2. SARS-CoV-2 variants of concern (VOC) are more transmissible and have the potential to cause increased disease severity and to decrease COVID-19 vaccine effectiveness1. As of the time of writing, Delta is now the dominant VOC that is driving increases in infections, even in populations with high levels of access to vaccines. Evidence of the efficacy of COVID-19 vaccines against VOCs from randomized clinical trials is mostly limited to post-hoc estimates of vaccine efficacy against symptomatic infection; however, these analyses suffer from insufficient statistical power and may not have variant information for all cases. Vaccine efficacy against symptomatic infection >14 days after the second dose was reported to be 70% (95% confidence interval [CI]: 44 to 85%)3 against Alpha and 10% (95% CI, -77 to 55%)4 against Beta for ChAdOx1 (AstraZeneca Vaxzevria). Efficacy against infection by Beta >7 days after the second dose for BNT162b2 (Pfizer-BioNTech Comirnaty) was 100% (95% CI, 54 to 100%)5. Few observational studies have reported the effectiveness of COVID-19 vaccines against infection or severe outcomes caused by VOCs6-11. Ontario, the largest province in Canada, implemented a three-phased COVID-19 vaccination program starting in December 2020 and adopted a delayed second-dose strategy due to vaccine supply constraints during phase 112. BNT162b2 became available on 14 December 2020, mRNA-1273 (Moderna SpikeVax) on 28 December 2020, and ChAdOx1 on 10 March 202113. All four VOCs have been circulating at various times in Ontario in 202114. Our objective was to estimate the effectiveness of BNT162b2, mRNA-1273, and ChAdOx1 vaccines against symptomatic SARS-CoV-2 infection and severe outcomes (COVID-19 hospitalization or death) caused by Alpha, Beta, Gamma, and Delta between December 2020 and August 2021 in Ontario. ## Results ### Study population Over the study period, we identified 682,071 symptomatic community-dwelling individuals who were tested for SARS-CoV-2, with 31,440 (5%) positive for non-VOC SARS-CoV-2 and 51,440 (8%) positive for a VOC (Table 1). Cases of Delta were younger, more likely to reside in Central West region, more likely to occur later in the study period, less likely to have any comorbidities, and more likely to reside in neighbourhoods with lower household income and greater proportions of essential workers than cases of other VOCs and non-VOC SARS-CoV-2 infections, as well as test-negative controls. View this table: [Table 1:](http://medrxiv.org/content/early/2021/09/30/2021.06.28.21259420/T1) Table 1: Characteristics of symptomatic test-positive cases (by variants) and test-negative controls tested for SARS-CoV-2 between 14 December 2020 and 3 August 2021 in Ontario, Canada We identified 15,269 individuals with a COVID-19 hospitalization or death (Table 2). We observed largely the same sociodemographic patterns between individuals with severe outcomes caused by Delta versus those caused by other VOCs and non-VOC SARS-CoV-2. View this table: [Table 2:](http://medrxiv.org/content/early/2021/09/30/2021.06.28.21259420/T2) Table 2: Characteristics of test-positive cases with severe outcomes (hospitalization or death) between 14 December 2020 and 3 August 2021 (based on test date) in Ontario, Canada ### Vaccine effectiveness against symptomatic infection Against symptomatic infection caused by Alpha, vaccine effectiveness ≥14 days after the first dose was higher for mRNA-1273 (82%; 95% CI, 80–84%) than BNT162b2 (67%; 95% CI, 65– 68%) and ChAdOx1 (63%; 95% CI, 59–66%) (Figure 1a). Vaccine effectiveness was increased ≥7 days after the second dose against Alpha for all three vaccines: mRNA-1273=92% (95% CI, 88–95%), BNT162b2=89% (95% CI, 87–90%), and ChAdOx1=91% (95% CI, 62–98%). ![Figure 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/09/30/2021.06.28.21259420/F1.medium.gif) [Figure 1:](http://medrxiv.org/content/early/2021/09/30/2021.06.28.21259420/F1) Figure 1: Adjusted vaccine effectiveness estimates of BNT162b2 (Pfizer-BioNTech Comirnaty), mRNA-1273 (Moderna Spikevax), and ChAdOx1 (AstraZeneca Vaxzevria) vaccines ≥14 days after the first dose (for individuals who received only one dose) and ≥7 days after the second dose against symptomatic SARS-CoV-2 infection caused by (a) Alpha, (b) Beta, (c) Gamma, (d) Beta/Gamma, (e) Delta, and (f) non-VOC SARS-CoV-2, between 14 December 2020 and 3 August 2021 in Ontario, Canada Models were adjusted for age, sex, public health unit region, period of test (weekly period for Delta, and bi-weekly period for non-VOC SARS-CoV-2 and other VOCs), number of SARS-CoV-2 tests in the 3 months prior to 14 December 2020, presence of any comorbidity that increase the risk of severe COVID-19, receipt of 2019/2020 and/or 2020/2021 influenza vaccination, and Census dissemination area-level quintiles of household income, proportion of persons employed as non-health essential workers, persons per dwelling, and proportion of self-identified visible minorities. Data are presented as effectiveness point estimates, with error bars indicating the corresponding 95% CIs. Solid circles indicate vaccine effectiveness estimated as 100% based on zero vaccinated test-positive cases. Estimates of effectiveness against symptomatic infection caused by Beta (Figure 1b) were imprecise or were 100% because of low numbers, or absence, of vaccinated test-positive cases, respectively (Supplementary Table 1). Vaccine effectiveness against symptomatic infection caused by Gamma was higher after the first dose for mRNA-1273 (89%; 95% CI, 76– 95%) than ChAdOx1 (41%; 95% CI, 12–60%), and was intermediate for BNT162b2 (63%; 95% CI, 54–70%) (Figure 1c). Effectiveness against Gamma increased after the second dose for BNT162b2 but could not be reliably estimated for mRNA-1273 and ChAdOx1 because of zero vaccinated cases. Protection against symptomatic infection caused by Beta/Gamma appeared to be marginally higher (but with overlapping confidence intervals) after the first dose for mRNA-1273 (75%; 95% CI, 53–86%) than BNT162b2 (64%; 95% CI, 54–72%) and ChAdOx1 (62%; 95% CI, 37–77%) (Figure 1d). Receipt of the second dose increased vaccine effectiveness against Beta/Gamma for BNT162b2 (82%; 95% CI, 65–91%) and mRNA-1273 (89%; 95% CI, 21–98%) but could not be reliably estimated for ChAdOx1 due to an absence of any vaccinated cases (Supplementary Table 1). Against Delta, vaccine effectiveness after the first dose was higher for mRNA-1273 (70%; 95% CI, 64–76%) and ChAdOx1 (68%; 95% CI, 57–76%) than BNT162b2 (57%; 95% CI, 53–61%) (Figure 1e). Vaccine effectiveness was increased after the second dose for all three vaccines, to 95% (95% CI, 91–97%) for mRNA-1273, 87% (95% CI, 69–95%) for ChAdOx1, and 92% (95% CI, 90–94%) for BNT162b2. By product, vaccine effectiveness after one dose tended to be lower against Delta than against Alpha and Gamma for mRNA-1273 (70% vs. 82% and 89%) and for BNT162b2 (57% vs. 67% and 63%), but was similar to Alpha for ChAdOx1 (68% vs. 63%). Two doses of BNT162b2 and mRNA-1273 increased protection against Delta (92–95%) to levels comparable to Alpha (89–92%), Beta (87%), and Gamma (88%). ### Vaccine effectiveness against hospitalization or death Vaccine effectiveness against hospitalization or death caused by all four VOCs was generally higher than against symptomatic infection after the first dose for all three vaccines (Figure 2). In particular, against Delta, vaccine effectiveness against severe outcomes after the first dose of BNT162b2, mRNA-1273, and ChAdOx1 was 81% (95% CI, 76–85%), 90% (95% CI, 82–94%), and 91% (95% CI, 72–97%), respectively (Figure 2e). Receipt of the second dose was associated with vaccine effectiveness estimates above 90% against: Alpha, Beta, and Delta for BNT162b2; Alpha and Delta for mRNA-1273; and Delta for ChAdOx1. Estimates were in the 80% range against Gamma for BNT162b2 and Alpha for ChAdOx1, and could not be reliably estimated for other VOC-vaccine combinations due to low numbers, or absence, of vaccinated cases. ![Figure 2:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2021/09/30/2021.06.28.21259420/F2.medium.gif) [Figure 2:](http://medrxiv.org/content/early/2021/09/30/2021.06.28.21259420/F2) Figure 2: Adjusted vaccine effectiveness estimates of BNT162b2 (Pfizer-BioNTech Comirnaty), mRNA-1273 (Moderna Spikevax), and ChAdOx1 (AstraZeneca Vaxzevria) vaccines ≥14 days after the first dose (for individuals who received only one dose) and ≥7 days after the second dose against severe outcomes (hospitalization or death) caused by (a) Alpha, (b) Beta, (c) Gamma, (d) Beta/Gamma, (e) Delta, and (f) non-VOC SARS-CoV-2, between 14 December 2020 and 17 August 2021 in Ontario, Canada Models were adjusted for age, sex, public health unit region, period of test (weekly period for Delta, and bi-weekly period for non-VOC SARS-CoV-2 and other VOCs), number of SARS-CoV-2 tests in the 3 months prior to 14 December 2020, presence of any comorbidity that increase the risk of severe COVID-19, receipt of 2019/2020 and/or 2020/2021 influenza vaccination, and Census dissemination area-level quintiles of household income, proportion of persons employed as non-health essential workers, persons per dwelling, and proportion of self-identified visible minorities. Data are presented as effectiveness point estimates, with error bars indicating the corresponding 95% CIs. Solid circles indicate vaccine effectiveness estimated as 100% based on zero vaccinated test-positive cases. ### Sensitivity analyses In sensitivity analyses, vaccine effectiveness estimates using ≥21 days after the first dose and ≥14 days after the second dose were mostly very similar (estimates differed by ≤5%) to our primary analyses (Table 3). Where differences were >5%, the sensitivity analyses yielded higher estimates. Similar vaccine effectiveness estimates were also observed when limiting the study period to 05 April 2021 to 3 August 2021 (Supplementary Table 2). View this table: [Table 3:](http://medrxiv.org/content/early/2021/09/30/2021.06.28.21259420/T3) Table 3: Vaccine effectiveness against Alpha (B.1.1.7), Beta (B.1.351), Gamma (P.1), Beta/Gamma, and Delta (B.1.617.2) variants of concern by outcome, vaccine product, number of doses received, and time between most recent vaccination date and index date for those tested for SARS-CoV-2 between 14 December 2020 and 3 August 2021 in Ontario, Canada ### Vaccine effectiveness by age group In age group-stratified analyses, vaccine effectiveness against symptomatic infection caused by all VOCs was in most instances lower or similar in older adults (aged ≥60 years) compared to younger individuals (aged <60 years) after partial vaccination (Table 4). Vaccine effectiveness in older adults increased to levels comparable to younger individuals after the second dose, except against Gamma for BNT162b2 and against Delta for ChAdOx1. Vaccine effectiveness was higher against hospitalization and death than symptomatic infection for both older and younger adults. View this table: [Table 4.](http://medrxiv.org/content/early/2021/09/30/2021.06.28.21259420/T4) Table 4. Vaccine effectiveness against Alpha (B.1.1.7), Beta (B.1.351), Gamma (P.1), Beta/Gamma, and Delta (B.1.617.2) variants of concern by outcome, vaccine product, number of doses received, and age group for those tested for SARS-CoV-2 between 14 December 2020 and 3 August 2021 in Ontario, Canada ## Discussion We estimated that one dose of BNT162b2 and mRNA-1273 was >50% and >70% effective, respectively, against symptomatic infection caused by VOCs that have circulated to date in Ontario, Canada. One dose of ChAdOx1 prevented 41% of symptomatic infections by Gamma, and was >60% effective against Alpha and Delta. For all three vaccines, effectiveness increased (to >80% and, in most cases, >90%) following the second dose. Effectiveness of the first dose was substantially higher against hospitalization or death than against symptomatic infection for all VOC-vaccine combinations except for mRNA-1273 against Alpha and Gamma because vaccine effectiveness against symptomatic infection was already high; the second dose of mRNA vaccines further improved effectiveness against severe outcomes. We also found that assessing effectiveness ≥21 days after the first dose and ≥14 days after the second dose resulted in similar or higher estimates, restricting the analysis to a period when all VOCs were co-circulating yielded similar results, and the effectiveness of one dose tended to be lower for older adults compared to younger adults. Our vaccine effectiveness estimates against symptomatic COVID-19 infection with Alpha and Gamma after the first dose of mRNA or ChAdOx1 vaccines are similar to estimates against infection from British Columbia, Canada (67% for mRNA vaccines against Alpha and 61% against Gamma)15 and Qatar (88% for mRNA-1273 against Alpha)9 but higher than estimates after one dose against infection or symptomatic COVID-19 reported from Qatar (for BNT162b2, 30% against Alpha and 17% against Beta7; 61% for mRNA-1273 against Beta9), England (49% for BNT162b2 and 51% for ChAdOx1 against Alpha)10 and Scotland (27% for BNT162b2 and 39% for ChAdOx1 against Alpha)6. Our estimates after one dose are also higher than the estimates for BNT162b2 against severe, critical, or fatal disease in Qatar (54%)7, but comparable with the estimates for hospitalization in England (83%)8 caused by the Alpha variant with BNT162b2 or ChAdOx1 and for severe, critical, or fatal disease with mRNA-1273 caused by Alpha/Beta in Qatar (82%)9. We estimated higher vaccine effectiveness against symptomatic COVID-19 infection with the Delta variant after one dose of mRNA or ChAdOx1 vaccines than the effectiveness against symptomatic or asymptomatic infections reported from England and Scotland (30–33% for BNT162b2 and 18–33% for ChAdOx1)6,10. However, our effectiveness estimates against symptomatic infections with Delta after the first dose were lower than the estimates against infections in Qatar (64% for BNT162b2 and 79% for mRNA-1273)11. Our estimates after the second dose were higher than the estimates against symptomatic infections reported in England (88% for BNT162b2 and 67% for ChAdOx1)10, Scotland (83% for BNT162b2 and 61% for ChAdOx1)6, Israel (40.5% for BNT162b2)16, the USA (42% for BNT162b2 and 76% for mRNA-1273 against infection)17 and Qatar (53.5% for BNT162b2 and 84.8% for mRNA-1273 against infection)11. Against hospitalization with the Delta variant, our vaccine effectiveness after one dose was lower for BNT162b2 and higher for ChAdOx1 than the estimates from England (81% vs. 94% for BNT162b2 and 91% vs. 71% for ChAdOx1)8. Vaccine effectiveness against severe, critical and fatal COVID-19 disease with Delta after one dose of BNT162b2 and mRNA-1273 in Qatar was reported to be 100% because of zero vaccinated cases11. After the second dose, our estimates against both outcomes for all VOCs were higher than after one dose, and comparable with estimates reported in previous studies6-8,10. However, the vaccine effectiveness after two doses was reported to be lower than after one dose against any infection with Delta (54% vs. 64%) in Qatar, which the authors interpreted as waning of protection11. The heterogeneity in vaccine estimates, particularly after one dose, across studies could result from a number of factors, including differences in study design, study population, SARS-CoV-2 test assays and testing criteria, comprehensiveness of test results recorded in databases, outcome definitions and ascertainment, timing of VOC circulation, vaccine priority groups, vaccine rollout, interval between vaccine doses, and variables adjusted to control for possible confounding18. Province-wide data allowed us to estimate the effectiveness of all three vaccines used in Canada against symptomatic infection and severe outcomes caused by the four VOCs that have circulated in Canada thus far. The test-negative study design has the advantage to control for bias resulting from differences in healthcare-seeking behaviour between vaccinated and unvaccinated individuals19. There are some limitations of our study. First, VOC classification in this study relied on a combination of mutation screening and whole genome sequencing, and the criteria for sequencing evolved over time. Our definition of Delta specimens initially relied largely on a proxy measure of a N501Y-/E484K-result on mutation screening and a combination of date and geographic location, which were used to infer probable Delta variant specimens. Thus, a small proportion of specimens classified as Delta may have been non-VOC SARS-CoV-2 specimens. Second, since vaccine effectiveness is likely impacted by age, interval between vaccine doses, time between vaccine receipt and index date, vaccine product, and VOC, and given that the eligibility criteria for vaccination (e.g., initial prioritization of older age groups), availability of certain vaccine products, and distribution of circulating VOCs all varied over time, comparisons of vaccine effectiveness estimates between combinations of vaccine products and VOCs should be made with caution. However, we included a sensitivity analysis that restricted the study period to individuals tested during 5 April through 3 August 2021 (to ensure that all VOCs and non-VOC SARS-CoV-2 were circulating and to mitigate temporal confounding caused by the aforementioned factors), which yielded very similar results to our primary analysis. Third, it is possible that we may have under-ascertained severe outcomes if they were not recorded in the public health surveillance database used, such as when severe outcomes occurred after completion of case follow-up or when case volumes exceeded public health system capacity and public health investigation of each laboratory-confirmed case was not possible. This may have resulted in overestimation of vaccine effectiveness against severe outcomes. Fourth, we used specimen collection date as the index date because of lack of available data on symptom onset date in OLIS, which precluded us from restricting the study population to individuals who were tested within 10 days of symptom onset. Thus, we may have underestimated vaccine effectiveness by increasing the risk of false-negative cases by extending the interval between symptom onset and testing. Last, despite our best efforts to adjust for potential confounders and the use of the test-negative design, these results may nonetheless be susceptible to residual confounding given the observational nature of the study. In conclusion, our real-world vaccine effectiveness estimates suggest that even a single dose of these three COVID-19 vaccine products provide considerable protection against symptomatic infection and severe outcomes caused by these four VOCs, particularly for young adults, and that two doses provide even higher protection. While vaccine effectiveness estimates after two doses are presently most relevant to high-income countries with adequate vaccine supply and relatively higher two-dose vaccine coverage, effectiveness estimates after one dose remain relevant for low- and middle-income countries with suboptimal vaccine supply and low one- or two-dose vaccine coverage. Thus, our findings have public health policy implications worldwide. Jurisdictions facing COVID-19 vaccine supply constraints may benefit from delaying the second dose (at least for younger individuals) to maximize the number of individuals receiving partial protection from the first dose, thereby potentially providing greater overall protection of the population more rapidly. However, older adults would likely benefit most from minimizing the delay in receiving the second dose to achieve adequate protection against VOCs, including Delta, the predominant VOC currently in circulation worldwide. ## Methods We employed a test-negative design to compare vaccination status between test-positive individuals (with symptomatic infection or a severe outcome) and symptomatic but test-negative individuals19. We included community-dwelling Ontarians aged ≥16 years who had symptoms consistent with or a severe outcome attributable to COVID-19, and who were tested for SARS-CoV-2 between 14 December 2020 and 3 August 2021. We excluded individuals who had tested positive for SARS-CoV-2 prior to their selected index date and those who received Ad26.COV2.S (Janssen), because it has not been used in Ontario (despite receiving approval), or mixed (ChAdOx1-mRNA or different mRNA) vaccine schedules. ### Data sources and definitions Comprehensive province-wide datasets for SARS-CoV-2 laboratory testing, SARS-CoV-2 public health surveillance, COVID-19 vaccination, and healthcare system use were linked using unique encoded identifiers and analyzed at ICES (formerly the Institute for Clinical Evaluative Sciences). Details have been described previously20. #### Vaccination status We obtained information regarding COVID-19 vaccination status, including vaccine product, date of administration, and dose number, from COVaxON, a centralized COVID-19 vaccine information system in Ontario. #### COVID-19 testing and identification of variants Data on laboratory-confirmed SARS-CoV-2 infection detected by real-time reverse transcription polymerase chain reaction (RT-PCR) were collected from the Ontario Laboratories Information System (OLIS) for both individuals who tested positive (treated as cases) and individuals who tested negative (treated as controls). We used specimen collection date as the index date because symptom onset date was not consistently available in OLIS. We used the first positive test for cases, and a randomly selected negative test for controls with multiple negative tests during the study period. We obtained information on variants from the Public Health Case and Contact Management system (CCM), which contains results of screening tests for mutations and whole genome sequencing to assign SARS-CoV-2 lineage or variant of concern (VOC). All RT-PCR positive specimens with cycle threshold values ≤35 were screened for N501Y and E484K mutations by multiplex RT-PCR (VOC PCR)21. From 7 June 2021, specimens positive for both N501Y and E484K mutations were also screened for K417N and K417T mutations to differentiate specimens between Beta and Gamma variants21. At the beginning of 2021, whole genome sequencing was performed on specimens that had specific mutations detected by VOC PCR to confirm they were indeed VOCs. From 3 February 2021, specimens with the N501Y mutation, and from 22 March 2021, all specimens with the E484K mutation and 5% of E484K-negative specimens (all with cycle threshold values ≤30) were sequenced for surveillance purposes21,22. A subset of RT-PCR-positive specimens without any mutations detected by VOC PCR were also selected for sequencing for surveillance purposes21. Additionally, VOC PCR testing and sequencing were performed for specific indications such as recent travellers, partially or fully vaccinated individuals, cases of suspected reinfection, or to support investigations of outbreaks and potential super-spreading events23. Ontario started sequencing 10% and 50% of VOC PCR-screened specimens on 2 May 2021 and 30 May 2021, respectively. From 14 June 2021, Ontario started sequencing 100% of eligible VOC PCR-screened specimens21 that continued until the end of the study period before scaling back to sequencing 50% of specimens on 27 August 202122. In addition to those classified into SARS-CoV-2 lineages based on sequencing, we considered specimens positive for the N501Y mutation and negative for the E484K mutation (N501Y+/E484K-) as Alpha. Both Beta and Gamma have N501Y and E484K mutations, and can only be differentiated by additional screening for K417N and K417T mutations. Hence, we considered specimens positive for N501Y, E484K, and K417N mutations as Beta, and specimens positive for N501Y, E484K, and K417T as Gamma. We grouped the specimens that could not be separated into Beta and Gamma into a combined Beta/Gamma group. We classified specimens collected after 1 April 2021 that were negative for both N501Y and E484K (N501Y-/E484K-) mutations as either probable, possible, or unlikely Delta cases based on the predicted probability that it was Delta. To do this, we created a logistic regression model of the probability a N501Y-/E484K-case was Delta based on the date of specimen collection and the forward sortation area (geographical unit based on the first three characters of the postal code) ranked by the cumulative incidence of laboratory-confirmed SARS-CoV-2 cases between 23 January 2020 and 28 March 2021 and grouped into deciles24. For each decile, we examined the trajectories of the daily counts of N501Y-/E484K-specimens between 1 April 2021 and 30 May 2021 to estimate the predicted probability that a N501Y-/E484K-specimen represented Delta. We classified specimens with >75% probability of being a Delta case to be ‘probable Delta’ cases, those with 25-75% probability to be ‘possible Delta’ cases, and those with <25% probability to be ‘unlikely Delta’ cases. Our approach correlates well with sequencing results (n=538) for the province indicating a rapid increase in the proportion of N501Y-/E484K-cases being identified as Delta from mid-March to mid-May 202125. As of 31 May 2021, all N501Y-/E484K-specimens were considered Delta22. We grouped the probable Delta cases with those identified through sequencing. We classified specimens with no lineage information and N501Y-/E484K-specimens collected prior to 1 April 2021 as non-VOC SARS-CoV-2. We also grouped the ‘unlikely Delta’ cases with the non-VOC specimens. We excluded ‘possible Delta’ cases and N501Y-/E484K+ cases from our analyses. #### Outcomes For vaccine effectiveness against symptomatic infection, individuals who were symptomatic and tested positive for SARS-CoV-2 in OLIS were considered as cases. For severe outcomes, test-positive individuals who had a hospitalization or death up to 17 August 2021 (regardless of the presence of any symptoms recorded at the time of RT-PCR testing) were identified from CCM and considered as cases. Individuals who were symptomatic but only had tests negative for SARS-CoV-2 in OLIS were considered as controls for both outcomes. However, for severe outcomes, we excluded symptomatic test-negative individuals who later tested positive between 4 August 2021 and 17 August 2021. #### Covariates We obtained information on the following covariates from administrative databases: age and sex from the Ontario Registered Persons Database (RPDB); postal code and Public Health Unit of residence from the RPDB and Statistics Canada Postal Code Conversion File Plus (version 7B); the number of SARS-CoV-2 RT-PCR tests for each individual during the 3 months prior to 14 December (a proxy for individuals who are at increased risk of exposure to SARS-CoV-2 infection and undergo frequent testing), and biweekly (weekly for Delta) period of RT-PCR test to account for the temporal viral activity and regional vaccine roll-out created using testing information from OLIS; comorbidities26 associated with increased risk of severe COVID-19 identified from various databases using validated algorithms and commonly used diagnostic codes and algorithms described previously27, including Expanded Diagnostic Clusters and Special Population Markers from the Johns Hopkins ACG System (version 10)28; influenza vaccination status during the 2019/2020 and/or 2020/2021 influenza season (a proxy for health behaviours) determined from physician and pharmacist billing claims in the Ontario Health Insurance Plan and Ontario Drug Benefit databases, respectively; and neighbourhood-level information on median household income, proportion of the working population employed as non-health essential workers, average number of persons per dwelling, and proportion of the population who self-identify as a visible minority obtained from 2016 Census data. Details regarding these covariates are provided in Supplementary Table 320. ### Statistical analyses We used multivariable logistic regression models to estimate the odds ratio comparing the odds of vaccination in test-positive cases with the odds of vaccination among test-negative controls, adjusting for the aforementioned covariates that are associated with COVID-19 and vaccine uptake26,29,30. We calculated vaccine effectiveness using the following formula: Vaccine effectiveness = 1 – (odds ratio) x 100%. We estimated vaccine effectiveness against SARS-CoV-2 infection and severe COVID-19 outcomes (hospitalization or death) caused by non-VOC SARS-CoV-2, Alpha, Beta, Gamma, Beta/Gamma, and Delta separately by vaccine product (BNT162b2, mRNA-1273, and ChAdOx1) and number of doses received. For individuals who had received only one dose by the index date, we calculated vaccine effectiveness ≥14 days after the first dose. For individuals who had received two doses, we calculated vaccine effectiveness ≥7 days after the second dose. As a sensitivity analysis, and to facilitate comparisons with other studies, we also estimated vaccine effectiveness ≥21 days after the first dose and ≥14 days after the second dose. When estimating vaccine effectiveness against Beta, Gamma, Beta/Gamma and Delta, we restricted both test-positive cases and test-negative controls to those who were tested on/after the dates of initial confirmation of these variants in Ontario (11 January 2021 for Beta, Gamma, and Beta/Gamma; 5 April 2021 for Delta). Furthermore, since the primary periods of circulation for non-VOC SARS-CoV-2 and VOCs varied relative to the vaccination campaign (i.e., more non-VOC SARS-CoV-2 circulated earlier in the campaign when fewer individuals were vaccinated, whereas Delta circulated later when more were vaccinated), we conducted a sensitivity analysis restricted to individuals who were tested between 5 April 2021 and 3 August 2021 when non-VOC SARS-CoV-2 and VOCs were concurrently circulating, thereby accounting for differences in vaccine availability and coverage over time. Lastly, we estimated vaccine effectiveness stratified by age group (<60 years and ≥60 years). All analyses were conducted using SAS Version 9.4 (SAS Institute Inc., Cary, NC). All tests were two-sided and used p*<*0.05 as the level of statistical significance. We did not report estimates of vaccine effectiveness when 95% confidence intervals [CIs] were extremely imprecise (i.e., ranging between a very large negative number and nearly 100) or when vaccine effectiveness was estimated as 100% based on zero vaccinated test-positive cases and the 95% CIs were essentially infinite. ## Supporting information Supplementary material [[supplements/259420_file02.pdf]](pending:yes) ## Data Availability The dataset from this study is held securely in coded form at ICES. While legal data sharing agreements between ICES and data providers (e.g., healthcare organizations and government) prohibit ICES from making the dataset publicly available, access may be granted to those who meet pre-specified criteria for confidential access, available at [www.ices.on.ca/DAS](http://www.ices.on.ca/DAS) (email: das{at}ices.on.ca). The full dataset creation plan and underlying analytic code are available from the authors upon request, understanding that the computer programs may rely upon coding templates or macros that are unique to ICES and are therefore either inaccessible or may require modification. ## Correspondence and requests for materials should be addressed to J.C.K. ## Author contributions J.C.K. and H.C. designed and oversaw the study. S.N., S.H. and H.C. obtained the data and conducted all analyses (data set and variable creation and statistical modelling). B.C. contributed to data analyses and data preparation for the symptomatic data set. H.C. and S.H. verified the data in the study. S.N. did the literature search. S.N. and J.C.K. drafted the manuscript. All authors contributed to the analysis plan, interpreted the results, critically reviewed and edited the manuscript, approved the final version, and agreed to be accountable for all aspects of the work. ## Competing interests K.W. is CEO of CANImmunize and serves on the data safety board for the Medicago COVID-19 vaccine trial. The other authors declare no conflicts of interest. ## Funding This work was supported by the Canadian Immunization Research Network (CIRN) through a grant from the Public Health Agency of Canada and the Canadian Institutes of Health Research (CNF 151944). This project was also supported by funding from the Public Health Agency of Canada, through the Vaccine Surveillance Reference Group and the COVID-19 Immunity Task Force. This study was also supported by ICES, which is funded by an annual grant from the Ontario Ministry of Health (MOH). J.C.K. is supported by Clinician-Scientist Award from the University of Toronto Department of Family and Community Medicine. P.C.A. is supported by a Mid-Career Investigator Award from the Heart and Stroke Foundation. ## Ethics approval ICES is a prescribed entity under Ontario’s Personal Health Information Protection Act (PHIPA). Section 45 of PHIPA authorizes ICES to collect personal health information, without consent, for the purpose of analysis or compiling statistical information with respect to the management of, evaluation or monitoring of, the allocation of resources to or planning for all or part of the health system. Projects that use data collected by ICES under section 45 of PHIPA, and use no other data, are exempt from REB review. The use of the data in this project is authorized under section 45 and approved by ICES’ Privacy and Legal Office. ## Disclaimers This study was supported by ICES, which is funded by an annual grant from the Ontario Ministry of Health (MOH) and the Ministry of Long-Term Care (MLTC). This study was supported by the Ontario Health Data Platform (OHDP), a Province of Ontario initiative to support Ontario’s ongoing response to COVID-19 and its related impacts. The study sponsors did not participate in the design and conduct of the study; collection, management, analysis and interpretation of the data; preparation, review or approval of the manuscript; or the decision to submit the manuscript for publication. Parts of this material are based on data and/or information compiled and provided by the Canadian Institute for Health Information (CIHI) and by Cancer Care Ontario (CCO). However, the analyses, conclusions, opinions and statements expressed herein are solely those of the authors, and do not reflect those of the funding or data sources; no endorsement by ICES, MOH, MLTC, OHDP, its partners, the Province of Ontario, CIHI or CCO is intended or should be inferred. ## Acknowledgments We would like to acknowledge Public Health Ontario for access to case-level data from CCM and COVID-19 laboratory data, as well as assistance with data interpretation. We also thank the staff of Ontario’s public health units who are responsible for COVID-19 case and contact management and data collection within CCM. We thank IQVIA Solutions Canada Inc. for use of their Drug Information Database. The authors are grateful to the Ontario residents without whom this research would be impossible. ## Footnotes * Updated analyses using latest available data; updated manuscript and supplemental file. * Received June 28, 2021. * Revision received September 30, 2021. * Accepted September 30, 2021. * © 2021, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/) ## References 1. 1.World Health Organization. Weekly epidemiological update on COVID-19 2021 [cited 2021 June 18]. 43, published 8 June 2021:[Available from: [https://apps.who.int/iris/bitstream/handle/10665/341716/CoV-weekly-sitrep8Jun21-eng.pdf.pdf?sequence=1](https://apps.who.int/iris/bitstream/handle/10665/341716/CoV-weekly-sitrep8Jun21-eng.pdf.pdf?sequence=1) accessed June 18, 2021. 2. 2.World Health Organization. Weekly epidemiological update on COVID-19 2021 [cited 2021 September 29,]. 59, published 28 September 2021:[Available from: [https://www.who.int/publications/m/item/weekly-epidemiological-update-on-covid-19\---|28-september-2021](https://www.who.int/publications/m/item/weekly-epidemiological-update-on-covid-19\---|28-september-2021) accessed September 29, 2021. 3. 3.Emary KRW, Golubchik T, Aley PK, et al. Efficacy of ChAdOx1 nCoV-19 (AZD1222) vaccine against SARS-CoV-2 variant of concern 202012/01 (B.1.1.7): an exploratory analysis of a randomised controlled trial. The Lancet 2021;397(10282):1351–62. doi: 10.1016/S0140-6736(21)00628-0 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S0140-6736(21)00628-0&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=33798499&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2021.06.28.21259420.atom) 4. 4.Madhi SA, Baillie V, Cutland CL, et al. Efficacy of the ChAdOx1 nCoV-19 Covid-19 Vaccine against the B.1.351 Variant. New England Journal of Medicine 2021;384(20):1885–98. doi: 10.1056/NEJMoa2102214 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa2102214&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=33725432&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2021.06.28.21259420.atom) 5. 5.Thomas SJ, Moreira ED, Kitchin N, et al. Safety and Efficacy of the BNT162b2 mRNA Covid-19 Vaccine through 6 Months. New England Journal of Medicine 2021 doi: 10.1056/NEJMoa2110345 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa2110345&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=34525277&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2021.06.28.21259420.atom) 6. 6.Sheikh A, McMenamin J, Taylor B, et al. SARS-CoV-2 Delta VOC in Scotland: demographics, risk of hospital admission, and vaccine effectiveness. The Lancet doi: 10.1016/S0140-6736(21)01358-1 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S0140-6736(21)01358-1&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=34139198&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2021.06.28.21259420.atom) 7. 7.Abu-Raddad LJ, Chemaitelly H, Butt AA. Effectiveness of the BNT162b2 Covid-19 Vaccine against the B.1.1.7 and B.1.351 Variants. N Engl J Med 2021 doi: 10.1056/NEJMc2104974 [published Online First: 2021/05/06] [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMc2104974&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=33951357&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2021.06.28.21259420.atom) 8. 8.Stowe J, Andrews N, Gower C, et al. Effectiveness of COVID-19 vaccines against hospital admission with the Delta (B.1.617.2) variant: Preprint; 2021 [Available from: [https://media.tghn.org/articles/Effectiveness\_of\_COVID-19\_vaccines\_against\_hospital\_admission\_with\_the\_Delta\_B.\_G6gnnqJ.pdf](https://media.tghn.org/articles/Effectiveness\_of\_COVID-19\_vaccines\_against\_hospital\_admission\_with\_the_Delta_B._G6gnnqJ.pdf) 9. 9.Chemaitelly H, Yassine HM, Benslimane FM, et al. mRNA-1273 COVID-19 vaccine effectiveness against the B.1.1.7 and B.1.351 variants and severe COVID-19 disease in Qatar. Nature Medicine 2021 doi: 10.1038/s41591-021-01446-y [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41591-021-01446-y&link_type=DOI) 10. 10.Lopez Bernal J, Andrews N, Gower C, et al. Effectiveness of Covid-19 Vaccines against the B.1.617.2 (Delta) Variant. N Engl J Med 2021;385(7):585–94. doi: 10.1056/NEJMoa2108891 [published Online First: 2021/07/22] [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa2108891&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=34289274&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2021.06.28.21259420.atom) 11. 11.Tang P, Hasan MR, Chemaitelly H, et al. BNT162b2 and mRNA-1273 COVID-19 vaccine effectiveness against the Delta (B.1.617.2) variant in Qatar. medRxiv 2021:2021.08.11.21261885. doi: 10.1101/2021.08.11.21261885 [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoibWVkcnhpdiI7czo1OiJyZXNpZCI7czoyMToiMjAyMS4wOC4xMS4yMTI2MTg4NXYxIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDkvMzAvMjAyMS4wNi4yOC4yMTI1OTQyMC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 12. 12.Ontario Ministry of Health. Ontario’s COVID-19 vaccination plan: Queen’s Printer for Ontario; 2021 [Available from: [https://covid-19.ontario.ca/ontarios-covid-19-vaccination-plan](https://covid-19.ontario.ca/ontarios-covid-19-vaccination-plan) accessed 14 June 2021. 13. 13.Ontario Proceeding with Second Dose Administration of AstraZeneca: Queen’s Printer for Ontario, 2012-2021; 2021 [Available from: [https://news.ontario.ca/en/release/1000174/ontario-proceeding-with-second-dose-administration-of-astrazeneca#quickfacts](https://news.ontario.ca/en/release/1000174/ontario-proceeding-with-second-dose-administration-of-astrazeneca#quickfacts) accessed 23 May, 2021. 14. 14.Ontario Agency for Health Protection and Promotion (Public Health Ontario). Epidemiologic summary: COVID-19 in Ontario – January 15, 2020 to September 22, 2021 Toronto, ON: Queen’s Printer for Ontario; 2021 [Available from: [https://www.publichealthontario.ca/-/media/documents/ncov/epi/covid-19-daily-epi-summary-report.pdf?la=en](https://www.publichealthontario.ca/-/media/documents/ncov/epi/covid-19-daily-epi-summary-report.pdf?la=en) accessed 23 September, 2021. 15. 15.Skowronski DM, Setayeshgar S, Zou M, et al. Single-dose mRNA vaccine effectiveness against SARS-CoV-2, including Alpha and Gamma variants: a test-negative design in adults 70 years and older in British Columbia, Canada. Clin Infect Dis 2021 doi: 10.1093/cid/ciab616 [published Online First: 2021/07/11] [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1093/cid/ciab616&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=34244723&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2021.06.28.21259420.atom) 16. 16.Israel’s Ministry of Health. COVID-19 vaccine effectiveness against the Delta variant. Israel’s Ministry of Health report 2021 [Available from: [https://www.gov.il/BlobFolder/reports/vaccine-efficacy-safety-follow-up-committee/he/files\_publications\_corona\_two-dose-vaccination-data.pdf](https://www.gov.il/BlobFolder/reports/vaccine-efficacy-safety-follow-up-committee/he/files_publications_corona_two-dose-vaccination-data.pdf) accessed 21 August 2021. 17. 17.Puranik A, Lenehan PJ, Silvert E, et al. Comparison of two highly-effective mRNA vaccines for COVID-19 during periods of Alpha and Delta variant prevalence. medRxiv 2021:2021.08.06.21261707. doi: 10.1101/2021.08.06.21261707 [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoibWVkcnhpdiI7czo1OiJyZXNpZCI7czoyMToiMjAyMS4wOC4wNi4yMTI2MTcwN3YzIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDkvMzAvMjAyMS4wNi4yOC4yMTI1OTQyMC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 18. 18.World Health Organization. Evaluation of COVID-19 vaccine effectiveness: Interim Guidance, 17 March 2021: World Health Organization; 2021 [Available from: [https://apps.who.int/iris/rest/bitstreams/1337417/retrieve](https://apps.who.int/iris/rest/bitstreams/1337417/retrieve) accessed 28 March 2021. 19. 19.Jackson ML, Nelson JC. The test-negative design for estimating influenza vaccine effectiveness. Vaccine 2013;31(17):2165–8. doi: 10.1016/j.vaccine.2013.02.053 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.vaccine.2013.02.053&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23499601&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2021.06.28.21259420.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000318329400010&link_type=ISI) 20. 20.Chung H, He S, Nasreen S, et al. Effectiveness of BNT162b2 and mRNA-1273 covid-19 vaccines against symptomatic SARS-CoV-2 infection and severe covid-19 outcomes in Ontario, Canada: test negative design study. BMJ 2021;374:n1943. doi: 10.1136/bmj.n1943 [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE4OiIzNzQvYXVnMjBfMjUvbjE5NDMiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8wOS8zMC8yMDIxLjA2LjI4LjIxMjU5NDIwLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 21. 21.Ontario Agency for Health Protection and Promotion (Public Health Ontario). SARS-CoV-2 (COVID-19 virus) variant of concern (VoC) surveillance [Internet] Toronto, ON: Queen’s Printer for Ontario; 2021 [Available from: [https://www.publichealthontario.ca/en/laboratory-services/test-information-index/covid-19-voc](https://www.publichealthontario.ca/en/laboratory-services/test-information-index/covid-19-voc) accessed 25 March 2021. 22. 22.Ontario Agency for Health Protection and Promotion (Public Health Ontario). Epidemiologic summary: SARS-CoV-2 whole genome sequencing in Ontario, September 21, 2021 Toronto, ON: Queen’s Printer for Ontario; 2021 [Available from: [https://www.publichealthontario.ca/-/media/documents/ncov/epi/covid-19-sars-cov2-whole-genome-sequencing-epi-summary.pdf?sc_lang=en](https://www.publichealthontario.ca/-/media/documents/ncov/epi/covid-19-sars-cov2-whole-genome-sequencing-epi-summary.pdf?sc_lang=en) accessed, 27 September 2021. 23. 23.Ontario Agency for Health Protection and Promotion (Public Health Ontario). SARS-CoV-2 Variant of Concern Testing/Whole Genome Sequencing Public Health Ontario Laboratory Information Form 2021 [Available from: [https://www.publichealthontario.ca/-/media/documents/lab/sars-cov-2-voc-screening-request-form.pdf?la=en](https://www.publichealthontario.ca/-/media/documents/lab/sars-cov-2-voc-screening-request-form.pdf?la=en) accessed 21 June 2021. 24. 24.Brown KA, Stall NM, Joh E, et al. A Strategy for the Mass Distribution of COVID19 Vaccines in Ontario Based on Age and Neighbourhood. Science Briefs of the Ontario COVID-19 Science Advisory Table 2021;2(10) doi: [https://doi.org/10.47326/ocsat.2021.02.10.1.0](https://doi.org/10.47326/ocsat.2021.02.10.1.0) 25. 25.Brown KA, Joh E, Buchan SA, et al. Inflection in prevalence of SARS-CoV-2 infections missing the N501Y mutation as a marker of rapid Delta (B.1.617.2) lineage expansion in Ontario, Canada. medRxiv 2021:2021.06.22.21259349. doi: 10.1101/2021.06.22.21259349 [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoibWVkcnhpdiI7czo1OiJyZXNpZCI7czoyMToiMjAyMS4wNi4yMi4yMTI1OTM0OXYxIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjEvMDkvMzAvMjAyMS4wNi4yOC4yMTI1OTQyMC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 26. 26.Centers for Disease Control and Prevention (CDC). Underlying Medical Conditions Associated with High Risk for Severe COVID-19: Information for Healthcare Providers 2021 [Available from: [https://www.cdc.gov/coronavirus/2019-ncov/hcp/clinical-care/underlyingconditions.html](https://www.cdc.gov/coronavirus/2019-ncov/hcp/clinical-care/underlyingconditions.html) accessed 12 April 2021 2021. 27. 27.Kwong JC, Buchan SA, Chung H, et al. Can routinely collected laboratory and health administrative data be used to assess influenza vaccine effectiveness? Assessing the validity of the Flu and Other Respiratory Viruses Research (FOREVER) Cohort. Vaccine 2019;37(31):4392–400. doi: 10.1016/j.vaccine.2019.06.011 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.vaccine.2019.06.011&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=31221563&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2021%2F09%2F30%2F2021.06.28.21259420.atom) 28. 28.The Johns Hopkins ACG system. Baltimore: Johns Hopkins University; [Available from: [http://www.hopkinsacg.org/](http://www.hopkinsacg.org/) accessed 14 July 2021. 29. 29.National Advisory Committee on Immunization (NACI). Guidance on the prioritization of key populations for COVID-19 immunization 2021 [updated February 2, 2021. Available from: [https://www.canada.ca/en/public-health/services/immunization/national-advisory-committee-on-immunization-naci/guidance-prioritization-key-populations-covid-19-vaccination.html](https://www.canada.ca/en/public-health/services/immunization/national-advisory-committee-on-immunization-naci/guidance-prioritization-key-populations-covid-19-vaccination.html) accessed May 3 2021. 30. 30.Sundaram ME, Calzavara A, Mishra S, et al. Individual and social determinants of SARS-CoV-2 testing and positivity in Ontario, Canada: a population-wide study. CMAJ 2021;193(20):E723. doi: 10.1503/cmaj.202608 [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiY21haiI7czo1OiJyZXNpZCI7czoxMToiMTkzLzIwL0U3MjMiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMS8wOS8zMC8yMDIxLjA2LjI4LjIxMjU5NDIwLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==)