Abstract
Objectives To estimate the effectiveness of the CoronaVac COVID-19 vaccine in a setting of SARS-CoV-2 P.1 variant transmission.
Design Matched test-negative case-control study to estimate the effectiveness of an inactivated vaccine, CoronaVac, with an early analysis of effectiveness following administration at least one vaccine dose and an analysis of effectiveness following administration of the complete two dose schedule.
Setting Cohort of healthcare workers (HCWs) in Manaus, where P.1 accounted for 75% of genotyped SARS-CoV-2 samples at the peak of its epidemic.
Participants For the early at-least-one-dose analysis, 53,176 HCWs residing in Manaus and aged 18 years or older, with complete information on age, residence, and vaccination status. For the two-dose analysis, 53,153 HCWs residing in Manaus and aged 18 years or older, with complete information on age, residence, and vaccination status.
Main outcome measures The primary outcome was symptomatic SARS-CoV-2 infection.
Results Among 53,153 HCWs eligible for the two-dose analysis, 47,170 (89%) received at least one dose of CoronaVac and 2,656 individuals (5%) underwent RT-PCR testing from 19 January, 2021 to 13 April, 2021. Of 3,195 RT-PCR tests, 885 (28%) were positive. 393 and 418 case-control pairs were selected for the early and two-dose analyses, respectively, matched on calendar time, age, and neighbourhood. In the early analysis, vaccination with at least one dose was associated with a 0.50-fold reduction (adjusted vaccine effectiveness, 49.6%, 95% CI 11.3 to 71.4) in the odds of symptomatic SARS-CoV-2 infection during the period 14 days or more after receiving the first dose. However, we estimated low effectiveness (adjusted VE 36.8%, 95% CI −54.9 to 74.2) of the two-dose schedule against symptomatic SARS-CoV-2 infection during the period 14 days or more after receiving the second dose. A finding that vaccinated individuals were much more likely to be infected than unvaccinated individuals in the period 0-13 days after first vaccination (aOR 2.11, 95% CI 1.36-3.27) suggests that among this population of healthcare workers, those at higher risk might take up vaccine earlier, leading to underestimation of its effectiveness.
Conclusions Evidence from this test-negative study of the effectiveness of CoronaVac was mixed, and likely affected by bias in this setting. Administration of at least one vaccine dose showed effectiveness against symptomatic SARS-CoV-2 infection in the setting of epidemic P.1 transmission. However, the low estimated effectiveness of the two-dose schedule underscores the need to maintain non-pharmaceutical interventions while vaccination campaigns with CoronaVac are being implemented.
What is already known on this topic
Early studies have found plasma from convalescent COVID-19 patients and sera from vaccinated individuals have reduced neutralising activity against the SARS-CoV-2 variant, P.1, compared with strains isolated earlier in the pandemic. Pfizer BNT162b2 mRNA and Oxford-AstraZeneca ChAdOx1 are the only vaccines for which such data has been published to date.
None of the published studies reported data on neutralisation of P.1 by sera from individuals who received the inactivated COVID-19 vaccine, CoronaVac.
No studies reported effectiveness of any vaccine on reducing the risk of infection or disease among individuals exposed to P.1 or in settings of high P.1 transmission.
What this study adds
This study finds that vaccination with CoronaVac was 49.6% (95% CI 11.3 to 71.4) effective at preventing COVID-19 in a setting with likely high prevalence of P.1, a SARS-CoV-2 Variant of Concern.
However, an analysis of effectiveness by dose was underpowered and failed to find significant effectiveness of the two-dose schedule of CoronaVac (estimated VE 36.8%, 95% CI −54.9 to 74.2).
These findings are suggestive but must be strengthened by observational studies in other settings.
Based on this evidence, there is a need to implement sustained non-pharmaceutical interventions even as vaccination campaigns continue.
Introduction
The P.1 variant of severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) emerged in Manaus, Brazil, in December 20201–3 and has since spread globally to 37 countries as of 20 April, 2021.4 The World Health Organisation declared P.1 as a Variant of Concern5 given the evidence for its increased transmissibility3 and mutations shared with other variants of concern. Brazil has recently experienced a COVID-19 resurgence, during which 6,453,057 cases and 151,467 deaths were reported between 1 December 2020 and 31 March 2021.6 A critical question is whether available vaccines in Brazil and South America are effective against COVID-19 in the context of P.1 transmission.
Concerns have been raised that available vaccines have reduced immunogenicity against P.1. The variant has three mutations, K417N, E484K and N501Y, in the ACE2 binding site of the SARS-CoV-2 S1 protein which have been speculated to promote immune escape.3 In vitro studies have found decreased sero-neutralisation of P.1 in individuals infected with non-P.1 strains and vaccinated individuals.7–11 However, evidence is lacking on whether available vaccines are effective against clinical and infection outcomes associated with P.1 and in settings of P.1 transmission in Brazil and beyond.
As part of its vaccination campaign, Brazil has administered CoronaVac, an inactivated vaccine.12–14 CoronaVac was found to have an efficacy of 50% and 84% against, respectively, COVID-19 and COVID-19 requiring medical assistance in a randomised controlled trial (RCT) in healthcare workers conducted in Brazil prior to the emergence of P.1.14 However, the effectiveness of CoronaVac in the real-world setting and in regions of P.1 transmission is unknown. We performed a test-negative case-control study15,16 on the effectiveness of CoronaVac in healthcare workers (HCWs) from Manaus, which was among the first cities in Brazil to aggressively implement vaccination. Herein, we report early findings on the effectiveness of administering at least one dose of the two-dose schedule, in response to the need to evaluate current vaccination efforts as they are being widely implemented, and a subsequent analysis of effectiveness of the complete two-dose schedule.
Methods
Study setting
Manaus is a city with 2.2 million inhabitants in the Amazon Basin of Brazil.17 Manaus is an important economic centre in the North of Brazil, with a human development index of 0.737 and high income inequality (Gini index, 0.634).18 As of 2 April, 2021, 160,803 cases (cumulative incidence, 7,367 per 100,000 population) and 8,432 COVID-19 associated deaths (cumulative mortality, 386 per 100,000 population) were reported in Manaus during the course of an initial epidemic in March 2020 and a second larger epidemic in late November 2020 (Supplementary Figure 1, Figure 1).19 Reported incidence likely represents an underestimate of true incidence due to lack of access to testing, and cumulative incidence in Manaus has been estimated to be significantly higher than reported.20,21 The second epidemic was associated with the emergence and spread of P.1,1–3 which accounted for 75% (657 of 877) of SARS-CoV-2 samples genotyped as part of surveillance during the peak of the epidemic in January 2021 (Supplementary Figure 2).2 The Municipal Secretary of Health of Manaus (SEMSA) initiated vaccination with CoronaVac and Oxford-AstraZeneca (ChAdOx1) on 19 January 2021; CoronaVac has been used in >97% of the vaccinations of HCWs (Figure 1).
HCWs generally had more access to testing than the general population, regardless of symptoms. We evaluated all HCWs in Manaus, including those in hospitals, primary care, general, and specialized units. Testing availability was heterogeneous across settings and location. There was no specific testing or screening policy in place for HCWs, and asymptomatic individuals being tested could arise from contact tracing or voluntary screening. Initially, vaccination of HCWs was stratified by risk of SARS-CoV-2 infection because of the scarcity of vaccines; the priority order was HCWs working in the ICU, ER, COVID-19 wards, and finally administrative staff.
Study design
We conducted a retrospective, test-negative, matched case-control study to estimate the effectiveness of CoronaVac in reducing the odds of primary and secondary outcomes of, respectively, symptomatic and all RT-PCR-confirmed SARS-CoV-2 infections. The study population was HCWs who had a residential address in Manaus, aged ≥ 18 years on 19 January, 2021, and with complete information, which was consistent between data sources, on age, sex, neighbourhood (bairro) of residence, and vaccination status and dates (Figure 2).
To ensure timely communication of results with potential public health benefit, we planned an analysis assessing the effectiveness of receiving at least one dose. For this early analysis, we selected cases and matched controls who had a positive and negative SARS-CoV-2 RT-PCR test result, respectively, during the study period of 19 January to 25 March, 2021. In addition, we planned an analysis of effectiveness of the two-dose schedule, for which the study period was extended to 13 April, 2021.
The study design and statistical analysis plan were specified in advance of extracting information from data sources and are described in a publicly available protocol (https://github.com/juliocroda/VebraCOVID-19) and the supplementary file. The study was approved by the Ethical Committee for Research of Federal University of Mato Grosso do Sul (CAAE: 43289221.5.0000.0021).
Data sources
We identified the study population from the SEMSA registry of employed HCWs in Manaus (Figure 2). For the purpose of extracting information for study population eligibility, case and control section, matching criteria, secondary outcomes and covariates, we integrated data from the following sources: the national laboratory testing registry (“GAL”); the national registry of users of the universal health system(“CadSUS”); the national surveillance system of suspected COVID-19 cases (“e-SUS”); the national surveillance database of severe acute respiratory illnesses (“SIVEP-Gripe”); and the SEMSA COVID-19 vaccination registry. These are surveillance systems for the whole country and notification is compulsory. The early analysis and two-dose analysis were implemented with data that were accessed on 1 April and 20 April, 2021 respectively, and censored after 25 March and 13 April, 2021 to account for reporting delays.
Selection of cases and matched controls
Cases were selected from the study population who had a SARS-CoV-2 infection, defined as a positive SARS-CoV-2 RT-PCR test result from a respiratory sample that was collected during the study period and the absence of a positive test in the preceding 90-day period. Controls were selected from the study population who did not have a SARS-CoV-2 infection, defined as a negative SARS-CoV-2 test result from a respiratory sample that was collected during the study period and the absence of a positive test in the preceding 90-day period and subsequent 14-day period. For both cases and controls, we excluded PCR tests that were performed after the individual received any dose of ChAdOx1, as this study was limited to assessment of the effectiveness of CoronaVac.
We matched one test-negative control to each case according to symptomatic illness status at time of testing; a time window of ±3 days between the case sample collection date; age category defined as <30, ≥30 and <60, and ≥60 years; and neighbourhood of residence. Symptomatic illness was defined as the presence of one or more reported COVID-19 related symptom22 with an onset within 0-10 days before the date of sample collection. We chose the matching factors that were predictors of vaccination and SARS-CoV-2 infection (Supplementary Figures 3-6). Due to the limited study size, we chose a small set of matching factors to balance the ability to reduce bias and to enrol sufficient case-control pairs to achieve desired power. We chose to categorize age as <30,30-60, and ≥60 years because the proportion of RT-PCR tests that were positive appeared to be consistent within these age bands, reflecting a similar risk for infection in this group, albeit possibly differential healthcare utilization (Supplementary Figure 3). Upon identification of each case, a control was selected at random from a list of eligible matching controls, such that each eligible control was matched to at most one case.
Statistical analysis
For the early analysis, we defined vaccination as having received at least one dose of the two-dose CoronaVac schedule, with the first dose administered ≥14 days before the sample collection date for their RT-PCR test. We pre-specified the early analysis of the effectiveness of at least one dose in the study protocol and used the O’Brien Fleming alpha-spending method to calculate an adjusted critical p-value of 0.0492.23 For the planned analysis of effectiveness after two doses, we defined vaccination in three categories: having received a single dose administered ≥14 days before the sample collection date for their RT-PCR test; having received two doses, with the second dose administered 0-13 days before the sample collection date for their RT-PCR test; and having received two doses, with the second dose administered ≥14 days before the sample collection date for their RT-PCR test. The reference group for vaccination status was individuals who had not received a first vaccine dose by the date of sample collection.
Finally, we evaluated the exposure of receiving the first vaccine dose from 0 to 13 days before the sample collection date, a period where the vaccine likely has no or limited effectiveness.12,13 A non-null association between this exposure and SARS-CoV-2 infection risk compared to those who had not received a first vaccine dose by the date of sample collection may serve as an indicator of unmeasured confounding.
Analyses of the primary outcome of symptomatic SARS-CoV-2 infection included case-control pairs who had symptomatic illness 0-10 days before the time of testing. Analyses of the secondary outcome of any SARS-CoV-2 infection included additional case-control pairs who did not have symptomatic illness before or at the time of testing.
We used conditional logistic regression to estimate the odds ratio (OR) of vaccination among cases and controls. 1-OR provided an estimate of vaccine effectiveness under the assumptions of a test-negative design.24 We included as covariates in the adjusted model: age as a continuous variable, sex, occupation category, self-reported race/skin colour, number of previous healthcare interactions from the beginning of the pandemic (March 2020) to the start of the study, and a SARS-CoV-2 infection, defined as a positive RT-PCR or antigen detection test, from the beginning of the pandemic (March 2020) to the start of the study period. A missing indicator was incorporated to address missing information on occupation category or race. We adjusted for the possible effect of COVID-19-associated comorbidities25 in a separate sensitivity analysis due differential completeness for this covariate between cases and controls.
Power calculation and timing of analyses
After generating matched case-control pairs for each pre-specified analysis and before performing the analysis, we simulated the power of the data set to identify a given vaccine effectiveness (see the Supplementary File, p5 for details). After extracting the surveillance databases on 1 April, 2021, we determined that the power of the early analysis to identify a vaccine effectiveness of 60% of at least one dose was 92.7%. On 20 April, 2021, we determined that the power of the two-dose analysis to identify a vaccine effectiveness of 70% comparing those with two doses ≥14 days after the second dose to those who had not received a vaccine was 80.0%.
All analyses were done in R, version 4.0.2.
Role of the funding source
All funders of the study had no role in study design, data collection, data analysis, data interpretation, or writing of the report. The Health Surveillance Foundation of the State of Amazonas and SEMSA reviewed the data from the study, but the academic authors retained editorial control. MDTH, OTR, MSST, SO, and JC had full access to de-identified data in the study and MDTH and OTR verified the data, and all authors approved the final version of the manuscript for publication.
Results
Second COVID-19 epidemic and vaccination campaign among HCWs in Manaus
Among 67,718 HCWs that were employed in the city’s healthcare facilities and linked to surveillance databases (Figure 2), 3,445 cases of SARS-CoV-2 infection were reported from 1 October 2020 to 13 April 2021 (Figure 1). Among the 3,445 cases, 2,559 and 886 were associated with and without, respectively, COVID-19 symptoms. The municipal vaccination campaign was initiated on 19 January, 2021 and as of 13 April, 2021, has administered first and second vaccine doses to 55,584 (82%) and 50,029 (74%), respectively, of the 67,718 HCWs.
Study population for the early at-least-one-dose analysis
Among the 67,718 HCWs, 53,176 were eligible for inclusion in the early analysis (Figure 2). Of the 53,176 HCWs, 1,752 and 904 received RT-PCR testing during the study period of 19 January to 25 March, 2021 who respectively, did or did not report a symptomatic illness at the time of testing. Among the 1,823 and 974 tests performed for HCWs with and without symptomatic illness, respectively, 564 (31% of 1,823) and 212 (22% of 974), respectively, were positive. Through matching, we selected 780 HCWs with 786 RT-PCR tests to establish 393 case-control pairs with symptomatic illness and 266 HCWs with 270 RT-PCR tests to establish 135 pairs without symptomatic illness.
Study population for the two-dose analysis
Among the 67,718 HCWs, 53,153 were eligible for inclusion in the two-dose analysis (Figure 2). Of the 53,153 HCWs, 1,907 and 1,038 individuals received RT-PCR testing during the study period of 19 January to 13 April, 2021 who respectively, did or did not report a symptomatic illness at the time of testing. Among the 1,985 and 1,116 tests performed for HCWs with and without symptomatic illness, respectively, 590 (30%) and 218 (20%), respectively, were positive. Through matching, we selected 829 HCWs with 836 RT-PCR tests to establish 418 case-control pairs with symptomatic illness and 272 HCWs with 276 RT-PCR tests to establish 138 pairs without symptomatic illness. The characteristics of HCWs selected and not selected is shown in Supplementary Table 1, the timing of pair enrolment during the study period is shown in Supplementary Figure 7 (early analysis) and Supplementary Figure 8 (two-dose analysis), and the distribution of discordant pairs is shown in Supplementary Table 2 (early analysis) and Supplementary Table 3 (two-dose analysis).
Table 1 shows the distribution of characteristics between symptomatic cases and controls selected for the early analysis (left) and two-dose analysis (right). The proportion of females was lower among the cases. The proportion who had a positive SARS-CoV-2 RT-PCR or antigen test prior to the study period was small, but higher among controls than cases in pairs with symptomatic illness and without symptomatic illness (3.1 vs 6.9% and 0.7 vs 13.8%, respectively). These differences suggest potential for confounding in the unadjusted analysis. Of the 556 cases in the two-dose analysis, 10.6% (59) required hospitalisation for their SARS-CoV-2 infection. P.1 was identified in SARS-CoV-2 samples from four of five cases for which genotyping information was available (data not shown). Among those who had received at least one dose of vaccine before the RT-PCR sample collection date, the average time from 1st dose to sample collection date was 13 days (IQR 7-26) among cases and 17 days (IQR 8-28) among controls (Supplementary Figure 9). Supplementary Table 4 shows the distribution of characteristics between cases and controls without symptomatic illness at the time of testing.
Early at-least-one-dose analysis
After adjusting, vaccination with at least one CoronaVac dose was associated with a 0.50-fold reduction (adjusted VE, 49.6%, 95% CI 11.3 to 71.4) in the odds of symptomatic SARS-CoV-2 infection during the period 14 days or more after receiving the first dose (Table 2). Of note, the odds of symptomatic SARS-CoV-2 infection was increased (aOR 1.69, 95% CI 1.09 to 2.64) amongst vaccinated HCWs in the period 0-13 days after receiving the first vaccine dose when compared with HCWs who did not receive the vaccine. Female sex (aOR 0.50, 95% CI 0.38 to 0.81) and a positive SARS-CoV-2 RT-PCR or antigen test in the pre-study period (aOR 0.38, 95% CI 0.17 to 0.87) were associated with a reduced odds of symptomatic SARS-CoV-2 infection. Estimated vaccine effectiveness of at least one dose against all SARS-CoV-2 infection during the period 14 days or more after receiving the first dose was 35.1% (95% CI −6.6 to 60.5) (Supplementary Table 5).
Two-dose analysis
Upon accruing more case-control pairs, we performed an analysis of vaccine effectiveness by dose. After adjusting, vaccination with two doses of CoronaVac was not associated (adjusted VE 36.8%, 95% CI −54.9 to 74.2) with a reduction in the odds of symptomatic SARS-CoV-2 infection during the period 14 days or more after receiving the second dose. As in the early analysis, vaccination 0-13 days before sample collection was associated with increased odds of symptomatic SARS-CoV-2 infection, while female sex and prior positive SARS-CoV-2 viral test were associated with reduced odds of symptomatic SARS-CoV-2 infection (Table 2). Estimated vaccine effectiveness of two doses against all SARS-CoV-2 infection during the period 14 days or more after receiving the second dose was 37.9% (95% CI −46.4 to 73.6) (Supplementary Table 5).
For primary and secondary outcomes, estimates for vaccine effectiveness and significant covariates were similar when adjusting for presence of one or more underlying comorbidities (Supplementary Table 6). In a sensitivity analysis excluding pairs where either individual had a previous positive SARS-CoV-2 test, we estimated effectiveness of two doses to be 56.2% (95% CI −23.0 to 84.4).
Discussion
Here, we provide suggestive but inconclusive evidence for the effectiveness of CoronaVac in the setting of widespread P.1 transmission. An RCT of CoronaVac in Brazil14 reported efficacy of 50.7% (95% CI 35.6 to 62.2), 83.7% (95% CI 58.0 to 93.7) and 100% (95% CI 56.4 to 100) against, respectively, symptomatic COVID-19, symptomatic COVID-19 requiring medical assistance, and hospitalised COVID-19 (scores ≥2, ≥3, and ≥4 on the WHO Clinical Progression Scale).26 An RCT from Turkey provided consistent evidence for the efficacy of this vaccine.27 However, these trials were conducted prior to the emergence of P.1. Evidence is needed from observational studies conducted in Brazil and other countries where the P.1 or other variant lineages are circulating.
In an effort to translate results of public health importance as early as possible, we performed a planned analysis of vaccine effectiveness following at least one dose and reported estimated effectiveness of 49.6% (95% CI 11.3 to 71.4) against symptomatic COVID-19, starting 14 days after administration of the first dose, in healthcare workers from Manaus. However, a planned subsequent analysis of effectiveness by dose failed to show strong effectiveness of two doses, with estimated effectiveness of 36.8% (95% CI −54.9 to 74.2). Although the early results are promising, the evidence from this study is mixed and studies in other settings are required to assess the real-world effectiveness of CoronaVac and support the efficacy shown in RCTs. In addition, we were unable to assess effectiveness against severe COVID-19 due to limited information on details of symptoms.
Our analysis of effectiveness by dose was limited in two key ways. SARS-CoV-2 seroprevalence in Manaus was likely high prior to the vaccination campaign.20,21 Prior natural infection may have conferred protection to unvaccinated individuals, which in turn may lead to underestimation of the VE estimate among seronegative individuals. If vaccine uptake were lower among those previously infected, this would exacerbate such a downward bias. The proportion with a previous positive RT-PCR or antigen test was in fact slightly higher among vaccinated individuals (5.3% vs. 3.6%), possibly representing higher access to healthcare. Due to the limited access to RT-PCR and antigen detection testing in the city, this variable does not fully control for this source of confounding, nor did we have sufficient power to explore the effect modification of vaccine effectiveness by previous infection. A sensitivity analysis suggested higher vaccine effectiveness among individuals without evidence of a previous infection, although the precision remained low.
The precision of the analysis of effectiveness of the two-dose schedule was low. We had powered this analysis to detect effectiveness of 70% after two doses, but it may be that true effectiveness is lower in this population. Several studies found that vaccination in individuals with a previous infection elicits a strong and rapid immune response,28,29 as well as cross-neutralizing antibody response to P.1.8 Overall immunogenicity following a single dose in this population may thus be higher than in a low-seroprevalence population. Conversely, the effectiveness of the second dose relative to the first dose may be similar.
We could not directly address whether CoronaVac was effective against P.1 as SARS-CoV-2 samples from HCW cases were not routinely genotyped. However, the study was conducted at the epicentre for P.1 emergence and during an epidemic when surveillance of the general population identified the variant in 75% of genotyped samples. Consistent with this finding, P.1 was identified in 4 of 5 genotyped samples from HCW cases. It seems plausible that vaccination with CoronaVac conferred a level of protection against P.1 and that our estimates reflect VE in the real-world setting of high P.1 transmission.
We addressed multiple potential sources of bias in this observational setting. The use of a test negative design allowed for control of healthcare-seeking behaviour among study participants, albeit with limits. For the analysis of the primary outcome, we restricted cases and controls to patients with evidence of any symptoms proximal to the time of testing. This restriction reduces the risk of outcome misclassification, as sensitivity of PCR tests is high in this time period. However, exposure to SARS-CoV-2 likely differs between those presenting with different symptoms, in particular for those without symptoms. We were unable to perform additional matching with detailed symptom data and cannot exclude the possibility of differential test-seeking or exposure between vaccinated and unvaccinated individuals with varying symptomology,30 nor of misclassification due to false negative PCR tests. However, a strength of the surveillance system in Manaus was the large source of individual-level data that allowed us to match on a number of variables in order to reduce confounding.
Our estimates may be subject to unmeasured and residual confounding, as unvaccinated individuals receiving PCR tests may have different risk of SARS-CoV-2 infection than vaccinated individuals for reasons unrelated to vaccination. We addressed this possibility by evaluating the risk associated with being vaccinated 0-13 days before testing, when vaccination is likely to be ineffective or have reduced effectiveness.12 The positive association suggests that HCWs prioritised for vaccination were indeed at higher risk of SARS-CoV-2 exposure than those who were vaccinated later. Some of the association may be due to time-varying changes in exposure risk or testing behaviour, as suggested in other studies.31,32 This bias indicator suggests that confounding contributed to underestimation of the VE in the analysis of at-least-one-dose and two-dose schedules.
We observed a strong protective effect of previous positive RT-PCR or antigen detection test (aOR 0.36, 95% CI 0.17 to 0.79) and of female sex (aOR 0.53, 95% CI 0.37 to 0.77), consistent with other studies.33,34 The association between previous positive SARS-CoV-2 test and infection is likely an underestimate of the protection from infection, as many without a positive test were truly infected.
Evidence from this study is mixed and highlights that as vaccination campaigns with CoronaVac continue in Brazil and other countries, non-pharmaceutical interventions are necessary to reduce transmission, morbidity, and mortality in the population.
Public and Patient Involvement Statement
As this study was conducted using surveillance data gathered by the Municipal Health Secretary of Manaus and State Health Secretary of Manaus, patient involvement was not possible.
Dissemination declaration
Results will be disseminated to the public in Manaus and across Brazil. It is not possible to disseminate results to individuals who were selected into the study due to anonymization of the data.
Transparency statement
The lead author affirms that the manuscript is an honest, accurate, and transparent account of the study being reported; that no important aspects of the study have been omitted; and that any discrepancies from the study as originally planned have been explained.
Data Availability
Deidentified databases as well as the R codes will be deposited in the repository https://github.com/juliocroda/VebraCOVID-19
Author contributions
All authors conceived the study. MDTH and OTR completed analyses with guidance from JRA, DATC, AIK, and JC. MSST, SBO, MDTH, and SBO curated and validated the data. MDTH and OTR wrote the first draft of the manuscript. WNA, MA, RS, AMS, BCA, SHHF, CFC provided supervision. All authors contributed to, and approved, the final manuscript. JC is guarantor. The corresponding author attests that all listed authors meet authorship criteria and that no others meeting the criteria have been omitted.
Declaration of interests
All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf and declare: no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years; no other relationships or activities that could appear to have influenced the submitted work.
Data sharing
De-identified databases as well as the R codes will be deposited in the repository https://github.com/juliocroda/VebraCOVID-19
Acknowledgements
We are grateful for Pan American Health Organization’s support to the Fundação de Vigilância em Saúde from Amazonas State and the Municipal Health Secretary of Manaus in making the databases available for analysis. JC and AS are supported by the Oswaldo Cruz Foundation (Edital Covid-19 – resposta rápida: 48111668950485). OTR is funded by a Sara Borrell fellowship (CD19/00110) from the Instituto de Salud Carlos III. OTR acknowledges support from the Spanish Ministry of Science and Innovation through the Centro de Excelencia Severo Ochoa 2019-2023 Program and from the Generalitat de Catalunya through the CERCA Program. We thank Julio Horta for automating database linkage.
Footnotes
After our initial submission, we continued to accrue eligible case-control pairs and have now reached power for a pre-specified analysis of the effectiveness of two doses against symptomatic SARS-CoV-2 infection, in the period starting 14 days after administration of the second dose. We had designed the sample size assuming that vaccine effectiveness would be 70%, based on trial results from the randomised controlled trial of CoronaVac in Brazil. The pre-specified analysis was incorporated in the protocol that was developed and uploaded onto a public access website before conducting the study and was attached as a supplement in the initial submission. Upon performing this final analysis, we found that the estimated effectiveness following administration of two vaccine doses was low - estimated vaccine effectiveness was 36.8% (95% CI −54.9 to 74.2), which was lower than the effectiveness after administering at least one dose in the early analysis (49.6%). Given the low precision for effectiveness after two doses, combined with the promising early analysis of effectiveness following at least one dose, we acknowledge that these findings are difficult to interpret. We believe that there is likely downward bias in this estimate because vaccinated individuals were much more likely to be infected than unvaccinated individuals in the period 0-13 days after first vaccination (OR 2.11, p<0.001). This suggests that, even after controlling for observable characteristics among this population of healthcare workers, those at higher risk might take up vaccine earlier, leading to underestimation of its effectiveness. Furthermore, we had no power to detect effect modification by previous SARS-CoV-2 infection. However, in a sensitivity analysis excluding pairs where either individual had a positive SARS-CoV-2 test before the study period, we estimated effectiveness of two doses to be 56.2% (95% CI −23.0 to 84.4).