Brief communication: A meta-analysis of randomized trials of hydroxychloroquine for the prevention of COVID-19 ============================================================================================================== * Xabier García-Albéniz * Julia del Amo * Rosa Polo * José Miguel Morales-Asencio * Miguel A Hernán ## Abstract **Background** Recruitment into randomized trials of hydroxychloroquine (HCQ) for prevention of COVID-19 is being threatened by a widespread conviction that HCQ is not effective for prevention. In the absence of an updated systematic review, we conducted a meta-analysis of randomized trials that study the effectiveness of HCQ to prevent COVID-19. **Methods and Findings** A search of PubMed, Embase, and medRxiv with expert consultation found four completed randomized trials: two pre-exposure prophylaxis trials and two post-exposure prophylaxis trials. We obtained or calculated the risk ratio of COVID-19 diagnosis for assignment to HCQ versus no HCQ (either placebo or usual care) for each trial, and then pooled the risk ratio estimates. The risk ratio estimated for each of the individual trials were 0.74 (95% CI 0.50-1.10), 0.95 (0.25, 3.64), 0.83 (95% CI: 0.58-1.18), and 0.69 (95% CI: 0.35-1.37). The pooled risk ratio estimate was 0.78 (95% CI: 0.61-0.99). All four trials found a similar rate of adverse effects in the HCQ and no HCQ groups. **Discussion** A pooled analysis of these randomized trials cannot rule out a moderate reduction of COVID-19 risk after assignment to HCQ. Yet the findings from the randomized trials were widely interpreted as definite evidence of lack of effectiveness of HCQ, simply because they were not “statistically significant”. Completion of the ongoing trials is needed to generate more precise estimates of the effectiveness of HCQ to prevent COVID-19. ## Background Hydroxychloroquine (HCQ) is not an effective treatment for established COVID-19 (1-3). Several ongoing studies will help determine whether HCQ is a viable option for prophylaxis of COVID-19. However, recruitment into these studies (some of them carried out by the authors of this report) is being threatened by a widespread conviction that HCQ is not effective for prevention. In the absence of an updated systematic review, we conducted a meta-analysis of randomized trials that study the effectiveness of HCQ to prevent COVID-19 either before known exposure to an infected individual (pre-exposure prophylaxis) or after known exposure to an infected individual (postexposure prophylaxis). ## Methods and Findings A search of PubMed, Embase, and medRxiv, together with expert consultation, identified four completed randomized trials of prophylaxis with HCQ as of September 30, 2020 (4-7): two pre-exposure prophylaxis trials (4-5) and two post-exposure prophylaxis trials (6-7). For each of the completed trials, we obtained or calculated the risk ratio of COVID-19 diagnosis (as defined by each trial protocol) for assignment to HCQ versus no HCQ (either placebo or usual care) among PCR-negative individuals at baseline. We then pooled the risk ratio estimates using a fixed effect approach and two types of random effects approaches (8-9). We reported the random effects approach that resulted in the wider 95% confidence interval. The two pre-exposure prophylaxis trials were double-blinded, placebo-controlled trials that included healthcare workers with ongoing exposure to patients with COVID-19. In the first one (available as a preprint) (4), the risk of COVID-19 was 5.9% (58 total cases, 11 confirmed by PCR) among 989 participants assigned to HCQ (two 400 mg doses on day 1, followed by 400 mg either once or twice weekly for 12 weeks) and 7.9% (39 total cases, 6 confirmed by PCR) among 494 participants assigned to placebo. The risk difference can be calculated as -2.0% (95% CI -4.8 to 0.8) and the risk ratio can be calculated as 0.74 (95% CI 0.50-1.10). In the second trial (5), the risk of COVID-19 was 6.3% (4 cases confirmed by PCR) among 64 participants assigned to HCQ (three 200 mg doses daily for 8 weeks) and 6.6% (4 cases confirmed by PCR) among 61 participants assigned to placebo. The risk difference can be calculated as -0.3% (95% CI -8.9, 8.3) and the risk ratio can be calculated as 0.95 (95% CI 0.25-3.64). The two post-exposure prophylaxis trials included asymptomatic contacts of confirmed COVID-19 cases. The first one was a double-blind, placebo-controlled trial (6) in which the risk of COVID-19 diagnosis (largely based on compatible symptoms) was 11.8% in 414 contacts assigned to HCQ (800 mg. on day 1, 600 mg. daily for four days) and 14.3% in 407 contacts assigned to placebo. The risk difference was -2.4% (95% CI: -7.0 to 2.2) and the risk ratio can be calculated as 0.83 (95% CI: 0.58-1.18). The second one (available as a preprint) (7) was an open-label, cluster-randomized trial in which the COVID-19 risk (based on confirmed PCR) was 3.0% in 958 contacts assigned to HCQ (800 mg. on day 1, 400 mg. daily for six days) and 4.3% in 1042 contacts assigned to usual care. The risk ratio (adjusted for age, gender, region, and time of exposure) was 0.69 (95% CI: 0.35-1.37); the corresponding risk difference cannot be directly calculated from the data provided. The time from exposure to initiation of prophylaxis was relatively long in the two post-exposure prophylaxis trials: in one trial, about a third of participants were enrolled 4 days after exposure (none was enrolled later) (6); in the other, about 10% of participants were enrolled 7 or more days after exposure (7). For comparison, post-exposure prophylaxis for HIV is recommended in the first 6-72 hours after the exposure (10-11). The Figure shows the risk ratio estimates from each of the trials and the pooled estimates. The pooled risk ratio estimate was 0.78 (95% CI: 0.61-0.99) using either a fixed effect or a random effects approach. All four trials found a similar rate of serious adverse effects in the HCQ and no HCQ groups, which were low (4-7). ![Figure.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/10/01/2020.09.29.20203869/F1.medium.gif) [Figure.](http://medrxiv.org/content/early/2020/10/01/2020.09.29.20203869/F1) Figure. Risk ratio estimates of COVID-19 risk for hydroxychloroquine vs. no hydroxychloroquine in randomized trials of pre- and post-exposure prophylaxis, pooled and by study. ## Discussion When considered together, the available randomized trials yield a point estimate of an approximately 20% lower risk of COVID-19 for assignment to HCQ compared with no HCQ among PCR-negative individuals at randomization. Any effect between a 50% reduction in risk and no reduction in risk is highly compatible with the data from these trials. Because our pooled estimate is imprecise, we will need additional studies in order to make strong causal inferences about the prophylactic effect, if any, of HCQ. Unfortunately, recruitment for those studies is being impeded by incorrect interpretations of the available randomized trial evidence. The individual findings from the 4 completed trials have been widely (and incorrectly) portrayed as definite evidence of the lack of effectiveness of HCQ, simply because they were not “statistically significant”. Thus, the common confusion between the concepts “no effect” and “no statistical significance” have led many to conclude that HCQ has no prophylactic effect (which may be a true but premature conclusion) when we can only conclude that the effect estimate is still too imprecise (12). Our pooled estimates are based on the design and analytic choices made by the investigators of each trial. We encourage these investigators to coordinate future analyses with standardized outcome definitions that correct for differences in length of follow-up and time since exposure, and that adjust for losses to follow-up and other deviations from protocol. We also encourage the authors of living systematic reviews to update their findings frequently when, as in this case, public opinion interferes with the generation of the very evidence that will feed their systematic review. In summary, pending final publication of two of them, these randomized trials cannot rule out a moderate reduction of COVID-19 risk after assignment to HCQ. Completion of the ongoing trials is needed to generate more precise estimates of the potential effectiveness of HCQ to prevent COVID-19. ## Data Availability Data used in the analysis are publicly available ## Acknowledgments We thank Prof. Sander Greenland for technical advice and Prof. Richard Riley for constructive feedback on estimation methods for random-effects meta-analysis. ## Footnotes * An additional clinical trial was added to the meta-analysis * Received September 29, 2020. * Revision received October 1, 2020. * Accepted October 1, 2020. * © 2020, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/) ## References 1. 1.Solidarity clinical trial for COVID-19 treatment. No clinical benefit from use of hydroxycloroquine in hospitalised COVID-19. Available at: [https://www.who.int/emergencies/diseases/novel-coronavirus-2019/global-research-on-novel-coronavirus-2019-ncov/solidarity-clinical-trial-for-covid-19-treatments](https://www.who.int/emergencies/diseases/novel-coronavirus-2019/global-research-on-novel-coronavirus-2019-ncov/solidarity-clinical-trial-for-covid-19-treatments) 2. 2.Statement from the Chief Investigators of the Randomised Evaluation of COVid-19 thERapY (RECOVERY) Trial on hydroxychloroquine. Available at: [https://www.recoverytrial.net/files/hcq-recovery-statement-050620-final-002.pdf](https://www.recoverytrial.net/files/hcq-recovery-statement-050620-final-002.pdf) 3. 3.Effect of Hydroxychloroquine in Hospitalized Patients with COVID-19: Preliminary results from a multi-centre, randomized, controlled trial. RECOVERY Collaborative Group. MedRxiv preprint doi: [https://doi.org/10.1101/2020.07.15.20151852](https://doi.org/10.1101/2020.07.15.20151852) 4. 4.Rajasingham R, Bangdiwala AS, Nicol MR, et al. Hydroxychloroquine as pre-exposure prophylaxis for COVID-19 in healthcare workers: a randomized trial. medRxiv. 2020:2020.09.18.20197327. 5. 5.Abella BS,Jolkovsky EL,Biney BT, et al. Efficacy and Safety of Hydroxychloroquine vs Placebo for Pre-exposure SARS-CoV-2 Prophylaxis Among Health Care WorkersA Randomized Clinical Trial JAMA Intern Med. Published online September 30, 2020. doi:10.1001/jamainternmed.2020.6319 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1001/jamainternmed.2020.6319&link_type=DOI) 6. 6.Boulware DR, Pullen MF, Bangdiwala AS, et al. A Randomized Trial of Hydroxychloroquine as Postexposure Prophylaxis for Covid-19. New England Journal of Medicine. 2020;383(6):517–25. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa2016638&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F10%2F01%2F2020.09.29.20203869.atom) 7. 7.Mitja O, Ubals M, Corbacho M, et al. A Cluster-Randomized Trial of Hydroxychloroquine as Prevention of Covid-19 Transmission and Disease. medRxiv. 2020: 2020.07.20.20157651 8. 8.Hartung J, Knapp G. A refined method for the meta analysis of controlled clinical trials with binary outcome. Stat Med 2001; 20 (24): 3875–3889. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/sim.1009&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=11782040&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F10%2F01%2F2020.09.29.20203869.atom) 9. 9.DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials 1986; 7 (3): 177–188 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/0197-2456(86)90046-2&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=3802833&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F10%2F01%2F2020.09.29.20203869.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1986F013900001&link_type=ISI) 10. 10.Updated U.S. Public Health Service guidelines for the management of occupational exposures to HIV and recommendations for postexposure prophylaxis. U.S U.S. Public Health Service Working Group. Department of Health & Human Services. Available at: [https://stacks.cdc.gov/view/cdc/20711](https://stacks.cdc.gov/view/cdc/20711) 11. 11.Polo Rodriguez R, Lozano F, González de Castro P, et al. Consensus Document on post-exposure prophylaxis against HIV, HBV and HCV in adults and children. Enferm Infecc Microbiol Clin 2016;34(2):121.e1-15. 12. 12.Greenland S, Senn SJ, Rothman KJ, et al. Statistical Tests, P-values, Confidence Intervals, and Power: A Guide to Misinterpretations. Eur J Epidemiol 2016; 31 (4):337–50 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s10654-016-0149-3&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=27209009&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F10%2F01%2F2020.09.29.20203869.atom)