Adverse effects of remdesivir, hydroxychloroquine, and lopinavir/ritonavir when used for COVID-19: systematic review and meta-analysis of randomized trials
===========================================================================================================================================================

* Ariel Izcovich
* Reed AC Siemieniuk
* Jessica J Bartoszko
* Long Ge
* Dena Zeraatkar
* Elena Kum
* Assem M. Khamis
* Bram Rochwerg
* Thomas Agoritsas
* Derek K Chu
* Shelley L McLeod
* Reem A Mustafa
* Per O Vandvik
* Romina Brignardello-Petersen

## Abstract

**Introduction** In an attempt to improve outcomes for patients with coronavirus disease 19 (COVID-19), several drugs, such as remdesivir, hydroxychloroquine (with or without azithromycin), and lopinavir/ritonavir, have been evaluated for treatment. While much attention focuses on potential benefits of these drugs, this must be weighed against their adverse effects.

**Methods** We searched 32 databases in multiple languages from 1 December 2019 to 27 October 2020. We included randomized trials if they compared any of the drugs of interest to placebo or standard care, or against each other. A related world health organization (WHO) guideline panel selected the interventions to address and identified possible adverse effects that might be important to patients. Pairs of reviewers independently extracted data and assessed risk of bias. We analyzed data using a fixed-effects pairwise meta-analysis and assessed the certainty of evidence using the GRADE approach.

**Results** We included 16 randomized trials which enrolled 8226 patients. Compared to standard care or placebo, low certainty evidence suggests that remdesivir may not have an important effect on acute kidney injury (risk difference [RD] 8 fewer per 1000, 95% confidence interval (CI): 27 fewer to 21 more) or cognitive dysfunction/delirium (RD 3 more per 1000, 95% CI: 12 fewer to 19 more). Low certainty evidence suggests that hydroxychloroquine may increase the risk of serious cardiac toxicity (RD 10 more per 1000, 95% CI: 0 more to 30 more) and cognitive dysfunction/delirium (RD 33 more per 1000, 95% CI: 18 fewer to 84 more), whereas moderate certainty evidence suggests hydroxychloroquine probably increases the risk of diarrhoea (RD 106 more per 1000, 95% CI: 48 more to 175 more) and nausea and/or vomiting (RD 62 more per 1000, 95% CI: 23 more to 110 more) compared to standard care or placebo. Low certainty evidence suggests lopinavir/ritonavir may increase the risk of diarrhoea (RD 168 more per 1000, 95% CI: 58 more to 330 more) and nausea and/or vomiting (RD 160 more per 1000, 95% CI: 100 more to 210 more) compared to standard care or placebo.

**Conclusion** Hydroxychloroquine probably increases the risk of diarrhoea and nausea and/or vomiting and may increase the risk of cardiac toxicity and cognitive dysfunction/delirium. Remdesivir may have no effect on risk of acute kidney injury or cognitive dysfunction/delirium. Lopinavir/ritonavir may increase the risk of diarrhoea and nausea and/or vomiting. These findings provide important information to support the development of evidence-based management strategies for patients with COVID-19.

## Introduction

As of November 16, 2020, there are 54.6 million cumulative cases of COVID-19 worldwide, and at least 1.3 million deaths.1 Several drugs have been used for the treatment of patients with COVID-19, often without high quality evidence demonstrating efficacy. Three drugs that have been used for COVID-19 include remdesivir, hydroxychloroquine with or without azithromycin, and lopinavir/ritonavir. None of these drugs have high certainty evidence evaluating their effectiveness for key patient-important outcomes such as mortality, need for mechanical ventilation, duration of hospital stay or time to clinical improvement.2

We are conducting a living systematic review and network meta-analysis to provide a summary of the evidence for all drugs used in the treatment of COVID-19.2 Until now, we have not found that any one of these drugs increases the risk of adverse effects leading to drug continuation when compared to standard care or another drug treatment. However, we have not evaluated drug-specific adverse effects, which patients might consider to be important when making decisions about whether to use or not use a drug, particularly in the face of considerable uncertainty regarding their desirable effects.

Building on the work of the living systematic review, the aim of this paper is to summarize the best available evidence addressing drug-specific adverse effects in COVID-19. This evidence synthesis is part of the BMJ-Rapid Recommendations project,3 to inform World Health Organization (WHO) Living Guidelines on drugs for treatment of COVID-19.4,5

## Methods

We followed the preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines for reporting.6

### Eligibility criteria

As selected by the linked guideline panel we included randomised clinical trials (RCTs) that included people with suspected, probable, or confirmed COVID-19 comparing remdesivir, hydroxychloroquine, and lopinavir/ritonavir, alone or in combination with other drugs, for treatment against one another or against no intervention, placebo, or standard care, and reported on drug-specific adverse events of interest (see outcome identification below). We included trials regardless of publication status (peer reviewed, in press, or preprint) or language. No restrictions were applied based on severity of COVID-19 illness or setting in which the trial was conducted (outpatient, hospital, ICU, etc). We excluded studies in which remdesivir, hydroxychloroquine, and lopinavir/ritonavir were used for prophylaxis and studies in which different doses of the same intervention were compared.

### Information sources

We performed daily searches from Monday to Friday using the WHO COVID-19 database for eligible studies, which is a comprehensive multilingual source of global literature on COVID-19.7 Prior to its merge with the WHO COVID-19 database on 9 October 2020, we also performed daily searches for eligible studies from Monday to Friday in the US Centers for Disease Control and Prevention (CDC) COVID-19 Research Articles Downloadable Database.8 To identify RCTs, we filtered the results from the CDC’s database through a validated and highly sensitive machine learning model.9 In addition, we searched six Chinese databases. We adapted the search terms for COVID-19 developed by the CDC to the Chinese language. For the Chinese literature search, we also included search terms for randomised trials.

We also used living evidence retrieval services to identify any trials that might have been missed with traditional search methods. These included the Living Overview of the Evidence (L-OVE) COVID-19 Repository by the Epistemonikos Foundation10 and the Systematic and Living Map on COVID-19 Evidence by the Norwegian Institute of Public Health, in collaboration with the Cochrane Canada Centre at McMaster University.11 We searched all English information sources from 1 December 2019 to 27 October 2020, and the Chinese literature from inception of the databases to 16 October 2020. A complete list of information sources is available in supplementary text 1.

### Study selection

Using systematic review software, Covidence,12 following training and calibration exercises, pairs of reviewers independently screened all titles and abstracts, followed by full texts of trials that were identified as potentially eligible. A third reviewer adjudicated conflicts.

### Data collection

For each eligible trial, pairs of reviewers extracted data independently using a standardised, pilot-tested data extraction form. Reviewers collected information on trial characteristics (trial registration, publication status, study status, design), participant characteristics (country, age, sex, smoking habits, comorbidities), and outcomes of interest. Reviewers resolved discrepancies by discussion and, when necessary, with adjudication by a third party.

#### Outcome identification

A linked WHO-BMJ Rapid Recommendations guideline panel4 consisting of patients, clinicians, and research methodologists with representation from all WHO geographic regions provided input on potentially important adverse effects of the medications. If any of the panelists believed a specific adverse effect was possible and might influence the decision to use or not use each drug, it was included in this systematic review as an outcome of interest. Panelists were asked to focus on adverse effects important to patients, rather than surrogate measures. For example, we considered clinically important cardiac toxicity including arrhythmias important, but did not consider changes to the QT interval important.

The panel identified specific adverse effects for each drug. For remdesivir, we included acute kidney injury. For hydroxychloroquine and hydroxychloroquine with azithromycin, we included cardiac toxicity, diarrhoea, and nausea and/or vomiting. For lopinavir/ritonavir, we included acute kidney injury, diarrhoea, and nausea and/or vomiting. For all of the drugs, we included cognitive dysfunction/delirium and fatigue. We included studies in which researchers used any definitions of these outcomes. In cases in which the definitions did appropriately reflect what is important to patients, we rated down the certainty of the evidence for indirectness (see certainty of the evidence below).

### Risk of bias within individual studies

For each eligible trial and outcome, following training and calibration exercises, reviewers used a revision of the Cochrane tool for assessing risk of bias in RCTs (RoB 2.0)13 to rate trials as either at i) low risk of bias, ii) some concerns—probably low risk of bias, iii) some concerns— probably high risk of bias, or iv) high risk of bias, across the following domains: bias arising from the randomisation process; bias due to departures from the intended intervention; bias due to missing outcome data; bias in measurement of the outcome; bias in selection of the reported results, including deviations from the registered protocol; and bias arising from early termination for benefit. We rated trials at high risk of bias overall if one or more domains were rated as “some concerns—probably high risk of bias” or as “high risk of bias”, and as low risk of bias overall if all domains were rated as “some concerns—probably low risk of bias” or “low risk of bias”. Reviewers resolved discrepancies by discussion and, when not possible, with adjudication by a third party.

### Data synthesis

#### Measures of effect and statistical analysis

We summarised the effect of interventions on dichotomous outcomes using odds ratios (ORs) and corresponding 95% confidence intervals (CIs). We conducted frequentist fixed-effects pairwise meta-analyses using the R package “meta” in RStudio Version 1.3.1093.14 We used fixed rather than random effects for the primary analysis because for many of the interventions, the evidence consisted of two or fewer trials or there were several studies with few events. For outcomes in which there were more than one trial with no events in both groups, we meta-analysed the data using risk differences (RD) rather than odds ratios.

### Certainty of the evidence

We assessed the certainty of evidence using the grading of recommendations assessment, development and evaluation (GRADE) approach.15 Two methodologists with experience in using GRADE rated each domain for each comparison separately and resolved discrepancies by consensus. We rated the certainty for each comparison and outcome as high, moderate, low, or very low, based on considerations of risk of bias, inconsistency, indirectness, publication bias, and imprecision. We made judgments of imprecision using a minimally contextualised approach with the null effect as a threshold. This minimally contextualised approach considers whether the CI includes the null effect, or, when the point estimate is close to the null effect, whether the CI lies within the boundaries of small but important benefit and harm.16 Additionally we analysed if the total number of patients included in the meta-analysis was less than the required number of patients generated by a conventional sample size calculation for a single adequately powered trial to define if optimal information size (OIS) was met. For some of the interventions, extensively implemented in other clinical scenarios, we used indirect evidence to complement the certainty of evidence judgments. We created GRADE evidence summaries (Summary of Findings tables) using the MAGIC Authoring and Publication Platform ([www.magicapp.org](http://www.magicapp.org)) to provide user friendly formats for clinicians and patients and to allow re-use in the context of clinical practice guidelines for COVID-19.4,5 We calculated the absolute risks and risk differences from the ORs (and their CIs) and the mean risk in the control groups across all of the included trials. In cases where no events were reported in the control arm of any of the included studies, we calculated baseline risks based on other comparisons for the same outcome.

### Subgroup and sensitivity analyses

We performed Bayesian random-effects meta-analysis using the *bayesmeta* package.17 We used a plausible prior for the variance parameter and a uniform prior for the effect parameter, as suggested in an empirical study using pre-specified empiric priors as a sensitivity analysis for all comparisons.18 We did not conduct any subgroup analyses.

## Results

### Study identification

After screening 14,806 titles and abstracts and 300 full texts, we included sixteen unique RCTs with 8,152 patients that informed on drug-specific adverse events (figure 1).19-34 We did not identify any additional eligible RCTs through the living evidence retrieval services. Two studies reported adverse effects for remdesivir,19,33 ten for hydroxychloroquine,21-26,29-32 one for hydroxychloroquine plus azithromycin,21 and four for lopinavir/ritonavir.20,27,28,34 Of the sixteen eligible RCTs, 13 have been published in peer reviewed journals, and 3 only as preprints.22,24,26 All of the trials were registered, published in English and most evaluated treatment in patients admitted to hospital with COVID-19 (15/16; 93.7%). Most of the trials were conducted in China (10/16; 62.5%). Table 1 presents the characteristics of the included studies. Additional study characteristics, outcome data, and risk of bias assessments for each study are available in the supplementary file.

View this table:
[Table 1.](http://medrxiv.org/content/early/2020/11/18/2020.11.16.20232876/T1)

Table 1. 
Characteristics of the included trials.

![Figure 1.](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/11/18/2020.11.16.20232876/F1.medium.gif)

[Figure 1.](http://medrxiv.org/content/early/2020/11/18/2020.11.16.20232876/F1)

Figure 1. Study selection (PRISMA form LNMA – Jess can help. The bottom cell should have number of trials for each drug separately.)

### Risk of bias in included studies

Supplementary figure 1 presents the risk of bias assessment of the 16 included studies for each outcome. Overall and domain specific risk of bias judgments did not differ between the outcomes reported in each individual study, and most of the studies (13/16, 81.2%) presented significant methodological limitations.

### Adverse effects of the interventions (Table 2.)

#### Remdesivir

Two studies19,33 including 1,281 patients reported on remdesivir specific adverse events. Both studies reported on acute kidney injury and one study19 including 1,048 patients reported on cognitive dysfunction/delirium. No studies reported on fatigue.

View this table:
[Table 2.](http://medrxiv.org/content/early/2020/11/18/2020.11.16.20232876/T2)

Table 2. 
Summary of findings table

##### Acute Kidney Injury

Remdesivir may have little or no effect on acute kidney injury when compared to placebo (OR 0.85, 95% CI: 0.51 to 1.41; RD 8 fewer per 1,000 participants, 95% CI: 27 fewer to 21 more) (Supplementary figure 2.). The certainty of the evidence was low because of serious imprecision and serious indirectness (studies used change in serum creatinine rather than patient-important measures of acute kidney injury like renal replacement therapy requirement).

##### Cognitive dysfunction/delirium

Remdesivir may have little or no effect on cognitive dysfunction/delirium when compared to placebo (OR 1.22, 95% CI: 0.48 to 3.11; RD 3 more per 1,000 participants, 95% CI: 12 fewer to 19 more). The certainty of the evidence was low because of very serious imprecision.

#### Hydroxychloroquine

Ten studies21-26,29-32 including 3,663 patients reported on hydroxychloroquine specific adverse events. Seven studies including 3,287 patients reported cardiac toxicity,21,22,24,27,30-32 six trials including 979 patients reported diarrhoea,23-25,29-31 seven studies including 1,429 patients23-26,29-31 reported nausea and/or vomiting, one study30 including 423 patients reported on cognitive dysfunction/delirium and two studies24,31 including 180 patients reported on fatigue.

##### Cardiac toxicity

Definitions of cardiac toxicity varied between trials: RECOVERY defined the outcome as new major arrhythmias (supraventricular tachycardia, ventricular tachycardia or fibrillation or atrioventricular block requiring intervention),26 two studies as new arrhythmias,21,30 and one study as new arrhythmias or cardiac arrest.32 The remaining studies did not provide details about cardiac toxicity definition. Hydroxychloroquine may increase the risk of cardiac toxicity when compared to standard care or placebo (RD 10 more per 1,000 participants, 95% CI: 0 more to 30 more) (Supplementary figure 3). The certainty of the evidence was low because of serious imprecision and risk of bias (unblinded studies with possible detection bias).

##### Diarrhoea

Hydroxychloroquine probably increases the risk of diarrhoea when compared to standard care or placebo (OR 1.95, 95% CI: 1.40 to 2.73; RD 106 more per 1,000 participants, 95% CI: 48 more to 175 more) (Supplementary figure 4). The certainty of the evidence was moderate because of imprecision as the optimal information size (OIS) was not met. Although most studies presented methodological limitations, we did not rate down for risk of bias (RoB) as our concerns were mitigated by a large effect size and indirect evidence showing consistent results.35

##### Nausea and/or vomiting

Hydroxychloroquine probably increases nausea and vomiting (OR 1.74, 95% CI: 1.26 to 2.41; RD 62 more per 1,000 participants, 95% CI: 23 more to 110 more) (Supplementary figure 5). The certainty of the evidence was moderate because of imprecision as OIS was not met. Although most studies presented methodological limitations, we did not rate down for RoB as our concerns were mitigated by a large effect size and indirect evidence showing consistent results.35

##### Cognitive dysfunction/delirium

Hydroxychloroquine may increase cognitive dysfunction/delirium when compared to standard care or placebo (OR 1.59, 95% CI: 0.77 to 3.28; RD 33 more per 1,000 participants, 95% CI: 18 fewer to 84 more). The certainty of the evidence was low because of very serious imprecision.

##### Fatigue

The effect of hydroxychloroquine on fatigue is uncertain when compared to standard care or placebo (OR 2.75, 95% CI: 0.28 to 27.28; RD 82 more per 1,000 participants, 95% CI: 38 fewer to 555 more) (Supplementary figure 6). The certainty of the evidence was very low because of very serious imprecision and serious risk of bias.

#### Hydroxychloroquine with azithromycin

Only one study21 including 667 patients reported drug-specific adverse effects for hydroxychloroquine with azithromycin. The study compared hydroxychloroquine with azithromycin, hydroxychloroquine alone, and standard care and reported on cardiac toxicity and nausea and/or vomiting. Other outcomes, including diarrhoea, cognitive dysfunction/delirium or fatigue were not reported.

##### Cardiac toxicity

The effect of hydroxychloroquine with azithromycin on cardiac toxicity is uncertain when compared to standard care or placebo (RD 10 more per 1,000 participants, 95% CI: 10 fewer to 20 more), or hydroxychloroquine alone (RD 0 more per 1,000 participants, 95% CI: 20 fewer to 20 more). The certainty of the evidence was very low because of very serious imprecision and serious risk of bias.

##### Nausea and/or vomiting

The effect of hydroxychloroquine with azithromycin on nausea and vomiting in uncertain when compared to standard care or placebo (OR 1.49, 95% CI: 0.37 to 6.06; RD 8 more per 1,000 participants, 95% CI: 11 fewer to 78 more), or hydroxychloroquine alone (OR 0.54, 95% CI: 0.18 to 1.57; RD 20 fewer per 1,000 participants, 95% CI: 37 fewer to 24 more). The certainty of the evidence was very low because of very serious imprecision and serious risk of bias.

#### Lopinavir/ritonavir

Four studies20,27,28,34 including 370 patients reported adverse effects of lopinavir/ritonavir. All four studies reported diarrhoea and nausea and/or vomiting. Two studies including 259 patients reported acute kidney injury20,27 and two studies including 254 patients reported fatigue.27,34 No studies reported on cognitive dysfunction/delirium.

##### Acute Kidney Injury

The effect of lopinavir/ritonavir on acute kidney injury is uncertain when compared to standard care or placebo (20 fewer per 1,000 participants, 95% CI: 70 fewer to 20 more) (Supplementary figure 7). The certainty of the evidence was very low because of very serious imprecision and serious risk of bias.

##### Diarrhoea

Lopinavir/ritonavir may increase the risk of diarrhoea when compared to standard care or placebo (OR 4.28, 95% CI: 1.99 to 9.18; RD 168 more per 1,000 participants, 95% CI: 58 more to 330 more) (Supplementary figure 8). The certainty of the evidence was low because of very serious imprecision. Although most studies presented methodological limitations, we did not rate down for RoB as our concerns were mitigated by a large effect size and indirect evidence showing consistent results.36

##### Nausea and/or vomiting

Lopinavir/ritonavir may increase the risk of nausea and/or vomiting when compared to standard care or placebo (RD 160 more per 1,000 participants, 95% CI: 100 more to 210 more) (Supplementary figure 9). The certainty of the evidence was low because of very serious imprecision. Although most studies presented methodologic limitations, we did not rate down for RoB as our concerns were mitigated by a large effect size and indirect evidence showing consistent results.36

##### Fatigue

The effect of lopinavir/ritonavir on fatigue is uncertain when compared to standard care or placebo (OR 1.56, 95% CI: 0.53 to 4.58; 28 more per 1,000 participants, 95% CI: 25 fewer to 154 more) (Supplementary figure 10). The certainty of the evidence was very low because of very serious imprecision and serious risk of bias.

#### Sensitivity analyses

Our interpretation of the results did not substantially change when using a Bayesian random effects model rather than frequentist fixed effects or when pooling relative estimates rather than absolute estimates (supplementary figures 11 to 22).

## Discussion

This systematic review and meta-analysis - directly informing the living WHO guideline for COVID-19 therapeutics - provides a comprehensive overview of the evidence for drug-specific adverse effects of interest for three commonly used drugs for treatment of COVID-19. From 40 interventions included in our living network meta-analysis,2 we only included studies reporting on drug specific adverse events for remdesivir, hydroxychloroquine, hydroxychloroquine with azithromycin and lopinavir/ritonavir in this review as these drugs are receiving a high degree of interest. None of these interventions may increase the risk of adverse effects leading to discontinuation, however the certainty of the evidence was low for hydroxychloroquine and moderate for remdesivir, while no information was available for hydroxychloroquine with azithromycin, or lopinavir-ritonavir.2 In this review we found moderate certainty evidence that hydroxychloroquine increases the risk of diarrhoea and nausea and/or vomiting and low certainty evidence that it increases the risk of cardiac toxicity and cognitive dysfunction/delirium. For lopinavir/ritonavir we found low certainty evidence that it increases the risk of diarrhoea, and nausea and/or vomiting. Based on low or very low certainty evidence, we did not find evidence that remdesivir or lopinavir/ritonavir increase the risk of acute kidney injury or cognitive defunction/delirium.

### Strengths and limitations of this review

The search strategy was comprehensive with explicit eligibility criteria, and no restrictions on language or publication status. To ensure expertise in all areas, the review team is composed of clinical and methods experts who have undergone training and calibration exercises for all stages of the review process. We assessed the certainty of the evidence using the GRADE approach and interpreted the results considering absolute, rather than relative, effects.

We evaluated only a limited number of adverse effects and interventions, as selected by the linked guideline panel. We included an adverse effect if any panel member believed it might be important to patients when deciding whether to use or not to use a drug. However, there may be other patient-important adverse drug effects that were not prespecified by the panel. Further, some may perceive that excluding surrogate outcomes, such as an increase in liver enzymes or electrocardiogram changes may lead to under-appreciation of potential harms, especially for surrogates that are more closely linked on the causal pathway to patient important harms.

So far there is limited evidence for the harms associated with most drugs as adverse effects were only reported by a limited number of studies. For comparisons with sufficient data, the primary limitation of the evidence was lack of blinding, which might introduce bias through differences in cointerventions or outcome assessment between randomisation groups. However, the large magnitude of effects observed resulted in moderate certainty that hydroxychloroquine causes specific adverse events.

These findings are consistent with “The Living Project” ([https://covid-nma.com/](https://covid-nma.com/)), which found an increase in any adverse events with hydroxychloroquine (RR 2.16, 95% CI: 1.21 to 3.86) and lopinavir/ritonavir (RR 2.39, 95% CI: 0.21 to 27.57), but not with remdesivir (RR 1.00, 95% CI: 0.87 to 1.15). However, they did not report on specific adverse events. Other systematic reviews found an increase in the risk of diarrhoea and nausea and/or vomiting with lopinavir-ritonavir37,38 and hydroxychloroquine,38-40 increase in arrhythmias and QTc interval prolongation with hydroxychloroquine alone,40-42 or combined with a macrolide,43,44 and no significant increase in renal failure with remdesivir.45

## Conclusion

Hydroxychloroquine probably increases the risk of diarrhoea and nausea and/or vomiting and may increase the risk of cardiac toxicity and cognitive dysfunction/delirium. Remdesivir may have no effect on risk of acute kidney injury or cognitive dysfunction/delirium.

Lopinavir/ritonavir may increase the risk of diarrhoea and nausea and/or vomiting. These findings provide important information to support the development of evidence-based management strategies for patients with COVID-19.

## Supporting information

Supplementary methods [[supplements/232876_file03.docx]](pending:yes)

Supplementary figures [[supplements/232876_file04.docx]](pending:yes)

## Data Availability

Complete data available in the main manuscript and supplementary materials

*   Received November 16, 2020.
*   Revision received November 16, 2020.
*   Accepted November 18, 2020.


*   © 2020, Posted by Cold Spring Harbor Laboratory

This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/)

## References

1.  1.John Hopkins University. Coronavirus Resource Center 2020 [https://coronavirus.jhu.edu/map.html](https://coronavirus.jhu.edu/map.html) accessed November 10 2020
    
    

2.  2.Siemieniuk RA, Bartoszko JJ, Ge L, Zeraatkar D, Izcovich A, Kum E, et al. Drug treatments for covid-19: living systematic review and network meta-analysis. BMJ. 2020 Jul 30;m2980.
    
    

3.  3.Siemieniuk RA, Agoritsas T, Macdonald H, Guyatt GH, Brandt L, Vandvik PO. Introduction to *BMJ* Rapid Recommendations. BMJ. 2016 Sep 28;i5191.
    
    

4.  4.Rochwerg B, Agarwal A, Zeng L, Leo Y-S, Appiah JA, Agoritsas T, et al. Remdesivir for severe covid-19: a clinical practice guideline. BMJ. 2020 Jul 30;m2924.
    
    

5.  5.Lamontagne F, Agoritsas T, Macdonald H, Leo Y-S, Diaz J, Agarwal A, et al. A living WHO guideline on drugs for covid-19. BMJ. 2020 Sep 4;m3379.
    
    

6.  6.Moher D, Liberati A, Tetzlaff J, Altman DG, for the PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009 Jul 21;339(jul21 1):b2535–b2535.
    
    [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE3OiIzMzkvanVsMjFfMS9iMjUzNSI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIwLzExLzE4LzIwMjAuMTEuMTYuMjAyMzI4NzYuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

7.  7.World Health Organization. Global Research on coronavirus disease (COVID-19). [https://www.who.int/emergencies/diseases/novel-coronavirus-2019/global-research-on-novel-coronavirus-2019-ncov](https://www.who.int/emergencies/diseases/novel-coronavirus-2019/global-research-on-novel-coronavirus-2019-ncov)
    
    

8.  8.The Stephen B. Thacker CDC Library. COVID-19 Research Articles Downloadable Database: U.S. Centers for Disease Control and Prevention (CDC); 2020 [https://www.cdc.gov/library/researchguides/2019novelcoronavirus/researcharticles.html](https://www.cdc.gov/library/researchguides/2019novelcoronavirus/researcharticles.html) [accessed 27 October 2020]
    
    

9.  9.Marshall IJ, Noel-Storr A, Kuiper J, Thomas J, Wallace BC. Machine learning for identifying Randomized Controlled Trials: An evaluation and practitioner’s guide. Res Synth Methods 2018;9:602–14. PubMed doi:10.1002/jrsm.1287
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/jrsm.1287&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=29314757&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F11%2F18%2F2020.11.16.20232876.atom) 

10. 10.Living evidence Repository for COVID-19. Epistemonikos Foundation. Available at: [https://app.iloveevidence.com/loves/5e6fdb9669c00e4ac072701d](https://app.iloveevidence.com/loves/5e6fdb9669c00e4ac072701d) [27 October 2020]
    
    

11. 11.Norwegian Institute of Public Health. NIPH systematic and living map on COVID-19 evidence 2020 [https://www.nornesk.no/forskningskart/NIPH\_mainMap.html](https://www.nornesk.no/forskningskart/NIPH_mainMap.html) [accessed 27 October 2020.]
    
    

12. 12.COVIDence systematic review software [program]. Melbourne, Australia: Veritas Health Innovation.
    
    

13. 13.Sterne JAC, Savović J, Page MJ, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ 2019;366:4898. PubMed doi:10.1136/bmj.l4898
    
    [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE3OiIzNjYvYXVnMjhfMi9sNDg5OCI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIwLzExLzE4LzIwMjAuMTEuMTYuMjAyMzI4NzYuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

14. 14.Balduzzi S, Rücker G, Schwarzer G. How to perform a meta-analysis with R: a practical tutorial. Evid Based Cognitive Health. 2019 Nov;22(4):153–60.
    
    

15. 15.GRADE Working Group. Grading quality of evidence and strength of recommendations. BMJ. 2004;328(7454):1490.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjEzOiIzMjgvNzQ1NC8xNDkwIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjAvMTEvMTgvMjAyMC4xMS4xNi4yMDIzMjg3Ni5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

16. 16.Hultcrantz M, Rind D, Akl EA, et al. The GRADE Working Group clarifies the construct of certainty of evidence. J Clin Epidemiol 2017;87:4–13. PubMed doi:10.1016/j.jclinepi.2017.05.006.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jclinepi.2017.05.006&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=28529184&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F11%2F18%2F2020.11.16.20232876.atom) 

17. 17.Rover C. Bayesian random-effects meta-analysis using the bayesmeta R package. Journal of Statistical Software 2017;93(5):1–51. doi: 10.18637/jss.v093.i06
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.18637/jss.v093.i06&link_type=DOI) 

18. 18.Turner RM, Jackson D, Wei Y, et al. Predictive distributions for between-study heterogeneity and simple methods for their application in Bayesian meta-analysis. Stat Med 2015;34(6):984–98. doi: 10.1002/sim.6381 [published Online First: 2014/12/06]
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/sim.6381&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25475839&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F11%2F18%2F2020.11.16.20232876.atom) 

19. 19.Beigel JH, Tomashek KM, Dodd LE, Mehta AK, Zingman BS, Kalil AC, et al. Remdesivir for the Treatment of Covid-19 — Final Report. N Engl J Med. 2020 May 22;NEJMoa2007764.
    
    

20. 20.Cao B, Wang Y, Wen D, et al. A Trial of Lopinavir-Ritonavir in Adults Hospitalized with Severe Covid-19. N Engl J Med 2020;382:1787–99. PubMed doi:10.1056/NEJMoa2001282
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa2001282&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32187464&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F11%2F18%2F2020.11.16.20232876.atom) 

21. 21.Cavalcanti AB, Zampieri FG, Rosa RG, et al; Coalition Covid-19 Brazil I Investigators. Hydroxychloroquine with or without Azithromycin in Mild-to-Moderate Covid-19. N Engl J Med 2020. doi:10.1056/NEJMoa2019014
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa2019014&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32706953&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F11%2F18%2F2020.11.16.20232876.atom) 

22. 22.Chen Z, Hu J, Zhang Z, et al. Efficacy of hydroxychloroquine in patients with COVID-19: results of a randomized clinical trial. medRxiv 2020. doi:10.1101/2020.03.22.20040758
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoibWVkcnhpdiI7czo1OiJyZXNpZCI7czoyMToiMjAyMC4wMy4yMi4yMDA0MDc1OHYzIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjAvMTEvMTgvMjAyMC4xMS4xNi4yMDIzMjg3Ni5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

23. 23.Jun C, Liu D, Li L, et al. A preliminary study of hydroxychloroquine sulfate in patients with common 2019 coronavirus disease (COVID-19). Journal of Zhejiang University 2019;49:215–9
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1101/2020.06.17.20133579&link_type=DOI) 

24. 24.Chen L, Zhang Z-y, Fu J-g, et al. Efficacy and safety of chloroquine or hydroxychloroquine in moderate type of COVID-19: a prospective open-label randomized controlled study. medRxiv 2020. doi:10.1101/2020.06.19.20136093
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoibWVkcnhpdiI7czo1OiJyZXNpZCI7czoyMToiMjAyMC4wNi4xOS4yMDEzNjA5M3YxIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjAvMTEvMTgvMjAyMC4xMS4xNi4yMDIzMjg3Ni5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

25. 25.Chen C-P, Lin Y-C, Chen T-C, et al. A multicenter, randomized, open-label, controlled trial to evaluate the efficacy and tolerability of hydroxychloroquine and a retrospective study in adult patients with mild to moderate coronavirus disease 2019 (COVID-19). medRxiv 2020. doi:10.1101/2020.07.08.20148841
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoibWVkcnhpdiI7czo1OiJyZXNpZCI7czoyMToiMjAyMC4wNy4wOC4yMDE0ODg0MXYxIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjAvMTEvMTgvMjAyMC4xMS4xNi4yMDIzMjg3Ni5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

26. 26.Horby P, Mafham M, Linsell L, et al. Effect of Hydroxychloroquine in Hospitalized Patients with COVID-19: Preliminary results from a multi-centre, randomized, controlled trial. medRxiv [Preprint] 2020. doi:10.1101/2020.07.15.20151852
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoibWVkcnhpdiI7czo1OiJyZXNpZCI7czoyMToiMjAyMC4wNy4xNS4yMDE1MTg1MnYxIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjAvMTEvMTgvMjAyMC4xMS4xNi4yMDIzMjg3Ni5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

27. 27.Huang Y-Q, Tang S-Q, Xu X-L, et al. No statistically apparent difference in antiviral effectiveness observed among ribavirin plus interferon-alpha, lopinavir/ritonavir plus interferon-alpha, and ribavirin plus lopinavir/ritonavir plus interferon-alpha in patients with mild to moderate coronavirus disease 2019: results of a randomized, open-labeled prospective study. Front Pharmacol 2020;11:1071
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.3389/fphar.2020.01071&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32765274&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F11%2F18%2F2020.11.16.20232876.atom) 

28. 28.Li Y, Xie Z, Lin W, et al. An exploratory randomized controlled study on the efficacy and safety of lopinavir/ritonavir or arbidol treating adult patients hospitalized with mild/moderate COVID-19 (ELACOI). medRxiv [Preprint] 2020.
    
    

29. 29.Lyngbakken MN, Berdal J-E, Eskesen A, Kvale D, Olsen IC, Rueegg CS, et al. A pragmatic randomized controlled trial reports lack of efficacy of hydroxychloroquine on coronavirus disease 2019 viral kinetics. Nat Commun. 2020 Dec;11(1):5284.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1038/s41467-020-19056-6&link_type=DOI) 

30. 30.Skipper CP, Pastick KA, Engen NW, et al. Hydroxychloroquine in Nonhospitalized Adults With Early COVID-19: A Randomized Trial. Ann Intern Med 2020; published online 16 July. PubMed doi:10.7326/M20-4207
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.7326/M20-4207&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32673060&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F11%2F18%2F2020.11.16.20232876.atom) 

31. 31.Tang W, Cao Z, Han M, et al. Hydroxychloroquine in patients with mainly mild to moderate coronavirus disease 2019: open label, randomised controlled trial. BMJ 2020;369:m1849. PubMed doi:10.1136/bmj.m1849
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE3OiIzNjkvbWF5MTRfNS9tMTg0OSI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDIwLzExLzE4LzIwMjAuMTEuMTYuMjAyMzI4NzYuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 

32. 32.Ulrich RJ, Troxel AB, Carmody E, Eapen J, Bäcker M, DeHovitz JA, et al. Treating Covid-19 With Hydroxychloroquine (TEACH): A Multicenter, Double-Blind, Randomized Controlled Trial in Hospitalized Patients. Open Forum Infectious Diseases. 2020 Sep 23;ofaa446.
    
    

33. 33.Wang Y, Zhang D, Du G, et al. Remdesivir in adults with severe COVID-19: a randomised, double-blind, placebo-controlled, multicentre trial. Lancet 2020;395:1569–78. PubMed doi:10.1016/S0140-6736(20)31022-9
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S0140-6736(20)31022-9&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32423584&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F11%2F18%2F2020.11.16.20232876.atom) 

34. 34.Zheng F, Zhou Y, Zhou Z, et al. A Novel Protein Drug, Novaferon, as the Potential Antiviral Drug for COVID-19. medRxiv [Preprint] 2020. doi:10.1101/2020.04.24.20077735
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoibWVkcnhpdiI7czo1OiJyZXNpZCI7czoyMToiMjAyMC4wNC4yNC4yMDA3NzczNXYxIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjAvMTEvMTgvMjAyMC4xMS4xNi4yMDIzMjg3Ni5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 

35. 35.Eljaaly K, Alireza KH, Alshehri S, Al-Tawfiq JA. Hydroxychloroquine safety: A meta-analysis of randomized controlled trials. Travel Medicine and Infectious Disease. 2020 Jul;36:101812.
    
    

36. 36.Hill A, Balkin A. Risk factors for gastrointestinal adverse events in HIV treated and untreated patients. AIDS Rev. 2009 Mar;11(1):30–8.
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=19290032&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F11%2F18%2F2020.11.16.20232876.atom) 
    
    [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000265354000004&link_type=ISI) 

37. 37.Bhattacharyya A, Kumar S, Sarma P, Kaur H, Prajapat M, Shekhar N, et al. Safety and efficacy of lopinavir/ritonavir combination in COVID-19: A systematic review, meta-analysis, and meta-regression analysis. Indian J Pharmacol. 2020 Aug;52(4):313–23.
    
    

38. 38.Liu W, Zhou P, Chen K, Ye Z, Liu F, Li X, et al. Efficacy and safety of antiviral treatment for COVID-19 from evidence in studies of SARS-CoV-2 and other acute viral infections: a systematic review and meta-analysis. CMAJ. 2020 Jul 6;192(27):E734–44.
    
    [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NDoiY21haiI7czo1OiJyZXNpZCI7czoxMToiMTkyLzI3L0U3MzQiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMC8xMS8xOC8yMDIwLjExLjE2LjIwMjMyODc2LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 

39. 39.Das RR, Jaiswal N, Dev N, Jaiswal N, Naik SS, Sankar J. Efficacy and Safety of Anti-malarial Drugs (Chloroquine and Hydroxy-Chloroquine) in Treatment of COVID-19 Infection: A Systematic Review and Meta-Analysis. Front Med. 2020 Jul 29;7:482.
    
    

40. 40.Hernandez AV, Roman YM, Pasupuleti V, Barboza JJ, White CM. Hydroxychloroquine or Chloroquine for Treatment or Prophylaxis of COVID-19: A Living Systematic Review. Annals of Internal Medicine. 2020 Aug 18;173(4):287–96.
    
    

41. 41.Shrestha DB, Budhathoki P, Khadka S, Rawal E. Hydroxychloroquine with or without macrolide and standard of care versus standard of care alone for COVID-19 cases: a systematic review and meta-analysis [Internet]. In Review; 2020 Jul [cited 2020 Nov 11]. Available from: [https://www.researchsquare.com/article/rs-39092/v1](https://www.researchsquare.com/article/rs-39092/v1)
    
    

42. 42.Jankelson L, Karam G, Becker ML, Chinitz LA, Tsai M-C. QT prolongation, torsades de pointes, and sudden death with short courses of chloroquine or hydroxychloroquine as used in COVID-19: A systematic review. Heart Rhythm. 2020 Sep;17(9):1472–9.
    
    [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.hrthm.2020.05.008&link_type=DOI) 
    
    [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32438018&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F11%2F18%2F2020.11.16.20232876.atom) 

43. 43.Kim MS, An MH, Kim WJ, Hwang T-H. Comparative efficacy and safety of pharmacological interventions for the treatment of COVID-19: A systematic review and network meta-analysis of confounder-adjusted 20212 hospitalized patients [Internet]. Infectious Diseases (except HIV/AIDS); 2020 Jun [cited 2020 Nov 11]. Available from: [http://medrxiv.org/lookup/doi/10.1101/2020.06.15.20132407](http://medrxiv.org/lookup/doi/10.1101/2020.06.15.20132407)
    
    

44. 44.Yang T-H, Chou C-Y, Yang Y-F, Chien C-S, Yarmishyn AA, Yang T-Y, et al. Systematic Review and Meta-analysis of the Effectiveness and Safety of Hydroxychloroquine in Treating COVID-19 Patients. Journal of the Chinese Medical Association [Internet]. 2020 Sep 15 [cited 2020 Nov 11];Publish Ahead of Print. Available from: [https://journals.lww.com/10.1097/JCMA.0000000000000425](https://journals.lww.com/10.1097/JCMA.0000000000000425)
    
    

45. 45.Piscoya A, Ng-Sueng LF, Parra del Riego A, Cerna-Viacava R, Pasupuleti V, Roman YM, et al. Efficacy and harms of remdesivir for the treatment of COVID-19: a systematic review and meta-analysis [Internet]. Infectious Diseases (except HIV/AIDS); 2020 May [cited 2020 Nov 11]. Available from: [http://medrxiv.org/lookup/doi/10.1101/2020.05.26.20109595](http://medrxiv.org/lookup/doi/10.1101/2020.05.26.20109595)