Vitamin C for the treatment of COVID-19: A living systematic review =================================================================== * Eduard Baladia * Ana Beatriz Pizarro * Gabriel Rada ## ABSTRACT **Objective** This living systematic review aims to provide a timely, rigorous and continuously updated summary of the evidence available on the role of vitamin C in the treatment of patients with COVID-19. **Data sources** We will conduct searches in PubMed/Medline, Embase, Cochrane Central Register of Controlled Trials (CENTRAL), grey literature and in a centralised repository in L·OVE (Living OVerview of Evidence). L·OVE is a platform that maps PICO questions to evidence from Epistemonikos database. In response to the COVID-19 emergency, L·OVE was adapted to expand the range of evidence it covers and customised to group all COVID-19 evidence in one place. The search will coverthe period until the day before submission to a journal. **Eligibility criteria for selecting studies and methods** We adapted an already published common protocol for multiple parallel systematic reviews to the specificities of this question. We will include randomised trials evaluating the effect of vitamin C, as monotherapy or in combination with other drugs, versus placebo or no treatment in patients with COVID-19. Randomised trials evaluating vitamin C in infections caused by other coronaviruses, such as MERS-CoV and SARS-CoV, and non-randomised studies in COVID-19 will be searched in case no direct evidence from randomised trials is found, or if the direct evidence provides low- or very low-certainty for critical outcomes. Two reviewers will independently screen each study for eligibility, extract data, and assess the risk of bias. We will pool the results using meta-analysis and will apply the GRADE system to assess the certainty of the evidence for each outcome. A living, web-based version of this review will be openly available during the COVID-19 pandemic. We will resubmit it every time the conclusions change or whenever there are substantial updates. **Ethics and dissemination** No ethics approval is considered necessary. The results of this review will be widely disseminated via peer-reviewed publications, social networks and traditional media. **PROSPERO Registration** Submitted to PROSPERO (awaiting ID allocation) **COVID-19 L OVE Working Group** Keywords * COVID-19 * severe acute respiratory syndrome coronavirus 2 * Coronavirus Infections * Systematic review * vitamin c * ascorbic acid ## INTRODUCTION COVID-19 is an infection caused by the SARS-CoV-2 coronavirus [1], It was first identified in Wuhan, China, on December 31, 2019 [2]; three months later, almost half a million cases of contagion had been identified across 197 countries [3], On March 11, 2020, WHO characterised the COVID-19 outbreak as a pandemic[1]. While the majority of cases result in mild symptoms, some might progress to pneumonia, acute respiratory distress syndrome and death [4],[5],[6]. The case fatality rate reported across countries, settings and age groups is highly variable, but it would range from about 0.5% to 10% [7], In hospitalized patients it has been reported to be higherthan 10% in some centres[8]. Vitamin C is one of the most commonly used interventions to treat respiratory infections, so the interest in testing its effects in the current pandemic is not surprising. The use of vitamin C began in the early 30s, and in the 70s it became widespread when the Nobel Prize winner, Linus Pauling, concluded that the use of vitamin C could relieve the common cold [9], Today, vitamin C is usually perceived as an effective, harmless and inexpensive therapeutic alternative. It is thought to improve the functioning of the immune system through various means, such as increasing the activity of phagocytes and lymphocytes, improving the response of T lymphocytes and augmenting interferon levels [10]. Although the evidence does not show that the intake of vitamin C translates into a clinically meaningful benefit on the treatment of respiratory infections [11], a role in critical patients, mediated by several mechanisms, has also been proposed [12]. Hence, research addressing the effect of vitamin C specifically for COVID-19 would add valuable information [13]. Using innovative and agile processes, taking advantage of technological tools, and resorting to the collective effort of several research groups, this living systematic review aims to provide a timely, rigorous and continuously updated summary of the evidence available on the role of vitamin C in preventing infection ortreating patients with COVID-19. ## METHODS ### Protocol and registration This manuscript complies with the ‘Preferred Reporting Items for Systematic reviews and Meta-Analyses’(PRISMA) guidelines for reporting systematic reviews and meta-analyses [14]. A protocol stating the shared objectives and methodology of multiple evidence syntheses (systematic reviews and overviews of systematic reviews) to be conducted in parallel for different questions relevant to COVID-19 was published elsewhere [15]. This protocol was adapted to the specificities of the question assessed in this review and submitted to PROSPERO (awaiting ID allocation) ### Search strategies #### Electronic searches Our literature search was devised by the team maintaining the L·OVE platform ([https://app.iloveevidence.com](https://app.iloveevidence.com)), using the following approach: 1. Identification of terms relevant to the population and intervention components of the search strategy, using Word2vec technology [16] to the corpus of documents available in Epistemonikos Database. 2. Discussion of terms with content and methods experts to identify relevant, irrelevant and missing terms. 3. Creation of a sensitive boolean strategy encompassing all the relevant terms 4. Iterative analysis of articles missed by the boolean strategy, and refinement of the strategy accordingly. Our main search source will be Epistemonikos database ([https://www.epistemonikos.org](https://www.epistemonikos.org)), a comprehensive database of systematic reviews and other types of evidence [17] that we supplemented with articles from multiple sources relevant to COVID-19 [18]. In sum, Epistemonikos Database acts as a central repository. Only articles fulfilling Epistemonikos criteria are visible by users. The remaining articles are only accessible for members of COVID-19 L·OVE Working Group. We will conduct additional searches using highly sensitive searches in PubMed/MEDLINE, the Cochrane Central Register of Controlled Trials (CENTRAL), Embase and the WHO International Clinical Trials Registry Platform. The searches will cover from the inception date of each database until the day before submission. No study design, publication status or language restriction will be applied to the searches in Epistemonikos or the additional searches. The following strategy will be used to search in Epistemonikos Database. We will adapt it to the syntax of other databases. (coronavir* OR coronovirus* OR “corona virus” OR “virus corona” OR “corono virus” OR “virus corono” OR hcov* OR “covid-19” OR covid19* OR “covid 19” OR “2019-nCoV” OR cv19* OR “cv-19” OR “cv 19” OR “n-cov” OR ncov* OR “sars-cov-2” OR “sars-cov2” OR (wuhan* AND (virus OR viruses OR viral) OR coronav*) OR (covid* AND (virus OR viruses OR viral)) OR “sars-cov” OR “sars cov” OR “sars-coronavirus” OR “severe acute respiratory syndrome” OR “mers-cov” OR “mers cov” OR “middle east respiratory syndrome” OR “middle-east respiratory syndrome” OR “covid-19-related” OR “SARS-CoV-2-related” OR “SARS-CoV2-related” OR “2019-nCoV-related” OR “cv-19-related” OR “n-cov-related”) AND ((“vitamin c” OR “vit c” OR “vitamin-c” OR “vitamins c” OR ascorb* OR “l-ascorbic”)) ### Other sources In order to identify articles that might have been missed in the electronic searches, we will do the following: 1. Screen the reference lists of other systematic reviews, and evaluate in full text all the articles they include. 2. Scan the reference lists of selected guidelines, narrative reviews and other documents. 3. Conduct cross-citation search in Google Scholar and Microsoft Academic, using each included study as the index reference. 4. Review websites specialised in COVID-19. 5. Email the contact authors of all the included studies to ask for additional publications or data on theirstudies, and for otherstudies in the topic. 6. Review the reference list of each included study. ## Eligibility criteria ### Types of studies We will preferentially include randomised trials. However, information from non-randomised studies will be used if there is no direct evidence from randomised trials or the certainty of evidence for the critical outcomes resulting from the randomised trials is graded as low- or very low, and the certainty provided by the non-randomised evidence grades higher than the one provided by the randomised evidence [19]. We will exclude studies evaluating the effects on animal models or in vitro conditions. ### Types of participants We will include trials assessing participants with COVID-19, as defined by the authors of the trials. Whenever we find substantial clinical heterogeneity on how the condition was defined, we will explore it using a sensitivity analysis. In case we find no direct evidence from randomised trials, or if the evidence from randomised trials provides low- or very low-certainty evidence for critical outcomes, we will include information from randomised trials evaluating vitamin C administration in other coronavirus infections, such as MERS-CoV or SARS-CoV infections[19]. ### Type of interventions The intervention of interest is vitamin C. We will not restrict our criteria to any dosage, duration, timing or route of administration. The comparison of interest will be placebo (intervention plus optimal treatment versus placebo plus optimal treatment) or no treatment plus optimal treatment versus optimal treatment. Trials assessing vitamin C plus other drugs will be eligible if the cointerventions are identical in both intervention and comparison groups. Trials evaluating vitamin C in combination with other active drugs versus placebo or no treatment will be also included. ### Type of outcomes We will not use the outcomes as an inclusion criteria during the selection process. Any article meeting all the criteria except for the outcome criterion will be preliminarily included and assessed in full text. We used the core outcome set COS-COVID [20], the existing guidelines and reviews and the judgement of the authors of this review as an input for selecting the primary and secondary outcomes, as well as to decide upon inclusion. The review team will revise this list of outcomes, in orderto incorporate ongoing efforts to define Core Outcomes Sets e.g. COVID-19 Core Outcomes [21]. * *Primary outcome* * All-cause mortality * *Secondary outcomes* * Mechanical ventilation * Extracorporeal membrane oxygenation * Length of hospital stay * Respiratory failure * Serious adverse events * Time to SARS-CoV-2 RT-PCR negativity * *Other outcomes* * Acute respiratory distress syndrome * Total adverse events Primary and secondary outcomes will be presented in the GRADE ‘Summary of Findings’tables, and a table with all the outcomes will be presented as an appendix [22]. ## Selection of studies The results of the literature search in Epistemonikos database will be automatically incorporated into the L·OVE platform (automated retrieval), where they will be de-duplicated by an algorithm comparing unique identifiers (database ID, DOI, trial registry ID), and citation details (i.e. author names, journal, year of publication, volume, number, pages, article title and article abstract). The additional searches will be uploaded to the screening software Collaboratron™ [23]. In both L·OVE platform and Collaboratron™, two researchers will independently screen the titles and abstracts yielded by the search against the inclusion criteria. We will obtain the full reports for all titles that appear to meet the inclusion criteria or require further analysis to decide about their inclusion. We will record the reasons for excluding trials in any stage of the search and outline the study selection process in a PRISMA flow diagram adapted for the purpose of this project. ### Extraction and management of data Using standardised forms, two reviewers will independently extract data from each included study. We will collect the following information: study design, setting, participant characteristics (including disease severity and age) and study eligibility criteria; details about the administered intervention and comparison, including dose and therapeutic scheme, duration, timing (i.e. time after diagnosis) and route of administration; the outcomes assessed and the time they were measured; the source of funding of the study and the conflicts of interest disclosed by the investigators; the risk of bias assessment for each individual study. We will resolve disagreements by discussion, and one arbiter will adjudicate unresolved disagreements. ### Risk of bias assessment The risk of bias for each randomised trial will be assessed using a ‘risk of bias’ tool (RoB 2.0: a revised tool to assess risk of bias in randomised trials) [24]. We will consider the effect of assignment to the intervention for this review. Two reviewers will independently assess five domains of bias for each outcome result of all reported outcomes and time points. These five domains are: bias due to (1) the randomisation process, (2) deviations from intended interventions (effects of assignment to interventions at baseline), (3) missing outcome data, (4) measurement of the outcome, and (5) selection of reported results. Answers to signalling questions and supporting information will lead to a domain-level judgement in the form of ‘Low risk of bias’, ‘Some concerns’, or ‘High risk of bias’. These domain-level judgements will inform an overall ‘risk of bias’judgement for each result. Discrepancies between review authors will be resolved by discussion to reach consensus. If necessary, a third review author will be consulted to achieve a decision. We will assess the risks of bias of other study designs with the ROBINS-I tool (ROBINS-I: Risk Of Bias In Non-randomised Studies of Interventions) [25], We will assess the following domains: bias due to confounding, bias in selection of participants into the study, bias in classification of interventions, bias due to deviations from intended interventions (effect of assignment to intervention), bias due to missing data, bias in measurement of outcomes and bias in the selection of the reported result. We will judge each domain as low risk, moderate risk, serious risk, critical risk, or no information, and evaluate individual bias items as described in ROBINS-I guidance. We will not considertime-varying confounding, as these confounders are not relevant in this setting [25]. We will consider the following factors as baseline potential confounders: * Age * Comorbidities(e.g. cardiovascular disease, renal disease, eye disease, liver disease) * Co-interventions * Severity, as defined by the authors (i.e respiratory failure vs respiratory distress syndrome vs ICU requirement). ### Measures of treatment effect For dichotomous outcomes, we will express the estimate of treatment effect of an intervention as risk ratios (RR) or odds ratios (OR) along with 95% confidence intervals (CI). For continuous outcomes, we will use mean difference and standard deviation (SD) to summarise the data using a 95% CI. Whenever continuous outcomes are measured using different scales, the treatment effect will be expressed as a standardised mean difference (SMD) with 95% CI. When possible, we will multiply the SMD by a standard deviation that is representative from the pooled studies, for example, the SD from a well-known scale used by several of the studies included in the analysis on which the result is based. In cases where the minimally important difference (MID) is known, we will also present continuous outcomes as MID units or inform the results as the difference in the proportion of patients achieving a minimal important effect between intervention and control [26]. Then, these results will be displayed on the ‘Summary of Findings Table’ as mean difference [26]. ### Strategy for data synthesis If we include more than one trial we will conduct meta-analysis for studies clinically homogeneous using RevMan 5 [27], using the inverse variance method with random effects model. For any outcomes where data are insufficient to calculate an effect estimate, a narrative synthesis will be presented. ### Subgroup and sensitivity analysis We will perform subgroup analysis according to the definition of severe COVID-19 infection (i.e respiratory failure vs respiratory distress syndrome vs ICU requirement). In case we identify significant differences between subgroups (test for interaction <0.05) we will report the results of individual subgroups separately. We will perform sensitivity analysis excluding high risk of bias studies, and if non-randomised studies are used, excluding studies that did not report adjusted estimates. In cases where the primary analysis effect estimates and the sensitivity analysis effect estimates significantly differ we will either present the low risk of bias — adjusted sensitivity analysis estimates — or present the primary analysis estimates but downgrading the certainty of the evidence because of risk of bias. ### Assessment of certainty of evidence The certainty of the evidence for all outcomes will be judged using the Grading of Recommendations Assessment, Development and Evaluation working group methodology (GRADE Working Group) [28], across the domains of risk of bias, consistency, directness, precision and reporting bias. Certainty will be adjudicated as high, moderate, low or very low. For the main comparisons and outcomes, we will prepare Summary of Findings (SoF) tables [22],[26] and also interactive Summary of Finding tables ([http://isof.epistemonikos.org/](http://isof.epistemonikos.org/)). A SoF table with all the comparisons and outcomes will be presented as an appendix. ### Living evidence synthesis An artificial intelligence algorithm deployed in the Coronavirus/COVID-19 topic of the L·OVE platform ([https://app.iloveevidence.com/loves/5e6fdb9669c00e4ac072701d](https://app.iloveevidence.com/loves/5e6fdb9669c00e4ac072701d)) will provide instant notification of articles with a high likelihood to be eligible. The authors will review these and will decide upon inclusion, and will update the living web version of the review accordingly. We will consider resubmission to a journal if there is a change in the direction of the effect on the critical outcomes or a substantial modification to the certainty of the evidence. This review is part of a larger project set up to produce multiple parallel systematic reviews relevant to COVID-19 [15]. ## Data Availability We state the availability of all data referred to in the manuscript. ## NOTES ## Roles and contributions GR conceived the common protocol for all the reviews being conducted by the COVID-19 L·OVE Working Group. GR drafted the manuscript, and all other authors contributed to it. The corresponding author is the guarantor and declares that all authors meet authorship criteria and that no other authors meeting the criteria have been omitted. The COVID-19 L·OVE Working Group was created by Epistemonikos and a number of expert teams in order to provide decision makers with the best evidence related to COVID-19. Up-to-date information about the group and its member organisations is available here: epistemonikos.cl/workina-group ## Competing interests All authors declare no financial relationships with any organisation that might have a real or perceived interest in this work. There are no other relationships or activities that could have influenced the submitted work. ## Funding This project was not commissioned by any organisation and did not receive external funding. Epistemonikos Foundation is providing training, support and tools at no cost for all the members of the COVID-19 L·OVE Working Group. ## PROSPERO registration This protocol has been submitted (awaiting PROSPERO ID allocation). ## Ethics As researchers will not access information that could lead to the identification of an individual participant, obtaining ethical approval was waived. ## Data sharing All data related to the project will be available. Epistemonikos Foundation will grant access to data. ## Acknowledgements The members of the COVID-19 L·OVE Working Group and Epistemonikos Foundation have made it possible to build the systems and compile the information needed by this project. Epistemonikos is a collaborative effort, based on the ongoing volunteer work of over a thousand contributors since 2012. * Received April 28, 2020. * Revision received May 29, 2020. * Accepted May 30, 2020. * © 2020, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/) ## REFERENCES 1. 1.World Health Organization. Director-General’s remarks at the media briefing on 2019-nCoV on 11 February 2020 [Internet], World Health Organization; 2020 [Accessed on April 8, 2020]. Available from: [https://www.who.int/dq/speeches/detail/who-director-qeneral-s-remarks-at-the-meciia-briefinq-on-2019-ncov-on-11-february-2020](https://www.who.int/dq/speeches/detail/who-director-qeneral-s-remarks-at-the-meciia-briefinq-on-2019-ncov-on-11-february-2020). 2. 2.Hui DS, I Azhar E, Madani TA, Ntoumi F, Kock R, Dar O, et al. The continuing 2019-nCoV epidemic threat of novel coronaviruses to global health - The latest 2019 novel coronavirus outbreak in Wuhan, China. Int J Infect Dis. 2020 Feb;91: 264-66. Available from: doi: 10.1016/j.ijid.2020.01.009. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.ijid.2020.01.009&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=31953166&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F05%2F30%2F2020.04.28.20083360.atom) 3. 3.Dong E, Du H, Gardner L. An interactive web-based dashboard to track COVID-19 in real time. Lancet Infect Dis. 2020 Feb 19. Available from: doi: 10.1016/S1473-3099(20)30120-1. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S1473-3099(20)30120-1&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32087114&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F05%2F30%2F2020.04.28.20083360.atom) 4. 4.Guan WJ, Ni ZY, Hu Y, Liang WH, Ou CQ, He JX, et al. Clinical Characteristics of Coronavirus Disease 2019 in China. N Engl J Med. 2020 Feb 28. Available from: doi:10.1056/NEJMoa2002032. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1056/NEJMoa2002032&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32109013&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F05%2F30%2F2020.04.28.20083360.atom) 5. 5.Tavakoli A, Vahdat K, Keshavarz M. Novel Coronavirus Disease 2019 (COVID-19): An Emerging Infectious Disease in the 21st Century. BPUMS. 2020;22(6):432–450. Available from: doi:10.29252/ismj.22.6.432. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.29252/ismj.22.6.432&link_type=DOI) 6. 6.Li LQ, Huang T, Wang YQ, Wang ZP, Liang Y, Huang TB, et al. 2019 novel coronavirus patients’ clinical characteristics, discharge rate and fatality rate of meta-analysis. J Med Virol. 2020 Mar 12. Available from: doi:10.1002/jmv.25757. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1002/jmv.25757&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32162702&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F05%2F30%2F2020.04.28.20083360.atom) 7. 7.Global Covid-19 Case Fatality Rates [Internet], UK: Centre for Evidence-Based Evidence. [Accessed on April 8, 2020]. Available from: [https://www.cebm.net/covid-19/alobal-covid-19-case-fatalitv-rates/](https://www.cebm.net/covid-19/alobal-covid-19-case-fatalitv-rates/) 8. 8.Rodriguez-Morales AJ, Cardona-Ospina JA, Gutierrez-Ocampo E, Villamizar-Pena R, Holguin-Rivera Y, Escalera-Antezana JP, et al. Clinical, laboratory and imaging features of COVID-19: A systematic review and meta-analysis. Travel Med Infect Dis. 2020 Mar 13; 101623. Available from: doi: 10.1016/j.tmaid.2020.101623. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.tmaid.2020.101623&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=32179124&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F05%2F30%2F2020.04.28.20083360.atom) 9. 9.Heikkinen T, Jarvinen A. The common cold. 2003 Jan 4;361 (9351): 51–9. Available from: doi: 10.1016/S0140-6736(03)12162-9. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S0140-6736(03)12162-9&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=12517470&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F05%2F30%2F2020.04.28.20083360.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000180191600024&link_type=ISI) 10. 10.Hemila H. Vitamin C intake and susceptibility to the common cold. Br J Nutr. 1997 Jan;77(1):59–72. Available from: doi: 10.1017/s0007114500002889. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1017/s0007114500002889&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=9059230&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F05%2F30%2F2020.04.28.20083360.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1997WH98500007&link_type=ISI) 11. 11.Gómez E, Quidel s, Bravo-Soto G, Ortigoza A. Does vitamin C prevent the common cold? Medwave. 2018 Aug 6;18(4):e7235. Available from: doi: 10.5867/medwave.2018.04.7236g. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.5867/medwave.2018.04.7236&link_type=DOI) 12. 12.Hemila H, Chalker E. Vitamin C can shorten the length of stay in the ICU: A meta-analysis. Nutrients. 2019;11(4). Available from: doi:10.3390/nu11040708. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.3390/nu11040708&link_type=DOI) 13. 13.Carr AC. A new clinical trial to test high-dose vitamin C in patients with COVID-19. Crit Care. 2020 Apr7;24(1):133. Available from: doi: 10.1186/s13054-020-02851-4. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/s13054-020-02851-4&link_type=DOI) 14. 14.Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015 Jan 1;4:1. Available from: doi:10.1186/2046-4053-4-1. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/2046-4053-4-1&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25554246&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F05%2F30%2F2020.04.28.20083360.atom) 15. 15.Rada G, Verdugo-Paiva F, Avila C, Morel-Marambio M, Bravo-Jeria R, Pesce F, et al. COVID-19 L·OVE Working Group. Evidence synthesis relevant to COVID-19: a protocol for multiple systematic reviews and overviews of systematic reviews. Medwave 2020;20(3):e7867. Available from: doi:10.5867/medwave.2020.03.7867. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.5867/medwave.2020.03.7867&link_type=DOI) 16. 16.Github repository [Internet], [Accessed on April 8, 2020], Available from: [https://aithub.com/dperezrada/kevwords2vec](https://aithub.com/dperezrada/kevwords2vec) 17. 17.Epistemonikos Database Methods [Internet], Santiago: Epistemonikos Foundation [Accessed on April 8, 2020]. Available from: [https://www.epistemonikos.org/en/about\_us/methods](https://www.epistemonikos.org/en/about_us/methods) 18. 18.Methods for the special L·OVE of Coronavirus infection [Internet], Santiago: Epistemonikos Foundation [Accessed on April 8, 2020], Available from: [https://app.iloveevidence.com/covid-19](https://app.iloveevidence.com/covid-19) 19. 19.Schunemann HJ, Cuello C, Akl EA, Mustafa RA, Meerpohl JJ, Thayer K, et al; GRADE Working Group. GRADE guidelines: 18. How ROBINS-I and other tools to assess risk of bias in nonrandomized studies should be used to rate the certainty of a body of evidence. J Clin Epidemiol. 2019 Jul;111:105–114. Available from: doi:10.1016/j.jclinepi.2018.01.012. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jclinepi.2018.01.012&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F05%2F30%2F2020.04.28.20083360.atom) 20. 20.Jin X, Pang B, Zhang J, Liu Q, Yang Z, Feng J, et al. Core Outcome Set for Clinical Trials on Coronavirus Disease 2019 (COS-COVID). Engineering (Beijing). 2020 Mar 18. Available from: doi:10.1016/j.eng.2020.03.002. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.eng.2020.03.002&link_type=DOI) 21. 21.COVID-19 Core Outcomes [Internet], [Accessed on April 8, 2020], Available from: [https://www.covid-19-cos.org/](https://www.covid-19-cos.org/) 22. 22.Guyatt GH, Oxman AD, Santesso N, Helfand M, Vist G, Kunz R, Brozek J, et al. GRADE guidelines: 12. Preparing summary of findings tables-binary outcomes. J Clin Epidemiol. 2013 Feb;66(2): 158–72. Available from: doi: 10.1016/j.jclinepi.2012.01.012. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jclinepi.2012.01.012&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=22609141&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F05%2F30%2F2020.04.28.20083360.atom) 23. 23.Epistemonikos Foundation. Collaboratron™ [Software], 2020. Available From: [https://collaboratron.epistelab.eom/#/login](https://collaboratron.epistelab.eom/#/login) 24. 24.Sterne JAC, Savovic J, Page MJ, Elbers RG, Blencowe NS, Boutron I, et al. RoB 2: a revised tool for assessing risk of bias in randomised trials. BMJ. 2019 Aug 28;366:14898. Available from: doi:10.1136/bmj.14898. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1136/bmj.14898&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F05%2F30%2F2020.04.28.20083360.atom) 25. 25.Sterne JA, Hernan MA, Reeves BC, Savovic J, Berkman ND, Viswanathan M, et al. ROBINS-I: a tool for assessing risk of bias in non-randomised studies of interventions. BMJ. 2016 Oct 12;355:i4919. Available from: doi: 10.1136/bmj.i4919. [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE4OiIzNTUvb2N0MTJfMTEvaTQ5MTkiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMC8wNS8zMC8yMDIwLjA0LjI4LjIwMDgzMzYwLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 26. 26.Guyatt GH, Thorlund K, Oxman AD, Walter SD, Patrick D, Furukawa TA, et al. GRADE guidelines: 13. Preparing summary of findings tables and evidence profiles-continuous outcomes. J Clin Epidemiol. 2013 Feb;66(2): 173–83. Available from: doi: 10.1016/j.jclinepi.2012.08.001. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/j.jclinepi.2012.08.001&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23116689&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F05%2F30%2F2020.04.28.20083360.atom) 27. 27.Review Manager (RevMan). Version 5.3.5 Copenhagen: The Nordic Cochrane Centre, The Cochrane Collaboration, 2014. [Software], Available from: [https://revman.cochrane.org/#/mvReviews](https://revman.cochrane.org/#/mvReviews) 28. 28.Guyatt GH, Oxman AD, Vist GE, Kunz R, Falck-Ytter Y, Alonso-Coello P, et al; GRADE Working Group. GRADE: an emerging consensus on rating quality of evidence and strength of recommendations. BMJ. 2008 Apr 26;336(7650):924–6. Available from: doi:10.1136/bmj.39489.470347. [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjEyOiIzMzYvNzY1MC85MjQiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMC8wNS8zMC8yMDIwLjA0LjI4LjIwMDgzMzYwLmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==)