PT  - JOURNAL ARTICLE
AU  - Jung, Richard G.
AU  - Di Santo, Pietro
AU  - Clifford, Cole
AU  - Prosperi-Porta, Graeme
AU  - Skanes, Stephanie
AU  - Hung, Annie
AU  - Parlow, Simon
AU  - Visintini, Sarah
AU  - Ramirez, F. Daniel
AU  - Simard, Trevor
AU  - Hibbert, Benjamin
TI  - Methodological Rigor in COVID-19 Clinical Research – A Systematic Review and Case-Control Analysis
AID  - 10.1101/2020.07.02.20145102
DP  - 2020 Jan 01
TA  - medRxiv
PG  - 2020.07.02.20145102
4099  - http://medrxiv.org/content/early/2020/07/03/2020.07.02.20145102.short
4100  - http://medrxiv.org/content/early/2020/07/03/2020.07.02.20145102.full
AB  - Objective To systematically evaluate the quality of reporting of currently available COVID-19 studies compared to historical controls.Design A systematic review and case-control analysisData sources MEDLINE, Embase, and Cochrane Central Register of Controlled Trials until May 14, 2020Study selection All original clinical literature evaluating COVID-19 or SARS-CoV2 were identified and 1:1 historical control of the same study type in the same published journal was matched from the previous yearData extraction Two independent reviewers screened titles, abstracts, and full-texts and independently assessed methodological quality using Cochrane Risk of Bias Tool, Newcastle- Ottawa Scale, QUADAS-2 Score, or case series checklist.Results 9895 titles and abstracts were screened and 686 COVID-19 articles were included in the final analysis in which 380 (55.4%) were case series, 199 (29.0%) were cohort, 63 (9.2%) were diagnostic, 38 (5.5%) were case-control, and 6 (0.9%) were randomized controlled trials. Overall, high quality/low-bias studies represented less than half of COVID-19 articles - 49.0% of case series, 43.9% of cohort, 31.6% of case-control, and 6.4% of diagnostic studies. We matched 539 control articles to COVID-19 articles from the same journal in the previous year for a final analysis of 1078 articles. The median time to acceptance was 13.0 (IQR, 5.0-25.0) days in COVID-19 articles vs. 110.0 (IQR, 71.0-156.0) days in control articles (p<0.0001). Overall, methodological quality was lower in COVID-19 articles with 220 COVID-19 articles of high quality (41.0%) vs. 392 control articles (73.3%, p<0.0001) with similar results when stratified by study design. In both unadjusted and adjusted logistic regression, COVID-19 articles were associated with lower methodological quality (odds ratio, 0.25; 95% CI, 0.20 to 0.33, p<0.0001).Conclusion Currently published COVID-19 studies were accepted more quickly and were found to be of lower methodological quality than comparative studies published in the same journal. Given the implications of these studies to medical decision making and government policy, greater effort to appropriately weigh the existing evidence in the context of emerging high-quality research is needed.Study registration PROSPERO: CRD42020187318Competing Interest StatementAll authors have completed the ICMJE Unified Competing Interest form (available on request from the corresponding author) and declare: no support from any organisation for the submitted work; no financial relationships with any organisations that might have an interest in the submitted work in the previous three years, no other relationships or activities that could appear to have influenced the submitted work. B. Hibbert reports funding as a clinical trial investigator from Abbott, Boston Scientific, and Edwards Lifesciences outside of the submitted work.Funding StatementThis study received no specific funding or grant from any agency in the public, commercial, or not-for-profit sectors. R. Jung was supported by the Vanier CIHR Canada Graduate Scholarship. F.D. Ramirez was supported by a CIHR Banting Postdoctoral Fellowship and a Royal College of Physicians and Surgeons of Canada Detweiler Travelling Fellowship. The funder/sponsor(s) had no role in design and conduct of the study, collection, analysis, and interpretation of the data.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:N/A.All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe statistical code and the entire dataset will be provided for transparency upon publication.COVID-19Coronavirus disease 2019NOSNewcastle-Ottawa ScaleORodds ratioRCTrandomized controlled trialSARS-CoV-2Severe acute respiratory syndrome coronavirus 2