ABSTRACT
Background The coronavirus disease (Covid-19) pandemic has produced a large number of clinical trial reports with unprecedented rapidity, raising concerns about methodological quality and potential for research waste.
Objectives To describe the characteristics of randomized clinical trials (RCTs) investigating prophylaxis or treatment of Covid-19 infection and examine the effect of trial characteristics on whether the study reported a statistically significant effect on the primary outcome(s).
Study Design Meta-epidemiological study of Covid-19 treatment and prophylaxis RCTs.
Eligibility criteria English-language RCTs (peer-reviewed or preprint) that evaluated pharmacologic agents or blood products compared to standard care, placebo, or an active comparator among participants with suspected or confirmed Covid-19 or at risk for Covid-19. We excluded trials of vaccines or traditional herbal medicines.
Information sources We searched 25 databases in the US Centre for Disease Control Downloadable Database from January 1 to October 21, 2020.
Trial appraisal and synthesis methods We extracted trial characteristics including number of centres, funding sources (industry versus non-industry), and sample size. We assessed risk of bias (RoB) using the modified Cochrane RoB 2.0 Tool. We used descriptive statistics to summarize trial characteristics and logistic regression to evaluate the association between RoB due to the randomization process, centre status (single vs. multicentre), funding source, and sample size, and statistically significant effect in the primary outcome.
Results We included 91 RCTs (46,802 participants) evaluating Covid-19 therapeutic drugs (n = 76), blood products (n = 9) or prophylactic drugs (n = 6). Of these, 40 (44%) were single-centre, 23 (25.3%) enrolled < 50 patients, and 28 (30.8%) received industry funding. RoB varied across trials, with high or probably high overall RoB in 75 (82.4%) trials, most frequently due to deviations from the intended protocol (including blinding) and randomization processes. Thirty-eight trials (41.8%) found a statistically significant effect in the primary outcome. RoB due randomization (odds ratio [OR] 3.77, 95% confidence interval [CI], 1.47 to 9.72) and single centre trials (OR 3.15, 95% CI, 1.25 to 7.97) were associated with higher likelihood of finding a statistically significant effect.
Conclusions There was high variability in RoB amongst Covid-19 trials. RoB attributed to the randomization process and single centre status were associated with a three-fold increase in the odds of finding a statistically significant effect. Researchers, funders, and knowledge users should remain cognizant of the impact of study characteristics, including RoB, on trial results when designing, conducting, and appraising Covid-19 trials.
Competing Interest Statement
All authors have completed the ICMJE uniform disclosure form at www.icmje.org/coi_disclosure.pdf (available on request from the corresponding author) and declare: support from the Canadian Institutes of Health Research. B.R. is also supported by a Hamilton Health Sciences Early Career Research Award; L.G. reports grants from Ministry of Science and Technology of China, outside the submitted work; no other relationships or activities that could appear to have influenced the submitted work.
Funding Statement
This is a substudy of the living network meta-analysis, supported by the Canadian Institutes of Health Research (grant CIHR-IRSC: 0579001321). Dr. Rochwerg is supported by a Hamilton Health Sciences Early Career Research Award. The funders had no role in the conduct of this study.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
Western Research Ethics Board
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Data Availability
No additional data available.
