RT Journal Article
SR Electronic
T1 Strength of Statistical Evidence for the Efficacy of Cancer Drugs: A Bayesian Re-Analysis of Randomized Trials Supporting FDA Approval
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2023.06.30.23292074
DO 10.1101/2023.06.30.23292074
A1 Pittelkow, Merle-Marie
A1 Linde, Maximilian
A1 de Vries, Ymkje Anna
A1 Hemkens, Lars G.
A1 Schmitt, Andreas M.
A1 Meijer, Rob R.
A1 van Ravenzwaaij, Don
YR 2024
UL http://medrxiv.org/content/early/2024/07/10/2023.06.30.23292074.abstract
AB Objective To quantify the strength of statistical evidence of randomised controlled trials (RCTs) for novel cancer drugs approved by the Food and Drug Administration (FDA) in the last two decades.Study Design and Setting We used data on overall survival (OS), progression-free survival (PFS), and tumour response (TR) for novel cancer drugs approved for the first time by the FDA between January 2000 and December 2020. We assessed strength of statistical evidence by calculating Bayes Factors (BFs) for all available endpoints, and we pooled evidence using Bayesian fixed-effect meta-analysis for indications approved based on two RCTs. Strength of statistical evidence was compared between endpoints, approval pathways, lines of treatment, and types of cancer.Results We analysed the available data from 82 RCTs corresponding to 68 indications supported by a single RCT and seven indications supported by two RCTs. Median strength of statistical evidence was ambiguous for OS (BF = 1.9; IQR 0.5-14.5), and strong for PFS (BF = 24,767.8; IQR 109.0-7.3*106) and TR (BF = 113.9; IQR 3.0-547,100). Overall, 44 indications (58.7%) were approved without clear statistical evidence for OS improvements and seven indications (9.3%) were approved without statistical evidence for improvements on any endpoint. Strength of statistical evidence was lower for accelerated approval compared to non-accelerated approval across all three endpoints. No meaningful differences were observed for line of treatment and cancer type.Limitations This analysis is limited to statistical evidence. We did not consider non-statistical factors (e.g., risk of bias, quality of the evidence).Conclusion BFs offer novel insights into the strength of statistical evidence underlying cancer drug approvals. Most novel cancer drugs lack strong statistical evidence that they improve OS, and a few lack statistical evidence for efficacy altogether. These cases require a transparent and clear explanation. When evidence is ambiguous, additional post-marketing trials could reduce uncertainty.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThis project is funded by an NWO Vidi grant to D. van Ravenzwaaij (016.Vidi.188.001).Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:This study involved publicly available trial-level data available at the FDA (https://www.accessdata.fda.gov/scripts/cder/daf/index.cfm). No ethical approval was needed.I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesThe data that support the findings of this study are available from https://ceit-cancer.org/ and the OSF framework (https://osf.io/4uhz7).https://ceit-cancer.org/https://osf.io/4uhz7