PT  - JOURNAL ARTICLE
AU  - Rose, Christopher James
AU  - Ohm, Ingrid Kristine
AU  - Giske, Liv
AU  - Næss, Gunn Eva
AU  - Fretheim, Atle
TI  - Effect modification in network meta-analyses of treatments for relapsing refractory multiple myeloma (RRMM): systematic review, meta-analysis, and simulation
AID  - 10.1101/2022.05.13.22275047
DP  - 2022 Jan 01
TA  - medRxiv
PG  - 2022.05.13.22275047
4099  - http://medrxiv.org/content/early/2022/05/20/2022.05.13.22275047.short
4100  - http://medrxiv.org/content/early/2022/05/20/2022.05.13.22275047.full
AB  - Aims Network meta-analysis (NMA) has been used in several systematic reviews on relapsing refractory multiple myeloma (RRMM). NMAs have been questioned on the basis that effect modification may invalidate the underpinning assumptions. We aimed to systematically review and meta-analyze the evidence for effect modification of hazard ratios (HRs) for overall survival (OS) and progression-free survival (PFS) with respect to refractory status and number of treatment lines.Methods We extracted stratified HR estimates from 42 phase 2 and 3 randomized controlled trials (RCTs). We tested for within-study effect modification and used meta-analyses to estimate ratios of hazard ratios (RHRs) across trial under assumptions that strongly favor the modification hypothesis. RHR estimates were used in simulations to estimate how many NMA results would be expected to differ in the presence versus absence of effect modification.Results Most (95%) publications could have reported stratified estimates but only 14% (OS) and 43% (PFS) did. Within-study evidence for effect modification is very weak (p > 0.05 for 47 of 49 sets of stratified estimates). The largest RHR estimated was 1.31 (95% CI 1.16–1.47), for the modifying effect of refractory status on HR for PFS. Simulations suggest that, in the worst case, effect modification would result in 4.48% (95% CI 4.42%–4.53%) of NMA estimates differing statistically significantly in the presence versus absence of effect modification.Conclusions Effect modification is essentially undetectable in phase 2 and 3 trials. In the worst case, it is unlikely to affect more than about 5% of random-effects NMA estimates.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThe authors conducted this research under the employ of the Norwegian Institute of Public Health (Folkehelseinstituttet). The work was funded via Norway's National System for Managed Introduction of New Health Technologies within the Specialist Health Service (Nye Metoder). The funder had no role in the conduct of this work.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The study used only previously published data.I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesData and software are publicly available at: https://github.com/multinormal/fhi.rrmm-em.2022 The specific version used to generate the results presented herein is archived at Zenodo: https://doi.org/10.5281/zenodo.6545584 https://github.com/multinormal/fhi.rrmm-em.2022 https://doi.org/10.5281/zenodo.6545584