PT  - JOURNAL ARTICLE
AU  - Hazewinkel, Audinga-Dea
AU  - Tilling, Kate
AU  - Wade, Kaitlin H.
AU  - Palmer, Tom
TI  - Treatment group outcome variance difference after dropout as an indicator of missing-not-at-random bias in randomized clinical trials
AID  - 10.1101/2022.04.15.22273918
DP  - 2022 Jan 01
TA  - medRxiv
PG  - 2022.04.15.22273918
4099  - http://medrxiv.org/content/early/2022/04/18/2022.04.15.22273918.short
4100  - http://medrxiv.org/content/early/2022/04/18/2022.04.15.22273918.full
AB  - Randomized controlled trials (RCTs) are considered the gold standard for assessing the causal effect of an exposure on an outcome, but are vulnerable to bias from missing data. When outcomes are missing not at random (MNAR), estimates from complete case analysis (CCA) will be biased. There is no statistical test for distinguishing between outcomes missing at random (MAR) and MNAR, and current strategies rely on comparing dropout proportions and covariate distributions, and using auxiliary information to assess the likelihood of dropout being associated with the outcome. We propose using the observed variance difference across treatment groups as a tool for assessing the risk of dropout being MNAR. In an RCT, at randomization, the distributions of all covariates should be equal in the populations randomized to the intervention and control arms. Under the assumption of homogeneous treatment effects, the variance of the outcome will also be equal in the two populations over the course of followup. We show that under MAR dropout, the observed outcome variances, conditional on the variables included in the model, are equal across groups, while MNAR dropout may result in unequal variances. Consequently, unequal observed conditional group variances are an indicator of MNAR dropout and possible bias of the estimated treatment effect. Heterogeneity of treatment effect affects the intervention group variance, and is another potential cause of observing different outcome variances. We show that, for longitudinal data, we can isolate the effect of MNAR outcome-dependent dropout by considering the variance difference at baseline in the same set of patients that are observed at final follow-up. We illustrate our method in simulation and in applications using individual-level patient data and summary data.Competing Interest StatementThe authors have declared no competing interest.Clinical TrialISRCTN96537534Funding StatementAH, TP and KT were supported by the Integrative Epidemiology Unit, which receives funding from the UK Medical Research Council and the University of Bristol (MC\_UU\_00011/3). KHW is affiliated to the Integrative Cancer Epidemiology Programme (ICEP), and works within the Medical Research Council Integrative Epidemiology UnitAuthor DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:This study used individual-level patient data from a randomized controlled trial investigating the benefit of an acupuncture treatment policy for patients with chronic headaches (ISRCTN96537534), available from https://www.causeweb.org/tshs/acupuncture/.I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe individual-level patient data used in this study are available from https://www.causeweb.org/tshs/acupuncture/. https://www.causeweb.org/tshs/acupuncture/