Abstract
Background When measuring latent traits, such as those used in psychology and psychiatry, it can be unclear whether the instruments used are measuring different concepts. This issue is particularly important in context of mediation analysis, since for a sound mediation hypothesis the mediator and outcome should be distinct. We sought to assess the extent of measurement overlap between mediators and outcomes in the PACE trial (n=640).
Methods Potential measurement overlap was assessed using generalised linear latent variable models where confirmatory factor models quantified the extent to which the addition of cross-loading items resulted in significant improvements in model fit.
Results Out of 26 mediator-outcome pairs considered, only six showed evidence of cross-loading items, supporting the suggestion that mediator and outcome constructs in the PACE trial were conceptually distinct.
Conclusions This study highlights the importance of assessing measurement overlap in mediation analyses with latent traits to ensure mediator and outcome instruments are distinct.
Competing Interest Statement
TC has received royalties from Sheldon Press and Constable and Robinson. Funding for the PACE trial was provided by the Medical Research Council, Department for Health for England, The Scottish Chief Scientist Office, and the Department for Work and Pensions. The authors declare no other conflicts of interest.
Funding Statement
This paper represents independent research part funded by the National Institute for Health Research (NIHR) Biomedical Research Centre (BRC) at South London and Maudsley NHS Foundation Trust and King's College London and Applied Research Collaboration South London (NIHR ARC South London) at King's College Hospital NHS Foundation Trust. The views expressed are those of the author(s) and not necessarily those of the NHS, the NIHR or the Department of Health and Social Care. EC and SV are fully funded by the NIHR BRC; TC is part-funded by the NIHR BRC; KG is part-funded by the BRC and ARC.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
This study uses data that have previously been published (Chalder et al. 2015; Ryan et al. 2017). The original PACE study was approved by the West Midlands Multicentre Research Ethics Committee (MREC 02/7/89).
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
List of abbreviations
- BDI
- Beck Depression Inventory;
- CBT
- Cognitive behavioural therapy;
- CFA
- Confirmatory Factor Model;
- CFI
- Comparative Fit Index;
- CFQ
- Chalder Fatigue Questionnaire;
- DIF
- Differential Item Functioning;
- EFA
- Exploratory Factor Analysis
- HAM-D
- Hamilton Rating Scale for Depression;
- MIMIC
- Multiple Indicators Multiple Causes
- PF
- Physical function;
- RMSEA
- Root Mean Square Error of Approximation;
- RSS
- Rumination on Sadness Scale;
- SF-36
- Medical Outcomes Study Short Form Health Survey;
- WLSMV
- Robust Weighted Least Squares.
The Chan Zuckerberg Initiative, Cold Spring Harbor Laboratory, the Sergey Brin Family Foundation, California Institute of Technology, Centre National de la Recherche Scientifique, Fred Hutchinson Cancer Center, Imperial College London, Massachusetts Institute of Technology, Stanford University, University of Washington, and Vrije Universiteit Amsterdam.