Abstract
Background Interest in internet-based patient reported outcome measure (PROM) collection is increasing. The NHS myHealthE (MHE) web-based monitoring system was developed to address the limitations of paper-based PROM completion. MHE provides a simple and secure way for families accessing Child and Adolescent Mental Health Services to report clinical information and track their child’s progress. This study aimed to assess whether MHE improves the completion of the Strengths and Difficulties Questionnaire (SDQ) compared with paper collection. Secondary objectives were to explore caregiver satisfaction and application acceptability.
Methods A twelve-week single-blinded randomised controlled feasibility pilot trial of MHE was conducted with 196 families accessing neurodevelopmental services in south London to examine whether electronic questionnaires are completed more readily than paper-based questionnaires over a 3-month period. Follow up process evaluation phone calls with a subset (n=8) of caregivers explored system satisfaction and usability.
Results MHE group assignment was significantly associated with an increased probability of completing an SDQ-P in the study period (adjusted hazard ratio, (HR) 12.1, 95% CI 4.7-31.0; p= <0.001). Of those caregivers’ who received the MHE invitation (n=68) 69.1% completed an SDQ using the platform compared to 8.8% in the control group (n=68). The system was well received by caregivers, who cited numerous benefits of using MHE, for example, real time feedback and ease of completion.
Conclusions MHE holds promise for improving PROM completion rates. Research is needed to refine MHE, evaluate large scale MHE implementation, cost effectiveness and explore factors associated with differences in electronic questionnaire uptake.
Key practitioner messages
Patient reported outcome measures (PROMs) are considered an important tool for measuring treatment success and outcomes in healthcare systems.
Adherence to routine PROM guidance in Child and Adolescent Mental Health Services (CAMHS) remains low, largely driven by limitations associated with paper-based data collection.
Paperless monitoring systems (i.e., digital) as an alternative to traditional outcome measure delivery and collection are growing in healthcare settings.
Remote questionnaire completion using the myHealthE (MHE) system is feasible and acceptable to caregivers of children accessing CAMHS in South London, yielding a 60.3 % increase in Strengths and Difficulties questionnaire reporting compared to standard practice.
More research is required to understand whether MHE implementation affords similar improvements in remote PROM completion at scale and whether electronic questionnaire uptake is equal for different socio-demographic and clinical populations.
Competing Interest Statement
The authors have declared no competing interest.
Clinical Trial
ISRCTN22581393
Funding Statement
Z.I. M.P. R.S. M.H. A.P. R.J.B.D. E.S. and J.D. are affiliated with the National Institute of Health Research (NIHR) Biomedical Research Centre for Mental Health (BRC) Nucleus at the South London and Maudsley (SLaM) NHS Foundation Trust and Institute of Psychiatry Psychology and Neuroscience (IoPPN) Kings College London (KCL). Additionally the Clinical Record Interactive Search (CRIS) is supported by the NIHR BRC at the SLaM NHS Foundation Trust and KCL. A.C.M is supported by the Guys and St Thomas (GSST) Charity. Z.I. and R.J.B.D. are additionally supported by the NIHR University College London Hospitals BRC. R.J.B.D. is further supported by (1) Health Data Research (HDR) UK and (2) The BigData@Heart Consortium under grant agreement No. 116074. M.H. reports funding from the NIHR. A.S. is supported by the Intramural Research Program of the National Institute of Mental Health National Institutes of Health (NIH) (Grant No. ZIA-MH002957-01). R.S. is additionally part-funded by i) a Medical Research Council (MRC) Mental Health Data Pathfinder Award to Kings College London; ii) an NIHR Senior Investigator Award; iii) the NIHR Applied Research Collaboration South London (NIHR ARC South London) at Kings College Hospital NHS Foundation Trust. The views expressed are those of the authors and not necessarily those of the NIHR or the Department of Health and Social Care. M.H. declares funding from the Innovative Medicines Initiative for the RADAR-CNS consortium which includes contributions from Janssen MSD UCB Biogen and Lundbeck. A.P. is partially supported by the NIHR (NF-SI-0617-10120). E.S. is supported from the NIHR BRC at SLaM NHS Foundation Trust (IS‐BRC‐1215‐20018) the NIHR through a programme grant (RP‐PG‐1211‐20016) and Senior Investigator Award (NF‐SI‐0514‐10073 and NF‐SI‐0617‐10120) the European Union Innovative Medicines Initiative (EU‐IMI 115300) Autistica (7237) MRC (MR/R000832/1, MR/P019293/1) the Economic and Social Research Council (ESRC 003041/1) and GSST Charity (GSTT EF1150502) and the Maudsley Charity. J.D. is supported by NIHR Clinician Science Fellowship award (CS‐2018‐18‐ST2‐014) and has received support from a Medical Research Council (MRC) Clinical Research Training Fellowship (MR/L017105/1) and Psychiatry Research Trust Peggy Pollak Research Fellowship in Developmental Psychiatry.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
Approval for the trial was given by the South London and Maudsley NHS Foundation Trust CAMHS Clinical Audit, Service Evaluation and Quality Improvement Committee (approval date: 07/04/2017). Extraction and analysis of deidentified outcome data were carried out using the CRIS platform and security model approved by Oxford Research Ethics Committee C (reference 18/SC/0372)
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
Trial Registration: International Standard Randomized Controlled Trial Number (ISRCTN) 22581393; https://doi.org/10.1186/ISRCTN22581393
Conflict of Interest: None to declare.
Ethics statement Approval for the trial was given by the South London and Maudsley NHS Foundation Trust CAMHS Clinical Audit, Service Evaluation and Quality Improvement Committee (approval date: 07/04/2017). Extraction and analysis of deidentified outcome data were carried out using the CRIS platform and security model approved by Oxford Research Ethics Committee C (reference 18/SC/0372).
Data Availability
The data accessed by CRIS remain within an NHS firewall and governance is provided by a patient-led oversight committee. Access to data is restricted to honorary or substantive employees of the South London and Maudsley NHS Foundation Trust and governed by a local oversight committee who review and approve applications to extract and analyse data for research. Subject to these conditions, data access is encouraged and those interested should contact RS (robert.stewart@kcl.ac.uk), CRIS academic lead.
