RT Journal Article
SR Electronic
T1 Experience of Service Questionnaire (ESQ) in children and adolescents: factor structure, reliability, validity, item parameters and interpretability of the parent version for practical use in Greece
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2024.07.05.24309986
DO 10.1101/2024.07.05.24309986
A1 Kotsis, Konstantinos
A1 Mitropoulou, Andromachi
A1 Tzotzi, Alexandra
A1 Marchionatti, Lauro Estivalete
A1 Hoffmann, Mauricio Scopel
A1 Schafer, Julia Luiza
A1 Casella, Caio B.
A1 Simioni, André
A1 Papanikolaou, Katerina
A1 Basta, Maria
A1 Serdari, Aspasia
A1 Koumoula, Anastasia
A1 Salum, Giovanni Abrahão
YR 2024
UL http://medrxiv.org/content/early/2024/07/05/2024.07.05.24309986.abstract
AB Background Health systems need tools to assess patient’s experience of service, but existing tools lack reliability and validity assessment. Our aim is to investigate the factor structure, reliability, validity, item parameters and interpretability of the parent version of the Experience of Service Questionnaire (ESQ) for practical use in Greece.Methods A total of 265 caregivers that were using mental health services in Greece participated in this study as part of the Nationwide cross-sectional survey from the Child and Adolescent Mental Health Initiative (CAMHI). Confirmatory Factor Analysis was used to test factor structure. Reliability of all models were measured with omega coefficients. Tobit regression analysis was used to test for convergent and discriminant validity with specifically designed questions. Item parameters were assessed via Item Response Theory. Interpretability was assessed by means of IRT-based scores.Results We found that ESQ is best represented and scored as a unidimensional construct, given potential subscales would not have enough reliability apart from a general factor. Convergent and discriminant validity was demonstrated, as caregivers who perceived that their child benefited from the received mental health care had 6.50 higher summed scores (SMD=1.14, p<0.001); while those who believed that their child needed additional help had 5.08 lower summed scores on the ESQ (SMD=-0.89, p<0.001). Average z-scores provided five meaningful categories of services, in terms of user satisfaction, compared to the national average.Conclusions Our study presents evidence for the reliability and validity of the ESQ and provides recommendations for its practical use in Greece. ESQ can be used to measure experience of service and might help drive improvements in service delivery in the Greek mental health sector.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThis work was fully funded by The Stavros Niarchos Foundation through The Child and Adolescent Mental Health Initiative (CAMHI).Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Ethical approval was granted by the Research Ethics Committee of the Democritus University of Thrace [approval number: ∆ΠΘ/ΕΗ∆Ε/42772/307].I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesThe dataset and the statistical codes supporting the conclusions of this article are openly available in the CAMHI Open Science Framework repository [http://doi.org/10.17605/OSF.IO/CRZ6H]