RT Journal Article SR Electronic T1 Assessing and predicting adolescent and early adulthood common mental disorders in the ALSPAC cohort using electronic primary care data JF medRxiv FD Cold Spring Harbor Laboratory Press SP 2021.05.14.21255910 DO 10.1101/2021.05.14.21255910 A1 Smith, Daniel A1 Willan, Kathryn A1 Prady, Stephanie L A1 Dickerson, Josie A1 Santorelli, Gillian A1 Tilling, Kate A1 Cornish, Rosie P YR 2021 UL http://medrxiv.org/content/early/2021/05/14/2021.05.14.21255910.abstract AB Objectives This paper has three objectives: 1) examine agreement between common mental disorders (CMDs) derived from primary health care records and repeated CMD questionnaire data from ALSPAC (the Avon Longitudinal Study of Parents and Children); 2) explore the factors affecting CMD identification in primary care records; and 3) taking ALSPAC as the reference standard, to construct models predicting ALSPAC-derived CMDs using primary care data.Design and Setting Prospective cohort study (ALSPAC) with linkage to electronic primary care data.Participants Primary care records were extracted for 11,807 ALSPAC participants (80% of the 14,731 eligible participants). The number of participants with both linked primary care and ALSPAC CMD data varied between 3,633 (age 15/16) to 1,298 (age 21/22).Outcome measures Outcome measures from ALSPAC data were diagnoses of suspected depression and/or CMDs. For the primary care data, Read codes for diagnosis, symptoms and treatment were used to indicate the presence of depression and CMDs.For each time point, sensitivities and specificities (using ALSPAC-derived CMDs as the reference standard) were calculated and the factors associated with identification of primary care-based CMDs in those with suspected ALSPAC-derived CMDs explored. Lasso models were then performed to predict ALSPAC CMDs from primary care data.Results Sensitivities were low for CMDs (range: 3.5 to 19.1%) and depression (range: 1.6 to 34.0%), while specificities were high (nearly all >95%). The strongest predictor of identification in the primary care data was symptom severity. The lasso models had relatively low prediction rates, especially for out-of-sample prediction (deviance ratio range: - 1.3 to 12.6%), but improved with age.Conclusions Even with predictive modelling using all available information, primary care data underestimate CMD rates compared to estimates from population-based studies. Research into the use of free-text data or secondary care information is needed to improve the predictive accuracy of models using clinical data.Strengths and limitations of this studyWe used a large prospective cohort (ALSPAC) and were able to link these data to individuals’ electronic primary care records, with this linkage data covering ∼80% of the cohort.We used validated mental health questionnaires to assess depression and common mental disorders among the ALSPAC cohort, which we treat as our ‘reference standard’.We were able to assess agreement between ALSPAC data and electronic primary care data for common mental disorders across adolescence and into adulthood, a key life transition and period where mental health problems often emerge.There is a risk of selection bias, as many participants with primary care data did not have ALSPAC mental health measures, while primary care data coverage also decreased with age; continued participation in both cases is likely to be non-random.For this study we assumed that the common mental disorder data from ALSPAC are the ‘reference standard’ against which the primary care data should be compared; however, this data may also be subject to misclassification.The available linkage data consisted of primary care Read codes, which misses data from other clinical sources, such as secondary care or from primary care free-text data.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThis work was funded by the Medical Research Council (MRC grant number: MC_PC_17210). The UK Medical Research Council and Wellcome (Grant ref: 217065/Z/19/Z) and the University of Bristol provide core support for ALSPAC. A comprehensive list of grants funding is available on the ALSPAC website http://www.bristol.ac.uk/alspac/external/documents/grant-acknowledgements.pdf); collection of ALSPAC CMD data was funded by the NIH (grant references 5R01MH073842-04 and PD301198-SC101645; for the TF3 DAWBA and YPB MFQ data), Wellcome Trust (grant reference 08426812/Z/07/Z; for the TF4 CIS-R data), and a joint Wellcome Trust and MRC grant (grant reference 092731; for the CCS, CCT and YPA SMFQ data). This publication is the work of the authors and Daniel Smith and Rosie Cornish will serve as guarantors for the contents of this paper.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Ethical approval for the study was obtained from the ALSPAC Ethics and Law Committee and the Local Research Ethics Committees (NHS Haydock REC: 10/H1010/70). Informed consent for the use of data collected via questionnaires and clinics was obtained from participants following the recommendations of the ALSPAC Ethics and Law Committee at the time.All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesInformation about access to ALSPAC data is given on the ALSPAC website (http://www.bristol.ac.uk/alspac/researchers/access/).