RT Journal Article
SR Electronic
T1 Using machine learning to improve diagnostic assessment of ASD in the light of specific differential diagnosis
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2021.10.27.21265329
DO 10.1101/2021.10.27.21265329
A1 Schulte-Rüther, Martin
A1 Kulvicius, Tomas
A1 Stroth, Sanna
A1 Roessner, Veit
A1 Marschik, Peter
A1 Kamp-Becker, Inge
A1 Poustka, Luise
YR 2021
UL http://medrxiv.org/content/early/2021/10/28/2021.10.27.21265329.abstract
AB Background Diagnostic assessment of ASD requires substantial clinical experience and is particular difficult in the context of other disorders with behavioral symptoms in the domain of social interaction and communication. Observation measures such as the Autism Diagnostic Observation Schedule (ADOS) do not take into account such comorbid and differential disorders.Method We used a well-characterized clinical sample of individuals (n=1262) that had received detailed outpatient evaluation for the presence of an ASD diagnosis (n=481) and covered a range of additional differential or overlapping diagnoses, including anxiety related disorders (ANX, n=100), ADHD (n=440), and conduct disorder (CD, n=192). We focused on ADOS module 3, covering the age range with particular high prevalence of such differential diagnoses. We used machine learning (ML) and trained random forest models on ADOS single item scores to predict a clinical best estimate diagnosis of ASD in the context of these differential diagnoses (ASD vs. ANX, ASD vs. ADHD, ASD vs. CD) and an unspecific model using all available data. We employed nested cross-validation for an unbiased estimate of classification performance (ASD vs. non-ASD).Results We obtained very good overall sensitivity (0.89-0.94) and specificity (0.87-0.89) for the classification of ASD vs. non-ASD. In particular for individuals with less severe symptoms (around the ADOS cut-off) our models showed increases of up to 20% in sensitivity or specificity. Furthermore, we analyzed item importance profiles of the ANX-, ADHD- and CD-models in comparison to the unspecific model. These analyses revealed distinct patterns of importance for specific ADOS-items with respect to differential diagnoses.Conclusion Using ML-based diagnostic classification may improve clinical decisions by utilizing the full range of information from comprehensive and detailed diagnostic observation such as the ADOS. Importantly, this strategy might be of particular relevance for individuals with less severe symptoms that typically present a very difficult decision for the clinician.Competing Interest StatementLP has received speaking fees from Takeda, medice and infectopharm and royalties from Hogrefe, Kohlhammer, and Schattauer. VR has received payment for consulting and writing activities from Lilly, Novartis, and Shire Pharmaceuticals; lecture honoraria from Lilly, Novartis, Shire Pharmaceuticals, and Medice Pharma; and support for research from Shire Pharmaceuticals and Novartis. He has carried out clinical trials in cooperation with the Novartis, Shire, Servier, and Otsuka companies. MSR, TK, SS, PM, IKB declare no potential conflict of interest.Funding StatementThis work was funded by the German Federal Ministry of Education and Research (BMBF, grant number: FKZ 01EE1409A). Funding period: 2015-2021.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Ethics committee of the medical faculty of the Philipps University Marburg gave ethical approval for this work. Due to the retrospective nature of data collection and analysis based on anonymized data, the need for informed consent was waived by the ethics committee.I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesAll data produced in the present study are available upon reasonable request to the authors