Abstract
Background Diagnostic assessment of ASD requires substantial clinical experience and is particular difficult in the context of other disorders with behavioral symptoms in the domain of social interaction and communication. Observation measures such as the Autism Diagnostic Observation Schedule (ADOS) do not take into account such comorbid and differential disorders.
Method We used a well-characterized clinical sample of individuals (n=1262) that had received detailed outpatient evaluation for the presence of an ASD diagnosis (n=481) and covered a range of additional differential or overlapping diagnoses, including anxiety related disorders (ANX, n=100), ADHD (n=440), and conduct disorder (CD, n=192). We focused on ADOS module 3, covering the age range with particular high prevalence of such differential diagnoses. We used machine learning (ML) and trained random forest models on ADOS single item scores to predict a clinical best estimate diagnosis of ASD in the context of these differential diagnoses (ASD vs. ANX, ASD vs. ADHD, ASD vs. CD) and an unspecific model using all available data. We employed nested cross-validation for an unbiased estimate of classification performance (ASD vs. non-ASD).
Results We obtained very good overall sensitivity (0.89-0.94) and specificity (0.87-0.89) for the classification of ASD vs. non-ASD. In particular for individuals with less severe symptoms (around the ADOS cut-off) our models showed increases of up to 20% in sensitivity or specificity. Furthermore, we analyzed item importance profiles of the ANX-, ADHD- and CD-models in comparison to the unspecific model. These analyses revealed distinct patterns of importance for specific ADOS-items with respect to differential diagnoses.
Conclusion Using ML-based diagnostic classification may improve clinical decisions by utilizing the full range of information from comprehensive and detailed diagnostic observation such as the ADOS. Importantly, this strategy might be of particular relevance for individuals with less severe symptoms that typically present a very difficult decision for the clinician.
Competing Interest Statement
LP has received speaking fees from Takeda, medice and infectopharm and royalties from Hogrefe, Kohlhammer, and Schattauer. VR has received payment for consulting and writing activities from Lilly, Novartis, and Shire Pharmaceuticals; lecture honoraria from Lilly, Novartis, Shire Pharmaceuticals, and Medice Pharma; and support for research from Shire Pharmaceuticals and Novartis. He has carried out clinical trials in cooperation with the Novartis, Shire, Servier, and Otsuka companies. MSR, TK, SS, PM, IKB declare no potential conflict of interest.
Funding Statement
This work was funded by the German Federal Ministry of Education and Research (BMBF, grant number: FKZ 01EE1409A). Funding period: 2015-2021.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
Ethics committee of the medical faculty of the Philipps University Marburg gave ethical approval for this work. Due to the retrospective nature of data collection and analysis based on anonymized data, the need for informed consent was waived by the ethics committee.
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
Competing Interests LP has received speaking fees from Takeda, medice and infectopharm and royalties from Hogrefe, Kohlhammer, and Schattauer. VR has received payment for consulting and writing activities from Lilly, Novartis, and Shire Pharmaceuticals; lecture honoraria from Lilly, Novartis, Shire Pharmaceuticals, and Medice Pharma; and support for research from Shire Pharmaceuticals and Novartis. He has carried out clinical trials in cooperation with the Novartis, Shire, Servier, and Otsuka companies. MSR, TK, SS, PM, IKB declare no potential conflict of interest.
Data Availability
All data produced in the present study are available upon reasonable request to the authors
