ABSTRACT
Background Several studies have shown that machine learning algorithms using MRI data can accurately discriminate parkinsonian syndromes. Validation under clinical conditions is missing.
Objectives To evaluate the accuracy for the categorization of parkinsonian syndromes of a machine learning algorithm trained with a research cohort and tested on an independent clinical replication cohort.
Methods 361 subjects, including 94 healthy controls, 139 patients with PD, 60 with PSP with Richardson’s syndrome, 41 with MSA of the parkinsonian variant (MSA-P) and 27 with MSA of the cerebellar variant (MSA-P), were recruited. They were divided into a training cohort (n=179) scanned in a research environment, and a replication cohort (n=182), scanned in clinical conditions on different MRI systems. Volumes and DTI metrics in 13 brain regions were used as input for a supervised machine learning algorithm.
Result High accuracy was achieved using volumetry in the classification of PD versus PSP, PD versus MSA-P, PD versus MSA-C, PD versus atypical parkinsonian syndromes and PSP versus MSA-C in both cohorts, although slightly lower in the replication cohort (balanced accuracy: 0.800 to 0.915 in the training cohort; 0.741 to 0.928 in the replication cohort). Performance was lower in the classification of PSP versus MSA-P and MSA-P versus MSA-C. When adding DTI metrics, the performance tended to increase in the training cohort, but not in the replication cohort.
Conclusions A machine learning approach based on volumetric and DTI data can accurately classify subjects with early-stage parkinsonism, scanned on different MRI systems, in the setting of their clinical workup.
Competing Interest Statement
No relevant conflict of interest related to this study Jean-Christophe Corvol - Reports no disclosures related to the present work Has served in scientific advisory boards for Biogen, Denali, Ever Pharma, Isdorsia, Prevail Therapeutics, UCB, and received grants from Sanofi, the Michael J Fox Foundation, ANR, France Parkinson, the French Ministry of Health Emma Biondetti - Reports no disclosures related to the present work Competing financial interests unrelated to the present work: Received a grant from Biogen Inc. Rahul Gaurav - Reports no disclosures related to the present work Competing financial interests unrelated to the present work: Received a grant from Biogen Inc. Louise-Laure Mariani - Reports no disclosures related to the present work Competing financial interests unrelated to the present work: Received research support grants from INSERM, JNLF, The L’Oreal Foundation; speech honoraria from CSL, Sanofi-Genzyme, Lundbeck, Teva; consultant for Alzprotect, Bionure, Digitsole and received travel funding from the Movement Disorders Society, ANAINF, Merck, Merz, Medtronic, Teva and AbbVie, outside the submitted work. Olivier Colliot - Reports no disclosures related to the present work Competing financial interests unrelated to the present work: Received consulting fees from AskBio (2020), received fees for writing a lay audience short paper from Expression Santé (2019), received speaker fees for a lay audience presentation from Palais de la découverte (2017). His laboratory received grants (paid to the institution) from Air Liquide Medical Systems (2011-2016) and Qynapse (2017-present). Members from his laboratory have co-supervised a PhD thesis with myBrainTechnologies (2016-present). OC’s spouse is an employee of myBrainTechnologies (2015-present). O.C. has submitted a patent to the International Bureau of the World Intellectual Property Organization (PCT/IB2016/0526993, Schiratti J-B, Allassonniere S, Colliot O, Durrleman S, A method for determining the temporal progression of a biological phenomenon and associated methods and devices) (2016). Bertrand Degos - Reports no disclosures related to the present work Competing financial interests unrelated to the present work: Received research support grants from Fondation de France, Inserm, ANR; speech honoraria from Ipsen, Merz Pharma, Orkyn; and received travel funding from Merz Pharma, Elivie, Orkyn. Stéphane Lehericy - Reports no disclosures related to the present work Competing financial interests unrelated to the present work: Received grants from ‘Investissements d’avenir’ [grant number ANR-10-IAIHU-06 and ANR-11-INBS-0006] and Biogen Inc.
Funding Statement
This work was supported by grants from Agence Nationale de la Recherche (Grant Numbers: ANR-11-INBS-0006, ANRMNP 2009, Nucleipark), Investissements d’Avenir ((ANR-19-P3IA-0001 (PRAIRIE 3IA Institute) and ANR-10-IAIHU-06 (Agence Nationale de la Recherche-10-IA Institut Hospitalo-Universitaire-6)), Association France Parkinson, Ecole Neuroscience de Paris, Électricité de France (Fondation d’Entreprise EDF), Institut National de la Santé et de la Recherche Médicale, DHOS-Inserm (2010, Nucleipark), Paris Institute of Neurosciences - IHU (Grant Number: IAIHU-06), PSP France, the Fondation Thérèse and René Planiol pour l’étude du Cerveau, European Union (EU) Framework Project 6 – GENEPARK, the Programme Hospitalier de Recherche Clinique (Grant Number: PHRC 2007-A00169-44, LRRK), the Programme Hospitalier de Recherche Clinique (Grant Number: PHRC 2004, BBBIPPS), the ICM Big Brain Theory Program (project PredictICD) and the Inria Project Lab Program (project Neuromarkers).
Author Declarations
All relevant ethical guidelines have been followed; any necessary IRB and/or ethics committee approvals have been obtained and details of the IRB/oversight body are included in the manuscript.
Yes
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
Financial Disclosures No relevant conflict of interest related to the present study.
Fundings This work was supported by grants from Agence Nationale de la Recherche (Grant Numbers: ANR-11-INBS-0006, ANRMNP 2009, Nucleipark), Investissements d’Avenir (ANR-19-P3IA-0001 (PRAIRIE 3IA Institute) and ANR-10-IAIHU-06 (Agence Nationale de la Recherche-10-IA Institut Hospitalo-Universitaire-6)), Association France Parkinson, Ecole Neuroscience de Paris, Électricité de France (Fondation d’Entreprise EDF), Institut National de la Santé et de la Recherche Médicale, DHOS-Inserm (2010, Nucleipark), Paris Institute of Neurosciences - IHU (Grant Number: IAIHU-06), PSP France, the Fondation Thérèse and René Planiol pour l’étude du Cerveau, European Union (EU) Framework Project 6 – GENEPARK, the Programme Hospitalier de Recherche Clinique (Grant Number: PHRC 2007-A00169-44, LRRK), the Programme Hospitalier de Recherche Clinique (Grant Number: PHRC 2004, BBBIPPS), the ICM Big Brain Theory Program (project PredictICD) and the Inria Project Lab Program (project Neuromarkers).
Data Availability
I declare that all data referred to in the manuscript and note links below are available
Abbreviations and acronyms
- (AUC)
- Area under the ROC curve
- (ADC)
- Apparent diffusion coefficient
- (AD)
- Axial diffusivity
- (BA)
- Balanced accuracy
- (DTI)
- Diffusion tensor imaging
- (FA)
- Fractional anisotropy
- (V4)
- Fourth ventricle
- (MD)
- Mean diffusivity
- (MRI)
- Magnetic resonance imaging
- (MSA-C)
- Cerebellar variant of multiple system atrophy
- (MSA-P)
- Parkinsonian variant of multiple system atrophy
- (PD)
- Parkinson’s disease
- (PSP)
- Progressive supranuclear palsy
- (RD)
- Radial diffusivity
- (SVM)
- Support vector machine
- (SCP)
- Superior cerebellar peduncles
- (V3)
- Third ventricle
- (UPDRS)
- Unified Parkinson’s Disease Rating Scale