PT - JOURNAL ARTICLE AU - Yang, Po-Kai AU - Filtjens, Benjamin AU - Ginis, Pieter AU - Goris, Maaike AU - Nieuwboer, Alice AU - Gilat, Moran AU - Slaets, Peter AU - Vanrumste, Bart TI - Automatic Detection and Assessment of Freezing of Gait Manifestations AID - 10.1101/2023.07.10.23292437 DP - 2023 Jan 01 TA - medRxiv PG - 2023.07.10.23292437 4099 - http://medrxiv.org/content/early/2023/07/12/2023.07.10.23292437.short 4100 - http://medrxiv.org/content/early/2023/07/12/2023.07.10.23292437.full AB - Freezing of gait (FOG) is an episodic and highly disabling symptom of Parkinson’s disease (PD). Although described as a single phenomenon, FOG is not univocal and can express as different manifestations, such as trembling in place or complete akinesia. We aimed to analyze the utility of deep learning trained on inertial measurement unit data to classify FOG into both manifestations. We developed a temporal convolutional neural network, which we compared to three state-of-the-art FOG detection algorithms that were adapted to the FOG manifestation detection task. Next, we investigated its performance in distinguishing between the two manifestations and other forms of movement cessation (e.g., volitional stopping and sitting) based on gold-standard video annotations. Experiments were conducted on a dataset of twelve PD patients with FOG that completed a FOG-provoking protocol, including the timed-up-and-go and 360-degree turning-in-place tasks during ON and OFF anti-Parkinsonian medication. The results showed that our model enables accurate detection of FOG manifestations with an 11.43% higher F1 score than the second-best model. Assessment of FOG manifestation severity was moderately strong for trembling in place (Intra-class Correlation Coefficient (ICC)=0.64, [0.16,0.88]) and strong for complete akinesia (ICC=0.87, [0.63,0.96]). Remarkably, our results show that complete akinesia can be distinguished from volitional stopping. In conclusion, we established that FOG manifestations could be accurately detected and assessed with deep learning. Future work should establish whether these results hold firm for a more extensive and varied verification cohort.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThis study is funded by the KU Leuven Industrial Research Fund. Po-Kai Yang was supported by the Ministry of Education (KU Leuven Taiwan Scholarship). Benjamin Filtjens was supported by KU Leuven Internal Funds Postdoctoral Mandate PDMT2/22/046.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Ethics committee Research UZ/KU Leuven approved this study (S65059).I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesOur neural network architecture was implemented in Python 3.7 with Pytorch version 1.8.0 by adopting the public code repositories of Farha and Gall [1], Pavllo et al. [2], and O'Day et al [3]. The datasets analyzed during the current study are not publicly available due to restrictions on sharing subject health information. https://github.com/yabufarha/ms-tcn https://github.com/facebookresearch/VideoPose3D https://github.com/stanfordnmbl/imu-fog-detection/