Abstract
Eye-movement trajectories are rich behavioral data, providing a window onto how the brain processes information. Analyses of these trajectories can be automated and benefit from machine learning algorithms. Among those, deep learning has recently proven very successful, setting new state-of-art results in many computer vision applications, including medical diagnosis systems. In this paper, we address the challenge of diagnosing and quantifying signs of visuo-spatial neglect from saccadic eye trajectories recorded in healthy controls and in brain-damaged patients with spatial neglect. We show how machine learning techniques, such as deep networks, can predict the patient’s status with unprecedented accuracy, benchmarking the algorithm prediction with structural Magnetic Resonance Images (MRI) of the patients’ brain lesions and their Diffusion Tensor Imaging (DTI) tracts. Preliminary evidence of correlation between MRI data and the algorithm scores suggest that a quantitative prediction of the patients’ impairment based only onto the behavioral data of eye trajectories seem possible, therefore opening to new horizons in the field of non-invasive diagnostics.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
B.F., A.M., received financial support for this work from the Fondation Asile des Aveugles (grant #232933 to M.M.M.), a grantor advised by Carigest SA (#232920 to M.M.M.), as well as the Swiss National Science Foundation (grants #169206 to M.M.M.). A.B. acknowledges the support of Swiss National Science Foundation to Armin Schnider under grant 32003B-175472 and to Radek Ptak under grant 32003B-184702. The work of P.B. and P.P. is supported by Agence Nationale de la Recherche through ANR-16-CE37-0005 and ANR-10-IAIHU-06. F.A. is supported by the Intelligence Advanced Research Projects Activity (IARPA) via Department of Interior/Interior Business Center (DoI/IBC) contract number D16PC00003. The U.S. Government is authorized to reproduce and distribute reprints for Governmental purposes notwithstanding any copyright annotation thereon. Disclaimer: The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies or endorsements, either expressed or implied, of IARPA, DoI/IBC, or the U.S. Government.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
The dataset used in this study was reviewed by the INSERM ethical committee and received the approval of an Institutional Review Board (CPP Ile de France 1) https://www.sciencedirect.com/science/article/abs/pii/S0028393215001591
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Data Availability
The dataset is detailed, analysed and discussed in https://www.sciencedirect.com/science/article/abs/pii/S0028393215001591 In the current work we only used the dateset for supplementary automatized analyses.
https://www.sciencedirect.com/science/article/abs/pii/S0028393215001591
