Abstract
Objective To develop a machine learning based tool, using routine vital signs, to assess delayed cerebral ischemia (DCI) risk over time.
Methods In this retrospective analysis, physiologic data for 540 consecutive acute subarachnoid hemorrhage patients were collected and annotated as part of a prospective observational cohort study between May 2006 and December 2014. Patients were excluded if (i) no physiologic data was available, (ii) they expired prior to the DCI onset window (< post bleed day 3) or (iii) early angiographic vasospasm was detected on admitting angiogram. DCI was prospectively labeled by consensus of treating physicians. Occurrence of DCI was classified using various machine learning approaches including logistic regression, random forest, support vector machine (linear and kernel), and an ensemble classifier, trained on vitals and subject characteristic features. Hourly risk scores were generated as the posterior probability at time t. We performed five-fold nested cross validation to tune the model parameters and to report the accuracy. All classifiers were evaluated for good discrimination using the area under the receiver operating characteristic curve (AU-ROC) and confusion matrices.
Results Of 310 patients included in our final analysis, 101 (32.6%) patients developed DCI. We achieved maximal classification of 0.81 [0.75-0.82] AU-ROC. We also predicted 74.7 % of all DCI events 12 hours before typical clinical detection with a ratio of 3 true alerts for every 2 false alerts.
Conclusion A data-driven machine learning based detection tool offered hourly assessments of DCI risk and incorporated new physiologic information over time.
Competing Interest Statement
Funding: This study was funded by National Institute of Health (NIH), grant number: NIEHS K01-ES026833-02 (SP), American Heart Association grant number : 20POST35210653 (MM)
Funding Statement
Funding: This study was funded by National Institute of Health (NIH), grant number: NIEHS K01-ES026833-02 (SP), American Heart Association grant number : 20POST35210653 (MM)
Author Declarations
All relevant ethical guidelines have been followed; any necessary IRB and/or ethics committee approvals have been obtained and details of the IRB/oversight body are included in the manuscript.
Yes
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
Potential Conflicts-of-Interest/Disclosures: Funding: This study was funded by National Institute of Health (NIH), grant number: NIEHS K01- ES026833-02 (SP) and American Heart Association grant number: 20POST35210653 (MM)
Compliance with Ethical Standards: Ethics approval and consent to participate: The study was approved by the Columbia University Medical Center Institutional Review Board. In all cases, written informed consent was obtained from the patient or a surrogate.
Statistical Analysis: conducted by Dr. Amelia Boehme and Dr. Murad Megjhani
Study Funded: by NIEHS K01-ES026833-02 (SP)
Authors’ contributions: Data Collection (KT, MM, SP, AV, DR, SA, JC), Analysis (MM, KT, SP, AB), Writing (KT, MM, SP, AA), Editing (All).
The Chan Zuckerberg Initiative, Cold Spring Harbor Laboratory, the Sergey Brin Family Foundation, California Institute of Technology, Centre National de la Recherche Scientifique, Fred Hutchinson Cancer Center, Imperial College London, Massachusetts Institute of Technology, Stanford University, University of Washington, and Vrije Universiteit Amsterdam.