Abstract
Importance Complications after percutaneous coronary intervention (PCI) are common and costly. Risk models for predicting the likelihood of acute kidney injury (AKI), bleeding, stroke and death are limited by accuracy and inability to use non-linear relationships among predictors. Additionally, if non-linear relationships among predictors can be leveraged, then the prediction of any adverse event (i.e. “the patient who will not do well with PCI”) is perhaps of greater interest to clinicians than prediction of adverse events in isolation.
Objective To develop and validate a set of artificial neural networks (ANN) models to predict five adverse outcomes after PCI – AKI, bleeding, stroke, death and one or more of these four (‘any adverse outcome’).
Design Cross-sectional study, using institutional NCDR CathPCI data.
Setting and participants 28,005 patients undergoing PCI at five hospitals in the Barnes-Jewish Hospital system.
Main Outcome(s) AKI, bleeding, stroke, death, and one or more of these four (‘any adverse outcome’). We divided 28,005 PCI patients into a training cohort of 21,004 (75%) and a test cohort of 7,001 (25%). We used an artificial neural network (ANN) multilayer perceptron (MLP) model to predict each outcome based on a set of 278 encoded and preprocessed variables. Model accuracy was tested using area under the receiver-operating-characteristic curve (AUC). Performance and validation of the MLP model was compared with existing regression models using integrated discrimination improvement (IDI) and continuous net reclassification index (NRI).
Results The prevalence of AKI, bleeding, stroke and death in the study cohort was 4.6%, 3.6%, 0.3% and 1.1%, respectively. The fully trained MLP model achieved convergence quickly (< 10 epochs) and could predict accurately predict AKI (77.9%), bleeding (86.5%), death (90.3%) and any adverse outcome (80.6%) in the independent test set. However, prediction of stroke was not satisfactory (69.9%). Compared to the currently used models for AKI, bleeding and death prediction, our models showed a significantly higher AUC (range 1.6% – 5.6%), IDI (range 4.9% –7.2%) and NRI (range 0.07 – 0.61).
Conclusions and Relevance By using neural network-based models, we accurately predict major adverse events after PCI. Larger studies for replicability and longitudinal studies for evidence of impact are needed to establish these artificial intelligence methods in current PCI practice.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
Funding for this work was obtained from an unrestricted grant from Terumo Medical Corporation.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
This study was approved by Washington University's (St. Louis, MO) institutional review board, and no informed consent was required.
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
AUTHOR DISCLOSURES Dr. Amit P. Amin – has received funding via a comparative effectiveness research KM1 career development award from the Clinical and Translational Science Award (CTSA) program of the National Center for Advancing Translational Sciences of the National Institutes of Health, Grant Numbers UL1TR000448, KL2TR000450, TL1TR000449 and the National Cancer Institute of the National Institutes of Health, Grant Number 1KM1CA156708–01; an AHRQ R18 grant award (Grant Number R18HS0224181–01A1), has received an unrestricted grant from Volcano corporation, and MedAxiom Synergistic Healthcare Solutions Austin, TX and is a consultant to Terumo, GE Healthcare and AstraZeneca. Dr. Hemant Kulkarni provides research consultancy to MedAxiom – Synergistic Healthcare Solutions Austin, TX.
Role of any Sponsor: No sponsor participated in the design and conduct of the study, collection, analysis, or interpretation of the data, nor in the preparation, review, nor approval of the manuscript. Funding for this work was obtained from an unrestricted grant from Terumo Medical Corporation.
Data Access and Responsibility: Drs. Amin and Kulkarni had full access to all the data in the study and take responsibility for the integrity of the data and the accuracy of the data analysis.
The Chan Zuckerberg Initiative, Cold Spring Harbor Laboratory, the Sergey Brin Family Foundation, California Institute of Technology, Centre National de la Recherche Scientifique, Fred Hutchinson Cancer Center, Imperial College London, Massachusetts Institute of Technology, Stanford University, University of Washington, and Vrije Universiteit Amsterdam.
Subject Area
Reviews and Context
0
Comment
0
TRIP Peer Reviews
0
Community Reviews
0
Automated Services
0
Blogs/Media
Author Videos