RT Journal Article
SR Electronic
T1 Machine Learning - Based Bleeding Risk Predictions in Atrial Fibrillation Patients on Direct Oral Anticoagulants
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2024.05.27.24307985
DO 10.1101/2024.05.27.24307985
A1 Chaudhary, Rahul
A1 Nourelahi, Mehdi
A1 Thoma, Floyd W.
A1 Gellad, Walid F.
A1 Lo-Ciganic, Wei-Hsuan
A1 Bliden, Kevin P.
A1 Gurbel, Paul A.
A1 Neal, Matthew D.
A1 Jain, Sandeep K.
A1 Bhonsale, Aditya
A1 Mulukutla, Suresh R.
A1 Wang, Yanshan
A1 Harinstein, Matthew E.
A1 Saba, Samir
A1 Visweswaran, Shyam
YR 2024
UL http://medrxiv.org/content/early/2024/05/27/2024.05.27.24307985.abstract
AB Importance Accurately predicting major bleeding events in non-valvular atrial fibrillation (AF) patients on direct oral anticoagulants (DOACs) is crucial for personalized treatment and improving patient outcomes, especially with emerging alternatives like left atrial appendage closure devices. The left atrial appendage closure devices reduce stroke risk comparably but with significantly fewer non-procedural bleeding events.Objective To evaluate the performance of machine learning (ML) risk models in predicting clinically significant bleeding events requiring hospitalization and hemorrhagic stroke in non-valvular AF patients on DOACs compared to conventional bleeding risk scores (HAS-BLED, ORBIT, and ATRIA) at the index visit to a cardiologist for AF management.Design Prognostic modeling with retrospective cohort study design using electronic health record (EHR) data, with clinical follow-up at one-, two-, and five-years.Setting University of Pittsburgh Medical Center (UPMC) system.Participants 24,468 non-valvular AF patients aged ≥18 years treated with DOACs, excluding those with prior history of significant bleeding, other indications for DOACs, on warfarin or contraindicated to DOACs.Exposure(s) DOAC therapy for non-valvular AF.Main Outcome(s) and Measure(s) The primary endpoint was clinically significant bleeding requiring hospitalization within one year of index visit. The models incorporated demographic, clinical, and laboratory variables available in the EHR at the index visit.Results Among 24,468 patients, 553 (2.3%) had bleeding events within one year, 829 (3.5%) within two years, and 1,292 (5.8%) within five years of index visit. We evaluated multivariate logistic regression and ML models including random forest, classification trees, k-nearest neighbor, naive Bayes, and extreme gradient boosting (XGBoost) which modestly outperformed HAS-BLED, ATRIA, and ORBIT scores in predicting clinically significant bleeding at 1-year follow-up. The best performing model (random forest) showed area under the curve (AUC-ROC) 0.76 (0.70-0.81), G-Mean score of 0.67, net reclassification index 0.14 compared to 0.57 (0.50-0.63), G-Mean score of 0.57 for HASBLED score, p-value for difference <0.001. The ML models had improved performance compared to conventional risk across time-points of 2-year and 5-years and within the subgroup of hemorrhagic stroke. SHAP analysis identified novel risk factors including measures from body mass index, cholesterol profile, and insurance type beyond those used in conventional risk scores.Conclusions and Relevance Our findings demonstrate the superior performance of ML models compared to conventional bleeding risk scores and identify novel risk factors highlighting the potential for personalized bleeding risk assessment in AF patients on DOACs.Competing Interest StatementDr. Lo-Ciganic has received grant funding from Merck, Sharp & Dohme and Bristol Myers Squibb, and was compensated consulting service by Teva Pharmaceuticals for unrelated projects of this paper. Dr. Gurbel has received consulting fees and/or honoraria from Bayer, Otitopic, Janssen, UpToDate, Cleveland Clinic, Adeno, Wolters Kluwer Pharma, Web MD Med-scape, Baron and Budd, North American Thrombosis Forum, Innovative Sciences; institutional research grants from the Haemonetics, Janssen, Bayer, Instrumentation Laboratories, Amgen, Idorsia, Otitopic, Hikari Dx, Novartis, Precision Biologic, Nirmidas Biotech, and R-Pharma International; in addition, Dr. Gurbel has two patents, Detection of restenosis risk in patients issued and Assessment of cardiac health and thrombotic risk in a patient. Dr. Saba reports receiving research grants from Abbott, Inc. and Boston Scientific as well as providing consultation services to Medtronic and Boston Scientific. Dr. Neal is the Chief Medical Officer of Haima Therapeutics and reports consulting fees and/or honoraria from Haemonetics, Janssen, CSL Behring, Alexion, Takeda, and Octapharma. He has received research grants from Haemonetics, Janssen, and Instrumentation Laboratories. Other authors report no disclosures.Funding StatementThis study was funded in part by the Beckwith Institute, University of Pittsburgh Medical Center, and by the National Heart, Lung, and Blood Institute of the National Institutes of Health under award number T32 HL129964. The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Institutional Review Board of University of Pittsburgh gave ethical approval for this work.I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesThe data that support the findings of this study are available from the corresponding author upon reasonable request and with permission of the University of Pittsburgh Medical Center.