RT Journal Article
SR Electronic
T1 Predicting Post-Liver Transplant Outcomes in Patients with Acute-on-Chronic Liver Failure using Expert-Augmented Machine Learning
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2023.03.03.23286729
DO 10.1101/2023.03.03.23286729
A1 Ge, Jin
A1 Digitale, Jean C.
A1 Fenton, Cynthia
A1 McCulloch, Charles E.
A1 Lai, Jennifer C.
A1 Pletcher, Mark J.
A1 Gennatas, Efstathios D.
YR 2023
UL http://medrxiv.org/content/early/2023/03/05/2023.03.03.23286729.abstract
AB Background Liver transplantation (LT) is a treatment for acute-on-chronic liver failure (ACLF) but up to 40% mortality post-LT has been reported. Existing post-LT models in ACLF have been limited by small samples. In this study, we developed a novel Expert-Augmented Machine Learning (EAML) model to predict post-LT outcomes.Methods We identified ACLF patients in the University of California Health Data Warehouse (UCHDW). We used EAML, which uses the RuleFit machine learning (ML) algorithm to extract rules from decision-trees that are then evaluated by human experts, to predict post-LT outcomes. We compared EAML/RuleFit’s performances versus other popular models.Results We identified 1,384 ACLF patients. For death at one-year: areas-under-the-receiver-operating characteristic curve (AUROCs) were 0.707 (Confidence Interval [CI] 0.625-0.793) for EAML and 0.719 (CI 0.640-0.800) for RuleFit. For death at 90-days: AUROCs were 0.678 (CI 0.581-0.776) for EAML and 0.707 (CI 0.615-0.800) for RuleFit. In pairwise comparisons, EAML/RuleFit models outperformed cross-sectional models. Divergences between experts and ML in rankings revealed biases and artifacts in the underlying data.Conclusions EAML/RuleFit outperformed cross-sectional models. Significant discrepancies between experts and ML occurred in rankings of biomarkers used in clinical practice. EAML may serve as a method for ML-guided hypothesis generation in further ACLF research.Competing Interest StatementDr. Jin Ge receives research support from Merck and Co.Funding StatementThe authors of this study were supported in part by the KL2TR001870 (National Center for Advancing Translational Sciences, Ge and McCulloch), AASLD Anna S. Lok Advanced/Transplant Hepatology Award AHL21-104606 (AASLD Foundation, Ge), American Society of Transplantation LICOP Grant Award CA-0182782 (American Society of Transplantation, Ge), P30DK026743 (UCSF Liver Center Grant, Ge and Lai), F31HL156498 (National Heart, Lung, and Blood Institute, Digitale), UL1TR001872 (National Center for Advancing Translational Sciences, Pletcher), and R01AG059183/K24AG080021 (National Institute on Aging, Lai). The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health or any other funding agencies. The funding agencies played no role in the analysis of the data or the preparation of this manuscript.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The Institutional Review Board at the University of California, San Francisco gave ethical approval for this work under #20-32717 for model generation and #22-37555 for expert input.I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesThe authors thank the Center for Data-driven Insights and Innovation (CDI2) at the University of California Health (UCH) for its analytical and technical support related to the use of the UC Health Data Warehouse (UCHDW) and related data assets, including the UC COVID Research Data Set (CORDS).ACLFacute-on-chronic liver failure;APASL ACLFAsian Pacific Association for the Study of the Liver ACLF Research Consortium;AUROCarea-under-the-receiver-operating characteristic curve;CDI2Center for Data-Driven Insights and Innovation;CDSclinical decision support;CIconfidence interval;CORDSUC COVID Research Data Set;CPT4Current Procedural Terminology version 4;EAMLExpert-Augmented Machine Learning;EF-CLIFEuropean Association for the Study of the Liver-Chronic Liver Failure Consortium;EHRelectronic health record;ESLDend-stage liver disease;FiO2fraction of inspired oxygen;GBMGradient Boosting Machine;GLMNETElastic-Net Regularized Generalized Linear Model;ICD-10-CMInternational Classification of Diseases, Tenth Revision, Clinical Modification;LASSOLeast Absolute Shrinkage and Selection Operator;LTliver transplantation;MLmachine learning;N3CNational COVID Cohort Collaborative;NACSELDNorth American Consortium for the Study of End-Stage Liver Disease;OMOPObservational Medical Outcomes Partnership;PaO2arterial partial pressure of oxygen;RFRandom Forest;SNOMEDStandard Nomenclature of Medicine;SpO2partial oxygen saturation;TAMTransplantation for ACLF-3 Model;UCHUniversity of California Health;UCHDWUniversity of California Health Data Warehouse;VHACDWVeterans Health Administration Corporate Data Warehouse