PT  - JOURNAL ARTICLE
AU  - Fralick, Michael
AU  - Debnath, Meggie
AU  - Pou-Prom, Chloe
AU  - O’Brien, Patrick
AU  - Perkins, Bruce A.
AU  - Carson, Esmerelda
AU  - Khemani, Fatima
AU  - Mamdani, Muhammad
TI  - Using Real-Time Machine Learning to Prevent In-Hospital Severe Hypoglycemia: A prospective study
AID  - 10.1101/2022.07.21.22277774
DP  - 2022 Jan 01
TA  - medRxiv
PG  - 2022.07.21.22277774
4099  - http://medrxiv.org/content/early/2022/07/24/2022.07.21.22277774.short
4100  - http://medrxiv.org/content/early/2022/07/24/2022.07.21.22277774.full
AB  - Objective There are many examples of machine learning based algorithms with impressive diagnostic characteristics. However, a few published studies have evaluated how well they perform when deployed into clinical care. The objective of this study was to evaluate the performance of a recently validated machine-learned model to predict inpatient hypoglycemia following its implementation into clinical care on cardiovascular and vascular surgery ward.Methods We conducted a prospective analysis of a machine learning algorithm to predict hypoglycemia. The algorithm was trained, validated, and tested using data from 2013 to 2019. We employed multiple supervised machine learning techniques (e.g., extreme gradient boosting) to predict inpatient hypoglycemia and severe hypoglycemia using a wide-range of patient-level data (i.e., features) including medications, labs, nursing notes, comorbid conditions, among others.Results Our study included 3989 hospitalizations during the pre-implementation period and 1916 post-implementation. Approximately one-third of patients were women, the median age was 66 years, 23% received metformin in hospital, 7% received a sulfonylurea, and the median length of stay was 6 days. During the pre-implementation period, more than 5% of patients experienced hypoglycemia during 9.4% (N=12/127 weeks) of study weeks as compared to 0% (N=0/79 weeks) of weeks during the post-implementation period (p=0.012). The weekly variability in the rates of hypoglycemia decreased by approximately 50% from the pre-implementation (standard deviation 1.8, variance 3.4) to implementation phase (standard deviation 1.3, variance 1.6; p=0.03). There was a week-to-week decrease in hypoglycemia rates by 0.03 events per week [95% CI: -0.04, -0.01] (p = 0.004) but no significant change in weekly rates of hyperglycemia (−0.04 [95% CI: -0.10, 0.01]; p=0.102). The severe hypoglycemia events per 100 patients per year was 1.3 pre-implementation and 1.1 following implementation.Discussion and Conclusion Our prospective analysis of a recently validated machine learned model to prevent hypoglycemia demonstrated a reduction in the rates of inpatient hypoglycemia. Our study suggests that machine learning methods can be leveraged to prevent inpatient hypoglycemia.Competing Interest StatementB.A.P. has received speaker honoraria from Abbott, Medtronic, Insulet, and Novo Nordisk; has served as an advisor to Insulet, Sanofi, and Abbott; and has received research support to his research institute from Novo Nordisk, and the Bank of Montreal (BMO). MF is a consultant for ProofDx, a start-up company that has created a point of care diagnostic tests for COVID-19 using CRISPRFunding StatementThis study was funded by Banting and Best Diabetes CentreAuthor DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The Unity Health Toronto Research Ethics Board gave ethical approval for this work (REB #16-371)I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesWe cannot share the data