PT  - JOURNAL ARTICLE
AU  - Henry, Katharine E.
AU  - Adams, Roy
AU  - Parent, Cassandra
AU  - Sridharan, Anirudh
AU  - Johnson, Lauren
AU  - Hager, David N.
AU  - Cosgrove, Sara E.
AU  - Markowski, Andrew
AU  - Klein, Eili Y.
AU  - Chen, Edward S.
AU  - Henley, Maureen
AU  - Miranda, Sheila
AU  - Houston, Katrina
AU  - Linton, Robert C.
AU  - Ahluwalia, Anushree R.
AU  - Wu, Albert W.
AU  - Saria, Suchi
TI  - Evaluating Adoption, Impact, and Factors Driving Adoption for TREWS, a Machine Learning-Based Sepsis Alerting System
AID  - 10.1101/2021.07.02.21259941
DP  - 2021 Jan 01
TA  - medRxiv
PG  - 2021.07.02.21259941
4099  - http://medrxiv.org/content/early/2021/07/07/2021.07.02.21259941.short
4100  - http://medrxiv.org/content/early/2021/07/07/2021.07.02.21259941.full
AB  - Machine learning-based clinical decision support tools for sepsis create opportunities to identify at-risk patients and initiate treatments earlier, an important step in improving sepsis outcomes. Increasing use of such systems means quantifying and understanding provider adoption is critical. Using real-time provider interactions with a sepsis early detection tool (Targeted Real-time Early Warning System) deployed at five hospitals over a two-year period (469,419 screened patient encounters, 9,805 (2.1%) of which were retrospectively identified as having sepsis), we found high adoption rates (89% of alerts were evaluated by a physician or advanced practice provider) and an association between use of the tool and earlier treatment of sepsis patients (1.85 (95% CI: 1.66 - 2.00) hour reduction in median time to first antibiotics order). Further, we found that provider-related factors had the strongest association with alert adoption and that case complexity and atypical presentation were associated with dismissal of alerts on sepsis patients. Beyond improving the performance of the system, efforts to improve adoption should focus on provider knowledge, experience, and perceptions of the system.Competing Interest StatementUnder a license agreement between Bayesian Health and the Johns Hopkins University, Dr. Henry, Dr. Saria, and Johns Hopkins University are entitled to revenue distributions. Additionally, the University owns equity in Bayesian Health. This arrangement has been reviewed and approved by the Johns Hopkins University in accordance with its conflict of interest policies. Dr. Saria also has grants from Gordon and Betty Moore Foundation, the National Science Foundation, the National Institutes of Health, Defense Advanced Research Projects Agency, the Food and Drug Administration, and the American Heart Association; she is a founder of and holds equity in Bayesian Health; she is the scientific advisory board member for PatientPing; and she has received honoraria for talks from a number of biotechnology, research, and health-tech companies. This arrangement has been reviewed and approved by the Johns Hopkins University in accordance with its conflict of interest policies. Dr. Hager discloses salary support and funding to his institution from the Marcus Foundation for the conduct of the Vitamin C, Thiamine, and Steroids in Sepsis Trial. Dr. Cosgrove consulting fees from Basilea for work on an infection adjudication committee for a S. aureus bacteremia trial. The other authors declare no disclosures of conflicts of interest.Funding StatementThe authors gratefully acknowledge the following sources of funding: the Gordon and Betty Moore Foundation (award #3926), the National Science Foundation Future of Work at the Human-technology Frontier (award #1840088), and the Alfred P. Sloan Foundation research fellowship (2018).Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:This study was approved by the Johns Hopkins University internal review board (IRB No. 00252594) and a waiver of consent was obtained.All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe data is not available for public use.