PT - JOURNAL ARTICLE AU - Kennedy, Georgina AU - Rihari-Thomas, John AU - Dras, Mark AU - Gallego, Blanca TI - Developing a deep learning system to drive the work of the critical care outreach team AID - 10.1101/2020.07.07.20148064 DP - 2021 Jan 01 TA - medRxiv PG - 2020.07.07.20148064 4099 - http://medrxiv.org/content/early/2021/02/10/2020.07.07.20148064.short 4100 - http://medrxiv.org/content/early/2021/02/10/2020.07.07.20148064.full AB - Background Care of patients at risk of deterioration on acute medical and surgical wards requires timely identification, increased monitoring and robust escalation procedures. The critical care outreach role brings specialist-trained critical care nurses and physicians into acute wards to facilitate these processes. Performing this role is challenging, as the breadth of information synthesis required is both high and rapidly updating.We propose a novel automated ‘watch-list’ to identify patients at high risk of deterioration, to help prioritise the work of the outreach team.Results This system takes data from the electronic medical record in real-time and creates a discrete tokenized trajectory, which is fed into a recurrent neural network model. These models achieve an AUROC of 0.928 for inpatient death and 0.778 for unplanned ICU admission (within 24 hours), which compares favourably with existing early warning scores and is comparable with proof of concept deep learning systems requiring significantly more input data.Conclusions Based on these results, we can conclude that it is technically feasible to build a set of predictive models that meet the needs of the critical care outreach role, based on a limited set of real-time clinical data.Competing Interest StatementThe authors have declared no competing interest.Funding StatementNo funding was received for the preparation of this work.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:Human Research Ethics Committee of St Vincent's Hospital, Sydney approved this research https://www.svhm.org.au/research/researchers/human-research-ethics-committeeAll necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe data input for the current study are not publicly available. Due to reasonable privacy and security concerns, the data cannot be distributed to researchers other than those granted access via the Human Research Ethics Committee of the target institution.AbbreviationsAIArti_cial intelligenceAUROCArea Under the Receiver Operating Characteristic curveCCOCritical Care OutreachCCOMCritical Care Outreach Medical O_cerCCONCritical Care Outreach NurseEMRElectronic Medical RecordEWSEarly Warning ScoreICUIntensive Care UnitLIMELocal Interpretable Model-Agnostic ExplanationsLSTMLong Short Term Memory unitMETMedical Emergency TeamNEWSNational Early Warning ScoreNLPNatural Language ProcessingRNNRecurrent Neural NetworkWDRWorkup to Detection Ratio