Abstract
Background Care of patients at risk of deterioration on acute medical and surgical wards requires timely identification, increased monitoring and robust escalation procedures. The critical care outreach role brings specialist-trained critical care nurses and physicians into acute wards to facilitate these processes. Performing this role is challenging, as the breadth of information synthesis required is both high and rapidly updating.
We propose a novel automated ‘watch-list’ to identify patients at high risk of deterioration, to help prioritise the work of the outreach team.
Results This system takes data from the electronic medical record in real-time and creates a discrete tokenized trajectory, which is fed into a recurrent neural network model. These models achieve an AUROC of 0.928 for inpatient death and 0.778 for unplanned ICU admission (within 24 hours), which compares favourably with existing early warning scores and is comparable with proof of concept deep learning systems requiring significantly more input data.
Conclusions Based on these results, we can conclude that it is technically feasible to build a set of predictive models that meet the needs of the critical care outreach role, based on a limited set of real-time clinical data.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
No funding was received for the preparation of this work.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
Human Research Ethics Committee of St Vincent's Hospital, Sydney approved this research https://www.svhm.org.au/research/researchers/human-research-ethics-committee
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
Updated based on peer-review feedback
Data Availability
The data input for the current study are not publicly available. Due to reasonable privacy and security concerns, the data cannot be distributed to researchers other than those granted access via the Human Research Ethics Committee of the target institution.
Abbreviations
- AI
- Arti_cial intelligence
- AUROC
- Area Under the Receiver Operating Characteristic curve
- CCO
- Critical Care Outreach
- CCOM
- Critical Care Outreach Medical O_cer
- CCON
- Critical Care Outreach Nurse
- EMR
- Electronic Medical Record
- EWS
- Early Warning Score
- ICU
- Intensive Care Unit
- LIME
- Local Interpretable Model-Agnostic Explanations
- LSTM
- Long Short Term Memory unit
- MET
- Medical Emergency Team
- NEWS
- National Early Warning Score
- NLP
- Natural Language Processing
- RNN
- Recurrent Neural Network
- WDR
- Workup to Detection Ratio
