Abstract
Objectives To develop a disease stratification model for COVID-19 that updates according to changes in a patient’s condition while in hospital to facilitate patient management and resource allocation.
Design In this retrospective cohort study we adopted a landmarking approach to dynamic prediction of all cause in-hospital mortality over the next 48 hours. We accounted for informative predictor missingness, and selected predictors using penalised regression.
Setting All data used in this study was obtained from a single UK teaching hospital.
Participants We developed the model using 473 consecutive patients with COVID-19 presenting to a UK hospital between March 1 and September 12, 2020; and temporally validated using data on 1119 patients presenting between September 13, 2020 and March 17, 2021.
Primary and secondary Outcomes The primary outcome is all-cause in-hospital mortality within 48 hours of the prediction time. We accounted for the competing risks of discharge from hospital alive and transfer to a tertiary Intensive Care Unit for extracorporeal membrane oxygenation.
Results Our final model includes age, Clinical Frailty Scale score, heart rate, respiratory rate, SpO2/FiO2 ratio, white cell count, presence of acidosis (pH < 7.35) and Interleukin-6. Internal validation achieved an AUROC of 0.90 (95% CI 0.87–0.93) and temporal validation gave an AUROC of 0.86 (95% CI 0.83-0.88).
Conclusion Our model incorporates both static risk factors (e.g. age) and evolving clinical and laboratory data, to provide a dynamic risk prediction model that adapts to both sudden and gradual changes in an individual patient’s clinical condition. Upon successful external validation, the model has the potential to be a powerful clinical risk assessment tool.
Trial Registration The study is registered as “researchregistry5464” on the Research Registry (www.researchregistry.com).
Article Summary
- Our dynamic prediction model is able to incorporate patient data as it accumulates throughout a hospital visit.
- We use the established statistical landmarking approach to dynamic prediction; account for competing risks for the primary outcome of in-hospital mortality; and the potentially-informative availability of clinical and laboratory data.
- The sample size of the first wave of patients admitted with severe COVID-19 was relatively low, due to the lower incidence in Cambridgeshire, but increased significantly during the winter months of 2020/21, providing the opportunity to temporally validate the model.
- As a single centre study, the presented model will require external validation to assess its performance in other cohorts; and also if there are significant changes in the characteristics of new variants or the management thereof.
- Our work also highlights the adaptability of the statistical landmarking framework to be used to model individual patient outcomes using densely-collected hospital data.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
Martin Wiegand was funded by the NIHR Cambridge Biomedical Research Centre [BRC-1215-20014]. Victoria L. Keevil was funded by the MRC/NIHR Clinical Academic Research Partnership Grant (CARP) [grant code MR/T023902/1]. Vince Taylor was funded by the Cancer Research UK Cambridge Centre. Effrossyni Gkrania-Klotsas was supported by the NIHR Clinical Research Network (CRN) Greenshoots Award. Brian D. M. Tom and Robert J. B. Goudie were funded by the UKRI Medical Research Council (MRC) [programme code MC_UU_00002/2] and supported by the NIHR Cambridge Biomedical Research Centre [BRC-1215-20014].
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
The study was approved by a UK Health Research Authority ethics committee (20/WM/0125). Patient consent was waived because the de-identified data presented here were collected during routine clinical practice; there was no requirement for informed consent.
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Footnotes
↵* Joint last
This manuscript contains updated results included an updated data set, as well as revisions to the manuscript's phrasing. We include updated figures (1+2) with modified calibration interpolations, several step-wise sub-models (supplement) and stratify the model performance by both vaccination status and on whether COVID-19 was diagnosed by the attending physician, or by a positive PCR test result.
Data Availability
The de-identified data that support the findings of this study are available from Cambridge University Hospitals but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request with permission of Cambridge University Hospitals.
