PT - JOURNAL ARTICLE AU - Jimenez-Solem, Espen AU - Petersen, Tonny S AU - Hansen, Casper AU - Hansen, Christian AU - Lioma, Christina AU - Igel, Christian AU - Boomsma, Wouter AU - Krause, Oswin AU - Lorenzen, Stephan AU - Selvan, Raghavendra AU - Petersen, Janne AU - Nyeland, Martin Erik AU - Zöllner Ankarfeldt, Mikkel AU - Virenfeldt, Gert Mehl AU - Winther-Jensen, Matilde AU - Linneberg, Allan AU - Ghazi, Mostafa Mediphour AU - Detlefsen, Nicki AU - Lauritzen, Andreas AU - Smith, Abraham George AU - de Bruijne, Marleen AU - Ibragimov, Bulat AU - Petersen, Jens AU - Lillholm, Martin AU - Middleton, Jon AU - Mogensen, Stine Hasling AU - Thorsen-Meyer, Hans-Christian AU - Perner, Anders AU - Helleberg, Marie AU - Kaas-Hansen, Benjamin Skov AU - Bonde, Mikkel AU - Bonde, Alexander AU - Pai, Akshay AU - Nielsen, Mads AU - Sillesen, Martin TI - DEVELOPING AND VALIDATING COVID-19 ADVERSE OUTCOME RISK PREDICTION MODELS FROM A BI-NATIONAL EUROPEAN COHORT OF 5594 PATIENTS AID - 10.1101/2020.10.06.20207209 DP - 2020 Jan 01 TA - medRxiv PG - 2020.10.06.20207209 4099 - http://medrxiv.org/content/early/2020/10/11/2020.10.06.20207209.short 4100 - http://medrxiv.org/content/early/2020/10/11/2020.10.06.20207209.full AB - Background Patients with severe COVID-19 have overwhelmed healthcare systems worldwide. We hypothesized that Machine Learning (ML) models could be used to predict risks at different stages of management (at diagnosis, hospital admission and ICU admission) and thereby provide insights into drivers and prognostic markers of disease progression and death.Methods From a cohort of approx. 2.6 million citizens in the two regions of Denmark, SARS-CoV-2 PCR tests were performed on subjects suspected for COVID-19 disease; 3944 cases had at least one positive test and were subjected to further analysis. A cohort of SARS- CoV-2 positive cases from the United Kingdom Biobank was used for external validation.Findings The ML models predicted the risk of death (Receiver Operation Characteristics – Area Under the Curve, ROC-AUC) of 0.904 at diagnosis, 0.818, at hospital admission and 0.723 at Intensive Care Unit (ICU) admission. Similar metrics were achieved for predicted risks of hospital and ICU admission and use of mechanical ventilation. We identified some common risk factors, including age, body mass index (BMI) and hypertension as driving factors, although the top risk features shifted towards markers of shock and organ dysfunction in ICU patients. The external validation indicated fair predictive performance for mortality prediction, but suboptimal performance for predicting ICU admission.Interpretation ML may be used to identify drivers of progression to more severe disease and for prognostication patients in patients with COVID-19. Prognostic features included age, BMI and hypertension, although markers of shock and organ dysfunction became more important in more severe cases.We provide access to an online risk calculator based on these findings.Funding The study was funded by grants from the Novo Nordisk Foundation to MS (#NNF20SA0062879 and #NNF19OC0055183) and MN (#NNF20SA0062879). The foundation took no part in project design, data handling and manuscript preparation.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThe study was funded by grants from the Novo Nordisk Foundation to MS (#NNF20SA0062879 and #NNF19OC0055183) and MN (#NNF20SA0062879). The foundation took no part in project design, data handling and manuscript preparation.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:As per your request for resubmission, we have expanded the information in the manuscript as detailed below. Under Danish Law, ethical and legal approval for access to patient charts for research purposes is governed by the Danish Patients Safety Authority (Styrelsen for Patientsikkerhed, en.stps.dk). Storage and handling of the data is approved by the Danish Data Protection Agency (Datatilsynet, www.datatilsynet.dk). Legal clearance for the study was furthermore obtained from the Danish Capital Region. Under Danish Law, Ethics committee approval (in Denmark, Videnskabsetisk komite) is required for studies requiring interaction with patients, but not for studies solely needing patient chart review and data extraction (without patient contact). For these studies, the Danish Patients Safety Authority is the ethics and legal governing body as stated. As such, the study obtained all necessary legal and ethics approval prior to commencement. New manuscript text: The study was approved by the relevant legal and ethics boards. These included the Danish Patient Safety Authority (Styrelsen for Patientsikkerhed, approval #31-1521-257) and the Danish Data Protection Agency (Datatilsynet, approval #P-2020-320) as well as the UK Biobank (Application ID #60861) COVID-19 cohort. Under Danish law, approval from these agencies are required for access to and handling of patient sensitive data, including EHR records. Legal approval for the study was furthermore obtained from the Danish Capital Region (Region Hovedstaden).All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).Yes I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe presented data have not been made publicly available, due to patient data safety concerns.