PT  - JOURNAL ARTICLE
AU  - Zandehshahvar, Mohammadreza
AU  - van Assen, Marly
AU  - Maleki, Hossein
AU  - Kiarashi, Yashar
AU  - De Cecco, Carlo N.
AU  - Adibi, Ali
TI  - Toward Understanding COVID-19 Pneumonia: A Deep-learning-based Approach for Severity Analysis and Monitoring the Disease
AID  - 10.1101/2020.11.24.20235887
DP  - 2020 Jan 01
TA  - medRxiv
PG  - 2020.11.24.20235887
4099  - http://medrxiv.org/content/early/2020/11/27/2020.11.24.20235887.short
4100  - http://medrxiv.org/content/early/2020/11/27/2020.11.24.20235887.full
AB  - We report a new approach using artificial intelligence to study and classify the severity of COVID-19 using 1208 chest X-rays (CXRs) of 396 COVID-19 patients obtained through the course of disease at Emory Healthcare affiliated hospitals (Atlanta, GA, USA). Using a two-stage transfer learning technique to train a convolutional neural network (CNN), we show that the algorithm is able to classify four classes of disease severity (normal, mild, moderate, and severe) with average area under curve (AUC) of 0.93. In addition, we show that the outputs of different layers of the CNN under dominant filters provide valuable insight about the subtle patterns in the CXRs, which can improve the accuracy in the reading of CXRs by a radiologist. Finally, we show that our approach can be used for studying the disease progression in single patients and its influencing factors. The results suggest that our technique can form the foundation of a more concrete clinical model to predict the evolution of COVID-19 severity and the efficacy of different treatments for each patient through using CXRs and clinical data in early stages. This will be essential in dealing with the upcoming waves of COVID-19 and optimizing resource allocation and treatment.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThe Georgia Tech contributions were supported by Ali Adibi's Joseph M. Pettit Chair account. The Emory contributions were supported by startup funding from Dr. De Cecco.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The CXRs are collected from January 1st, 2020 to May 1st, 2020, and the need for informed consent is waived by the institutional review board (IRB). All images are de-identified according to Health Insurance Portability and Accountability Act (HIPAA) and hospital-specific guidelines. Patients with an age above 90 were noted as > 90. DICOM headers are anonymized and only contain technique-related information, such as information about position of the X-ray (supine, semi-erect etc.) and whether it is a portable X-ray machine or not; all patient-related data are removed. Patients and imaging dates are coded to keep the longitudinal information between CXRs from the same patient. In addition, the date and time stamp, burned into the CXRs, are removed. All the approaches and methods used the anonymized and de-identified CXR data according to the guidelines of Emory University and Georgia Tech and approved by the IRB. All procedures followed HIPAA guidelines. The Emory IRB approved the collection of this data and waived the need of informed consent. The part of the research that is performed at Georgia Tech was based on totally de-identified data and the need for IRB is waived by Georgia Tech IRB.All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe dataset that is used for the first stage of the transfer learning during the training is publicly available on https://www.kaggle.com/c/rsna-pneumonia-detection-challenge/data. The datasets generated during and/or analyzed (i.e., Emory COVID-19 CXR dataset) during the current study are available upon reasonable request. For more information, please contact Dr. Carlo De Cecco and Dr. Ali Adibi.