RT Journal Article
SR Electronic
T1 COVID-19 Classification of X-ray Images Using Deep Neural Networks
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2020.10.01.20204073
DO 10.1101/2020.10.01.20204073
A1 Goldstein, Elisha
A1 Keidar, Daphna
A1 Yaron, Daniel
A1 Shachar, Yair
A1 Blass, Ayelet
A1 Charbinsky, Leonid
A1 Aharony, Israel
A1 Lifshitz, Liza
A1 Lumelsky, Dimitri
A1 Neeman, Ziv
A1 Mizrachi, Matti
A1 Hajouj, Majd
A1 Eizenbach, Nethanel
A1 Sela, Eyal
A1 Weiss, Chedva
A1 Levin, Philip
A1 Benjaminov, Ofer
A1 Bachar, Gil N
A1 Tamir, Shlomit
A1 Rapson, Yael
A1 Suhami, Dror
A1 dror, amiel a
A1 Bogot, Naama
A1 Grubstein, Ahuva
A1 Shabsin, Nogah
A1 Elyada, Yishai M
A1 Eldar, Yonina
YR 2021
UL http://medrxiv.org/content/early/2021/01/26/2020.10.01.20204073.abstract
AB Objectives In the midst of the coronavirus disease 2019 (COVID-19) outbreak, chest X-ray (CXR) imaging is playing an important role in diagnosis and monitoring of patients with COVID-19. Machine learning solutions have been shown to be useful for X-ray analysis and classification in a range of medical contexts. In this study, we propose a machine learning model for detection of patients tested positive for COVID-19 from CXRs that were collected from inpatients hospitalized in four different hospitals. We additionally present a tool for retrieving similar patients according to the model’s results on their CXRs.Methods In this retrospective study, 1384 frontal CXRs, of COVID-19 confirmed patients imaged between March-August 2020, and 1024 matching CXRs of non-COVID patients imaged before the pandemic, were collected and used to build a deep learning classifier for detecting patients positive for COVID-19. The classifier consists of an ensemble of pre-trained deep neural networks (DNNS), specifically, ReNet34, ReNet50, ReNet152, vgg16, and is enhanced by data augmentation and lung segmentation. We further implemented a nearest-neighbors algorithm that uses DNN-based image embeddings to retrieve the images most similar to a given image.Results Our model achieved accuracy of 90.3%, (95%CI: 86.3%-93.7%) specificity of 90% (95%CI: 84.3%-94%), and sensitivity of 90.5% (95%CI: 85%-94%) on a test dataset comprising 15% (350/2326) of the original images. The AUC of the ROC curve is 0.96 (95%CI: 0.93-0.97).Conclusion We provide deep learning models, trained and evaluated on CXRs that can assist medical efforts and reduce medical staff workload in handling COVID-19.Key PointsA machine learning model was able to detect chest X-ray (CXR) images of patients tested positive for COVID-19 with accuracy and detection rate above 90%.A tool was created for finding existing CXR images with imaging characteristics most similar to a given CXR, according to the model’s image embeddings.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThe work was funded by CoronaVirus Fund, Weizmann Insititue of Science.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:This retrospective study was approved by the Institutional Review Board (IRB) and the Helsinki committee of the participating medical centers: 1) Department of Radiology, HaEmek Medical Center, Afula, Israel 2) Department of Otolaryngology, Head and Neck Surgery, Galilee Medical Center, Nahariya, Israel; 3) Cardiothoracic Imaging Unit, Shaare Zedek Medical Center, Jerusalem, Israel 4) Radiology department, Rabin Medical Center, Jabotinsky Rd 39, Petah Tikva; The study was approved in compliance with the public health regulations and provisions of the current harmonized international guidelines for good clinical practice (ICH-GCP) and in accordance with Helsinki principles. Informed consent was waived by the IRB of the above centers for the purpose of this study. Data extracted from medical records retrieved included only non-identifying information such as age, sex, vital signs, blood counts, chemistry, SARS-CoV-2 swab testing results, chemistry, and X-ray imaging files obtained as part of the diagnostic pipeline upon admission and on routine medical follow-up.All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe code will be made available upon publication of the paper https://github.com/X-ray-Covid-19-AI/covid19_xray_pub CXRchest x-rayCOVID-19Coronavirus Disease 2019RT-PCRreverse transcription polymerase chain reactionROCreceiver operating characteristicP-R curveprecision-recall curveAUCarea under the curveGTground truthFPRfalse positive rateTPRtrue positive rate