RT Journal Article SR Electronic T1 Development of a deep learning classifier to accurately distinguish COVID-19 from look-a-like pathology on lung ultrasound JF medRxiv FD Cold Spring Harbor Laboratory Press SP 2020.10.13.20212258 DO 10.1101/2020.10.13.20212258 A1 Arntfield, Robert A1 VanBerlo, Blake A1 Alaifan, Thamer A1 Phelps, Nathan A1 White, Matt A1 Chaudhary, Rushil A1 Ho, Jordan A1 Wu, Derek YR 2020 UL http://medrxiv.org/content/early/2020/10/22/2020.10.13.20212258.abstract AB Objectives Lung ultrasound (LUS) is a portable, low cost respiratory imaging tool but is challenged by user dependence and lack of diagnostic specificity. It is unknown whether the advantages of LUS implementation could be paired with deep learning techniques to match or exceed human-level, diagnostic specificity among similar appearing, pathological LUS images.Design A convolutional neural network was trained on LUS images with B lines of different etiologies. CNN diagnostic performance, as validated using a 10% data holdback set was compared to surveyed LUS-competent physicians.Setting Two tertiary Canadian hospitals.Participants 600 LUS videos (121,381 frames) of B lines from 243 distinct patients with either 1) COVID-19, Non-COVID acute respiratory distress syndrome (NCOVID) and 3) Hydrostatic pulmonary edema (HPE).Results The trained CNN performance on the independent dataset showed an ability to discriminate between COVID (AUC 1.0), NCOVID (AUC 0.934) and HPE (AUC 1.0) pathologies. This was significantly better than physician ability (AUCs of 0.697, 0.704, 0.967 for the COVID, NCOVID and HPE classes, respectively), p < 0.01.Conclusions A deep learning model can distinguish similar appearing LUS pathology, including COVID-19, that cannot be distinguished by humans. The performance gap between humans and the model suggests that subvisible biomarkers within ultrasound images could exist and multi-center research is merited.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThere was no external funding. This project was self-funded by the investigators.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:University of Western Ontario Research Ethics Board (REB 115723)All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe GitHub link to the code used to generate the DL model and the full survey data results can be found in our supplementary appendix. https://github.com/bvanberl/covid-us-ml