PT - JOURNAL ARTICLE AU - Jin, Cheng AU - Chen, Weixiang AU - Cao, Yukun AU - Xu, Zhanwei AU - Tan, Zimeng AU - Zhang, Xin AU - Deng, Lei AU - Zheng, Chuansheng AU - Zhou, Jie AU - Shi, Heshui AU - Feng, Jianjiang TI - Development and Evaluation of an AI System for COVID-19 Diagnosis AID - 10.1101/2020.03.20.20039834 DP - 2020 Jan 01 TA - medRxiv PG - 2020.03.20.20039834 4099 - http://medrxiv.org/content/early/2020/06/02/2020.03.20.20039834.short 4100 - http://medrxiv.org/content/early/2020/06/02/2020.03.20.20039834.full AB - Early detection of COVID-19 based on chest CT will enable timely treatment of patients and help control the spread of the disease. With rapid spreading of COVID-19 in many countries, however, CT volumes of suspicious patients are increasing at a speed much faster than the availability of human experts. We proposed an artificial intelligence (AI) system for fast COVID-19 detection and performed extensive statistical analysis of CTs of COVID-19 based on the AI system. We developed and evaluated our system on a large dataset with more than 10 thousand CT volumes from COVID-19, influenza-A/B, non-viral community acquired pneumonia (CAP) and non-pneumonia subjects. In such a difficult multi-class diagnosis task, our deep convolutional neural network-based system is able to achieve an area under the receiver operating characteristic curve (AUC) of 97.17%, a sensitivity of 90.19%, and a specificity of 95.76% for COVID-19 on internal test cohort of 3,203 scans and AUC of 97.77% on the publicly available CC-CCII database with 1,943 test samples. In a reader study involving five radiologists, the AI system outperforms all of radiologists in more challenging tasks at a speed of two orders of magnitude above them. Diagnosis performance of chest x-ray (CXR) is compared. Detailed interpretation of deep network is also performed to relate AI results with CT findings. The code is available at https://github.com/ChenWWWeixiang/diagnosis_covid19.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThis study was supported by Zhejiang University special scientific research fund for COVID-19 prevention and control.Author DeclarationsAll relevant ethical guidelines have been followed; any necessary IRB and/or ethics committee approvals have been obtained and details of the IRB/oversight body are included in the manuscript.YesAll necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThree databases in our experiments are publicly available. LIDC-IDRI database can be accessed at https://wiki.cancerimagingarchive.net/display/Public/LIDC-IDRI. Tianchi-Alibaba database can be accessed at https://tianchi.aliyun.com/competition/entrance/231601/information. CC-CCII database can be accessed at http://ncov-ai.big.ac.cn/download. The datasets from Wuhan Union Hospital, Western Campus of Wuhan Union Hospital, and Jianghan Mobile Cabin Hospital were used under the license of the current study and are not publicly available. https://wiki.cancerimagingarchive.net/display/Public/LIDC-IDRI. https://tianchi.aliyun.com/competition/entrance/231601/information http://ncov-ai.big.ac.cn/download