PT  - JOURNAL ARTICLE
AU  - Shen, Yiqiu
AU  - Shamout, Farah E.
AU  - Oliver, Jamie R.
AU  - Witowski, Jan
AU  - Kannan, Kawshik
AU  - Park, Jungkyu
AU  - Wu, Nan
AU  - Huddleston, Connor
AU  - Wolfson, Stacey
AU  - Millet, Alexandra
AU  - Ehrenpreis, Robin
AU  - Awal, Divya
AU  - Tyma, Cathy
AU  - Samreen, Naziya
AU  - Gao, Yiming
AU  - Chhor, Chloe
AU  - Gandhi, Stacey
AU  - Lee, Cindy
AU  - Kumari-Subaiya, Sheila
AU  - Leonard, Cindy
AU  - Mohammed, Reyhan
AU  - Moczulski, Christopher
AU  - Altabet, Jaime
AU  - Babb, James
AU  - Lewin, Alana
AU  - Reig, Beatriu
AU  - Moy, Linda
AU  - Heacock, Laura
AU  - Geras, Krzysztof J.
TI  - Artificial Intelligence System Reduces False-Positive Findings in the Interpretation of Breast Ultrasound Exams
AID  - 10.1101/2021.04.28.21256203
DP  - 2021 Jan 01
TA  - medRxiv
PG  - 2021.04.28.21256203
4099  - http://medrxiv.org/content/early/2021/04/30/2021.04.28.21256203.short
4100  - http://medrxiv.org/content/early/2021/04/30/2021.04.28.21256203.full
AB  - Ultrasound is an important imaging modality for the detection and characterization of breast cancer. Though consistently shown to detect mammographically occult cancers, especially in women with dense breasts, breast ultrasound has been noted to have high false-positive rates. In this work, we present an artificial intelligence (AI) system that achieves radiologist-level accuracy in identifying breast cancer in ultrasound images. To develop and validate this system, we curated a dataset consisting of 288,767 ultrasound exams from 143,203 patients examined at NYU Langone Health, between 2012 and 2019. On a test set consisting of 44,755 exams, the AI system achieved an area under the receiver operating characteristic curve (AUROC) of 0.976. In a reader study, the AI system achieved a higher AUROC than the average of ten board-certified breast radiologists (AUROC: 0.962 AI, 0.924±0.02 radiologists). With the help of the AI, radiologists decreased their false positive rates by 37.4% and reduced the number of requested biopsies by 27.8%, while maintaining the same level of sensitivity. To confirm its generalizability, we evaluated our system on an independent external test dataset where it achieved an AUROC of 0.911. This highlights the potential of AI in improving the accuracy, consistency, and efficiency of breast ultrasound diagnosis worldwide.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThis work was supported in part by grants from the National Institutes of Health (P41EB017183, R21CA225175), the National Science Foundation (1922658), the Gordon and Betty Moore Foundation (9683), the Polish National Agency for Academic Exchange (PPN/IWA/2019/1/00114/U/00001) and NYU Abu Dhabi.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:This retrospective study was approved by the NYU Langone Health Institutional Review Board (ID#i18-00712_CR3) and is compliant with the Health Insurance Portability and Accountability Act. Informed consent was waived since the study presents no more than minimal risk.All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesThe external test dataset is publicly available at https://scholar.cu.edu.eg/?q=afahmy/pages/dataset. The NYU Breast Ultrasound Dataset is not currently permitted for public release by the institutional review board. We published the following report explaining how the dataset was created for reproducibility: https://cs.nyu.edu/~kgeras/reports/ultrasound_datav1.0.pdf. https://scholar.cu.edu.eg/?q=afahmy/pages/dataset https://cs.nyu.edu/~kgeras/reports/ultrasound_datav1.0.pdf