RT Journal Article
SR Electronic
T1 Applications of Digital Microscopy and Densely Connected Convolutional Neural Networks for Automated Quantitation of Babesia-Infected Erythrocytes
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2021.04.27.21256115
DO 10.1101/2021.04.27.21256115
A1 Durant, Thomas JS
A1 Dudgeon, Sarah
A1 McPadden, Jacob
A1 Simpson, Anisia
A1 Price, Nathan
A1 Schulz, Wade
A1 Torres, Richard
A1 Olson, Eben M
YR 2021
UL http://medrxiv.org/content/early/2021/04/29/2021.04.27.21256115.abstract
AB Background Clinical babesiosis is diagnosed, and parasite burden is determined, by microscopic inspection of a thick or thin Giemsa-stained peripheral blood smear. However, quantitative analysis by manual microscopy is subject to observer bias, slide distribution errors, statistical sampling error, recording errors, and is inherently burdensome from time management and workflow efficiency standpoints. As such, methods for the automated measurement of percent parasitemia in digital microscopic images of peripheral blood smears could improve clinical accuracy, relative to the predicate method.Methods Individual erythrocyte images (shape: 70×70×3) were manually labeled as “parasite” or “normal” and were used to train a model for binary image classification. The best model was then used to calculate percent parasitemia from a clinical validation dataset, and values were compared to a clinical reference value. Lastly, model interpretability was examined using an integrated gradient to identify pixels most likely to influence classification decisions.Results The precision and recall of the model during development testing were 0.92 and 1.00, respectively. In clinical validation, the model returned increasing positive signal with increasing mean reference value. However, there were two highly erroneous false positive values returned by the model. Lastly, the model incorrectly assessed three cases well above the clinical threshold of 10%. The integrated gradient suggested potential sources of false positives including rouleaux formations, cell boundaries, and precipitate as deterministic factors in negative erythrocyte images.Conclusions While the model demonstrated highly accurate single cell classification and correctly assessed most slides, several false positives were highly incorrect. This project highlights the need for integrated testing of ML-based models, even when models in the development phase perform well.Competing Interest StatementW.L.S. was an investigator for a research agreement, through Yale University, from the Shenzhen Center for Health Information for work to advance intelligent disease prevention and health promotion; collaborates with the National Center for Cardiovascular Diseases in Beijing; is a technical consultant to HugoHealth, a personal health information platform, and cofounder of Refactor Health, an AI-augmented data management platform for healthcare; is a consultant for Interpace Diagnostics Group, a molecular diagnostics company.Funding StatementAcademy of Clinical Laboratory Physicians and Scientists: Paul E. Strandjord Young Investigator Research GrantAuthor DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:This study was approved by the Yale Institutional Review Board and Human Protections Program (IRB#: 2000020244)All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesData will not be made publicly available.AUCArea Under the CurveFNFalse NegativeFPFalse PositiveIGIntegrated GradientMLSMedical Laboratory ScientistMLS-RSMedical Laboratory Scientist-Reference StandardRBCRed blood cellTNTrue NegativeTPTrue PositiveXAIExplainable Artificial Intelligence