PT - JOURNAL ARTICLE AU - Syed, Sana AU - Ehsan, Lubaina AU - Shrivastava, Aman AU - Sengupta, Saurav AU - Khan, Marium AU - Kowsari, Kamran AU - Guleria, Shan AU - Sali, Rasoul AU - Kant, Karan AU - Kang, Sung-Jun AU - Sadiq, Kamran AU - Iqbal, Najeeha T. AU - Cheng, Lin AU - Moskaluk, Christopher A. AU - Kelly, Paul AU - Amadi, Beatrice C. AU - Ali, S. Asad AU - Moore, Sean R. AU - Brown, Donald E. TI - Artificial Intelligence-Based Analytics for Diagnosis of Small Bowel Enteropathies and Black Box Feature Detection AID - 10.1101/2020.08.06.20159152 DP - 2020 Jan 01 TA - medRxiv PG - 2020.08.06.20159152 4099 - http://medrxiv.org/content/early/2020/08/12/2020.08.06.20159152.short 4100 - http://medrxiv.org/content/early/2020/08/12/2020.08.06.20159152.full AB - Objectives Striking histopathological overlap between distinct but related conditions poses a significant disease diagnostic challenge. There is a major clinical need to develop computational methods enabling clinicians to translate heterogeneous biomedical images into accurate and quantitative diagnostics. This need is particularly salient with small bowel enteropathies; Environmental Enteropathy (EE) and Celiac Disease (CD). We built upon our preliminary analysis by developing an artificial intelligence (AI)-based image analysis platform utilizing deep learning convolutional neural networks (CNNs) for these enteropathies.Methods Data for secondary analysis was obtained from three primary studies at different sites. The image analysis platform for EE and CD was developed using convolutional neural networks (CNNs: ResNet and custom Shallow CNN). Gradient-weighted Class Activation Mappings (Grad-CAMs) were used to visualize the models’ decision making process. A team of medical experts simultaneously reviewed the stain color normalized images done for bias reduction and Grad-CAM visualizations to confirm structural preservation and biological relevance, respectively.Results 461 high-resolution biopsy images from 150 children were acquired. Median age (interquartile range) was 37·5 (19·0 to 121·5) months with a roughly equal sex distribution; 77 males (51·3%). ResNet50 and Shallow CNN demonstrated 98% and 96% case-detection accuracy, respectively, which increased to 98·3% with an ensemble. Grad-CAMs demonstrated models’ ability to learn distinct microscopic morphological features.Conclusion Our AI-based image analysis platform demonstrated high classification accuracy for small bowel enteropathies which was capable of identifying biologically relevant microscopic features, emulating human pathologist decision making process, performing in the case of suboptimal computational environment, and being modified for improving disease classification accuracy. Grad-CAMs that were employed illuminated the otherwise ‘black box’ of deep learning in medicine, allowing for increased physician confidence in adopting these new technologies in clinical practice.What is knownStriking histopathological overlap exists between distinct but related conditions which poses a significant disease diagnostic challenge; such as for small bowel enteropathies including Environmental Enteropathy (EE) and Celiac Disease (CD).There is a major clinical need to develop computational [including Artificial Intelligence (AI) and deep learning] methods enabling clinicians to translate heterogeneous biomedical images into accurate and quantitative diagnostics.A major issue plaguing the use of AI in medicine is the so-called ‘black box’ of deep learning, an analogy which describes the lack of insight that humans have into how the models arrive at their decision-makingWhat is newAI-based image analysis platform demonstrated high classification accuracy for small bowel enteropathies (EE vs. CD vs. histologically normal controls).Gradient-weighted Class Activation Mappings (Grad-CAMs) illuminated the otherwise ‘black box’ of deep learning in medicine, allowing for increased physician confidence in adopting these new technologies in clinical practice.Competing Interest StatementThe authors have declared no competing interest.Clinical TrialDoes not include clinical trialFunding StatementResearch reported in this manuscript was supported by National Institute of Diabetes and Digestive and Kidney Diseases of the National Institutes of Health under award number K23DK117061-01A1 (Syed), Bill and Melinda Gates Foundation under award numbers OPP1066203 (Ali) and OPP1066118 (Kelly), University of Virginia Center for Engineering in Medicine Grant (Syed and Brown), and University of Virginia THRIV Scholar Career Development Award (Syed). The content is solely the responsibility of the authors and does not necessarily represent the official views of the funding agencies.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The secondary analyses as part of this study were approved by University of Virginia Institutional Review Board. Ethical approval for prior original primary studies was obtained from: 1) the Ethical Review Committee of Aga Khan University, Karachi, PK (informed consent obtained from parents and/ or guardians for EE cases), 2) the Biomedical Research Ethics Committee of the University of Zambia School of Medicine, University Teaching Hospital, Lusaka, ZA (informed consent obtained from caregivers for EE cases), and 3) University of Virginia Institutional Review Board (waiver of consent granted).All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesData can be available on request