RT Journal Article
SR Electronic
T1 A comprehensive evaluation of an artificial intelligence based digital pathology to monitor large-scale deworming programs against soil-transmitted helminths: a study protocol
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2023.09.28.23296266
DO 10.1101/2023.09.28.23296266
A1 Ward, Peter K.
A1 Roose, Sara
A1 Ayana, Mio
A1 Broadfield, Lindsay A.
A1 Dahlberg, Peter
A1 Kabatereine, Narcis
A1 Kazienga, Adama
A1 Mekonnen, Zeleke
A1 Nabatte, Betty
A1 Stuyver, Lieven
A1 Vande Velde, Fiona
A1 Van Hoecke, Sofie
A1 Levecke, Bruno
YR 2023
UL http://medrxiv.org/content/early/2023/09/28/2023.09.28.23296266.abstract
AB Background Manual screening of a Kato-Katz (KK) thick stool smear remains the current standard to monitor the impact of large-scale deworming programs against soil-transmitted helminths (STHs). To improve this diagnostic standard, we recently designed an artificial intelligence based digital pathology system (AI-DP) for digital image capture and analysis of KK thick smears. Preliminary results of its diagnostic performance are encouraging, and a comprehensive evaluation of this technology as a cost-efficient end-to-end diagnostic to inform STH control programs against the target product profiles (TPP) of the World Health Organisation (WHO) is the next step for validation.Methods Here, we describe the study protocol for a comprehensive evaluation of the AI-DP based on its (i) diagnostic performance, (ii) repeatability/reproducibility, (iii) time-to-result, (iv) cost-efficiency to inform large-scale deworming programs, and (v) usability in both laboratory and field settings. For each of these five attributes, we designed separate experiments with sufficient power to verify the non-inferiority of the AI-DP (KK2.0) over the manual screening of the KK stool thick smears (KK1.0). These experiments will be conducted in two STH endemic countries with national deworming programs (Ethiopia and Uganda), focussing on school-age children only.Discussion This comprehensive study will provide the necessary data to make an evidence-based decision on whether the technology is indeed performant and a cost-efficient end-to-end diagnostic to inform large-scale deworming programs against STHs. Following the protocolized collection of high-quality data we will seek approval by WHO. Through the dissemination of our methodology and statistics, we hope to support additional developments in AI-DP technologies for other neglected tropical diseases in resource-limited settings.Trial registration The trial was registered on Clinicaltrials.gov (ID: NCT06055530).Author summary Millions of deworming tablets are annually administered to children to reduce the morbidity caused by intestinal worms. To monitor the progress of these large-scale deworming programs, periodic assessments are made regarding the occurrence and prevalence of intestinal worm infections. Manual examination of a stool smear through a compound microscope remains the current diagnostic standard. We recently developed a device that utilizes artificial intelligence (AI) to scan smears and recognize eggs of intestinal worms. Encouraging preliminary results of the diagnostic performance warrant additional and more research, essential for obtaining necessary approvals to support wide-scale adoption.Here, we describe the study protocols we will employ for a comprehensive evaluation of this AI-based device. The generated results will provide health decision-makers with evidence-based data to assess whether the tool can be recommended for informing large-scale deworming programs against intestinal worms. Additionally, we provide full access to our study documentation which may be relevant for evaluating other AI-based devices for intestinal worms.Competing Interest StatementThe authors have declared no competing interest.Clinical TrialNCT06055530Funding StatementYesAuthor DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The study protocol will be submitted to the institutional review boards of the Faculty of Medicine and Health Sciences of Ghent University (Belgium), the Health Institute of Jimma University (Ethiopia), the Vector Control Division Research Ethics committee (Uganda), and the Uganda National Council of Science and Technology for both review and approval.I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesAll relevant data are within the manuscript and its Supporting Information files.