PT - JOURNAL ARTICLE AU - Chung, Jong-Won AU - Lee, Myungjae AU - Ha, Sue Young AU - Kim, Pyeong Eun AU - Sunwoo, Leonard AU - Kim, Nakhoon AU - Park, Kwang-Yeol AU - Yum, Kyu Sun AU - Shin, Dong-Ick AU - Park, Hong-Kyun AU - Cho, Yong-Jin AU - Hong, Keun-Sik AU - Kim, Jae Guk AU - Lee, Soo Joo AU - Kim, Joon-Tae AU - Seo, Woo-Keun AU - Bang, Oh Young AU - Kim, Gyeong-Moon AU - Kim, Dongmin AU - Bae, Hee- Joon AU - Ryu, Wi-Sun AU - Kim, Beom Joon TI - Multicenter validation of artificial intelligence software predicting large vessel occlusion using noncontrast brain CT AID - 10.1101/2024.07.01.24309790 DP - 2024 Jan 01 TA - medRxiv PG - 2024.07.01.24309790 4099 - http://medrxiv.org/content/early/2024/07/03/2024.07.01.24309790.short 4100 - http://medrxiv.org/content/early/2024/07/03/2024.07.01.24309790.full AB - Background To validate JLK-CTL, an artificial intelligence (AI) software developed to predict large vessel occlusion (LVO) using non-contrast CT (NCCT) scans, and to investigate its clinical implications regarding both infarct volume and functional outcomes.Methods Between January-2021 and April-2023, a consecutive series of patients who concurrently underwent CT angiography and NCCT within 24 hours of last- known-well (LKW) were collected. LVO was confirmed through consensus among three experts reviewing CT angiography. Infarct volumes were quantified using diffusion-weighted imaging (DWI) conducted within seven days of the NCCT. The performance of the JLK-CTL was evaluated based on the area under the receiver operating characteristic curve (AUROC), as well as its sensitivity and specificity. The association of JLK-CTL LVO scores with infarct volumes and functional outcomes was assessed using Pearson correlation and logistic regression analyses, respectively.Results Of 1,391 screened patients, 774 (mean age 69.0 ± 13.6 years, 57.6% men) were included. The median time from LKW to NCCT was 3.1 hours (IQR 1.5–7.4), with 24.2% (n=187) presenting LVO. The JLK-CTL demonstrated AUROC of 0.832 (95% CI 0.804–0.858), with a sensitivity of 0.711 (95% CI 0.641–0.775) and a specificity of 0.830 (95% CI 0.797–0.859) at the predefined threshold. Incorporating the National Institute of Health Stroke Scale into the model increased the AUROC to 0.872 (95% CI 0.846–0.894; p<0.001). The LVO scores showed a significant correlation with infarct volumes on follow-up DWI (r=0.53; p<0.001). When JLK-CTL LVO scores were categorized based on observed frequency of LVO, the highest JLK-CTL LVO scores (51-100) group showed an independent association with unfavorable functional outcomes (adjusted odds ratio 9.48; 95% CI 3.98–22.55).Conclusion The performance of the AI software in predicting LVO was validated across multiple centers. This tool has the potential to assist physicians in optimizing stroke management workflows, especially in resource-limited settings.Competing Interest StatementLee, Ha, P.Kim, D.Kim, and Ryu are employees of JLK Inc., Seoul, Republic of Korea.Funding StatementThis research was supported by the Multiministry Grant for Medical Device Development (KMDF_PR_20200901_0098), funded by the Korean government and a grant of the Korea Health Technology R&D Project through the Korea Health Industry Development Institute, funded by the Ministry of Health & Welfare, Republic of Korea (grant number: HI22C0454).Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The study protocol was approved by the institutional review board of Seoul National University Bundang Hospital [B-2307-841-303].I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesThe anonymized data used for this study will be made available upon reasonable request and the approval of our Data Steering Committee.