Abstract
Background The hyperdense artery sign (HAS) in patients with large vessel occlusion (LVO) is associated with outcomes after ischemic stroke. Considering the labor-intensive nature of manual segmentation of HAS, we developed and validated an automated HAS segmentation algorithm on non-contrast brain CT (NCCT) images using a multicenter dataset with independent annotations by two experts.
Methods For the training dataset, we included patients with ischemic stroke undergoing concurrent NCCT and CT angiography between May 2011 and December 2022 from six stroke centers. The model was externally validated using a dataset from one stroke center. For the clinical validation dataset, a consecutive series of patients admitted within 24 hours of symptom onset were included between December 2020 and April 2023 from six stroke centers. The model was trained using a 2D U-Net algorithm with manual segmentation by two experts. We constructed models trained on datasets annotated individually by each expert, and an ensemble model using shuffled annotations from both experts. The performance of the models was compared using area under the receiver operating characteristics curve (AUROC), sensitivity, and specificity.
Results A total of 673, 365, and 774 patients were included in the training, external validation, and clinical validation datasets, respectively, with mean (SD) ages of 68.8 (13.2), 67.6 (13.4), and 68.8 (13.6) years and male frequencies of 55.0%, 59.5%, and 57.6%. The ensemble model achieved higher AUROC and sensitivity compared to the models trained on annotations from a single expert in the external validation dataset. In the clinical validation dataset, the ensemble model exhibited an AUROC of 0.846 (95% CI, 0.819–0.871), sensitivity of 76.8% (65.1–86.1%), and specificity of 88.5% (85.9–90.8%). The predicted volume of the clot was significantly correlated with infarct volume on follow-up diffusion-weighted imaging (r=0.42; p<0.001).
Conclusion Our algorithm promptly and accurately identifies clot signs, facilitating the screening of potential patients who may require intervention.
Competing Interest Statement
M.Lee, S.Ha, P.Kim, D.Kim, and W-S.Ryu are employees of JLK Inc., Seoul, Republic of Korea.
Funding Statement
This research was supported by the Multiministry Grant for Medical Device Development (KMDF_PR_20200901_0098), funded by the Korean government and a grant of the Korea Health Technology R&D Project through the Korea Health Industry Development Institute, funded by the Ministry of Health & Welfare, Republic of Korea (grant number: HI22C0454).
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
The institutional review boards of Seoul National University Bundang hospital approved the study and waived informed consent due to the anonymous and retrospective study design.
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
Data Availability
The data that support the findings of this study are available from the corresponding author upon request.
Non-standard Abbreviations and Acronyms
- HAS
- hyperdense artery sign
- NCCT
- noncontrast computed tomography
- LVO
- large vessel occlusion
- AI
- artificial intelligence
- CTA
- computed tomography angiography
- DWI
- diffusion-weighted image
- NIHSS
- National Institutes of Health Stroke Scale
- mTICI
- modified thrombolysis in cerebral infarction
- EVT
- endovascular treatment
- mRS
- modified Rankin Scale
- HU
- Hounsfield unit
- DSC
- Dice similarity coefficient
- AUROC
- area under the receiver operating characteristic curve
- PPV
- positive predictive value
- NPV
- negative predictive value