PT  - JOURNAL ARTICLE
AU  - Torres-Simon, Lucia
AU  - del Cerro-León, Alberto
AU  - Yus, Miguel
AU  - Bruña, Ricardo
AU  - Gil-Martinez, Lidia
AU  - Marcos Dolado, Alberto
AU  - Maestú, Fernando
AU  - Arrazola-Garcia, Juan
AU  - Cuesta, Pablo
TI  - Comparison between tools for automatic segmentation of white matter hyperintensities of presumed vascular origin in aging: which one, how and why to choose the most suitable for your purpose?
AID  - 10.1101/2023.03.30.23287946
DP  - 2023 Jan 01
TA  - medRxiv
PG  - 2023.03.30.23287946
4099  - http://medrxiv.org/content/early/2023/04/03/2023.03.30.23287946.short
4100  - http://medrxiv.org/content/early/2023/04/03/2023.03.30.23287946.full
AB  - Cerebrovascular damage consequent to small vessel disease (SVD) is a common companion of healthy and pathological aging. Neuroimaging signatures of SVD are present in virtually all people older than 60 years, and their prevalence increases with age. According to the STRIVE criteria, white matter hyperintensities (WMH) have been associated with different clinical symptoms and constitute a good clinical proxy for SVD. This is important as WMH can be directly assessed via MRI. Currently, the most widely used method to detect and assess the severity of HWH are clinical scales based on visual assessment, but these scales do not offer real quantitative information, making it difficult to assess progression. Quantitative information can be approached through the manual segmentation of physicians, but this process is extremely time-consuming and presents a high inter and intra evaluators variability, which makes its application in routine protocols unfeasible. Therefore, it is imperative to facilitate the use of automatic protocols capable of providing WMH load measurements that are as accurate as possible to those obtained by manual segmentation. In this study, we aim to identify the most accurate software for WMH segmentation, providing not only methodological insights but also usability knowledge that would enlighten the tradeoff between clinical accuracy and real-world implementation. The data set consisted of T1 and Flair images of 45 cognitively healthy older participants (mean age 71 ± 5). The study analyzed WMH segmentations obtained with clinician manual segmentation and four tools included in three of the most widely used neuroimaging toolkits: 1) Lesion Prediction Algorithm (LPA) and Lesion Growth Algorithm (LGA) of the lesion segmentation tool (LST); 2) sequence adaptive multimodal segmentation (SAMSEG); and 3) the brain intensity anomalies classification algorithm (BIANCA). The analysis evaluated the correlations with the Fazekas clinical scale, the influence of the WMH load and evaluated the performance at the individual lesion level. The results showed that the supervised methods (LST-LPA and BIANCA) performed better in all the analyzes and were the only ones capable of consistently capturing small lesions (<26 mm3). However, these tools lose performance when applied to new data. Considering the results (accuracy and ease of use), we concluded that, in the general case, the combined use of the two FSL tools emerged as the best option. We confirmed this conclusion by evaluating WMH segmentation in a dataset of 500 older individuals and found that the LPA results, using LGA to control for divergences, offered valuable and actionable clinical information, both to help clinicians make treatment decisions treatment and to monitor pathological progression.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThe authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The Hospital Universitario San Carlos Ethics Committee (Madrid) approved the study, and all participants signed a written informed consent prior to participation.I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesAll data produced in the present study are available upon reasonable request to the authors