Abstract
Background Accurate brain meningioma detection, segmentation and volumetric assessment are critical for serial patient follow-up, surgical planning and monitoring response to treatment. Current gold standard of manual labeling is a time-consuming process, subject to inter-user variability. Fully-automated algorithms for meningioma detection and segmentation have the potential to bring volumetric analysis into clinical and research workflows by increasing accuracy and efficiency, reducing inter-user variability and saving time. Previous research has focused solely on segmentation tasks without assessment of impact and usability of deep learning solutions in clinical practice.
Methods We developed a three-dimensional convolutional neural network (3D-CNN) to perform expert-level, automated meningioma segmentation and volume estimation on MRI scans. A 3D-CNN was initially trained by segmenting entire brain volumes using a dataset of 10,099 healthy brain MRIs. Using transfer learning, the network was then specifically trained on meningioma segmentation using 806 expert-labeled MRIs. The algorithm tumor-labeling performance was assessed with standard metrics of tumor segmentation performance (i.e., Dice score). To evaluate clinical applicability, we compared volume estimation accuracy and segmentation time based on current practice versus the use of our automated algorithm.
Findings The final model achieved a median performance of 88.2% reaching the spectrum of current inter-expert variability (82.6% - 91.6%). Compared to current workflows, the use of the algorithm reduced processing time by 99% and produced tumor volume calculations with an almost perfect correlation with the expert manual segmentations (r=0.98, p<0.001), significantly more accurate compared to volume estimation techniques used in practice.
Conclusions We demonstrate through a prospective trial conducted in a simulated setting that a deep learning approach to meningioma segmentation is feasible, highly accurate and can substantially improve current clinical practice.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
J.R.K was partially supported by R01EB020740, P41EB019936, and T32GM008444. S.G. was partially supported by R01EB020740, P41EB019936, and RF1MH121885. A.R. was supported by RF1MH121885
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
We operated under institutional review board approval. The Partners Human Research Committee provided approval for the research through a dedicated research protocol (protocol number 2015P002352)
All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.
Yes
Data Availability
Data Availability The majority of the healthy brain MRI dataset used and analyzed during the current study is publicly available at https://sensein.github.io/open-data-processing/. Restrictions apply to part of the healthy brain MRI dataset and the whole meningioma MRI dataset as derived from private, institutional databases and contain information that could enable patient identification. The authors will consider request to access to training and testing data on individual basis. Any data use will be restricted to non-commercial research purposes, and the data will only be made available upon execution of appropriate data use agreements. Code availability As reported in the Methods section of the manuscript, the code for the algorithm development and evaluation is publicly available at: https://github.com/neuronets/ams and the pretrained model is available at https://github.com/neuronets/trainedmodels/tree/master/neuronets/ams/0.1.0.
https://sensein.github.io/open-data-processing/.
https://github.com/neuronets/ams
https://github.com/neuronets/trainedmodels/tree/master/neuronets/ams/0.1.0.