PT  - JOURNAL ARTICLE
AU  - Tampu, Iulian Emil
AU  - Bianchessi, Tamara
AU  - Blystad, Ida
AU  - Lundberg, Peter
AU  - Nyman, Per
AU  - Eklund, Anders
AU  - Haj-Hosseini, Neda
TI  - Pediatric brain tumor classification using deep learning on MR-images with age fusion
AID  - 10.1101/2024.09.05.24313109
DP  - 2024 Jan 01
TA  - medRxiv
PG  - 2024.09.05.24313109
4099  - http://medrxiv.org/content/early/2024/09/06/2024.09.05.24313109.short
4100  - http://medrxiv.org/content/early/2024/09/06/2024.09.05.24313109.full
AB  - Purpose To implement and evaluate deep learning-based methods for the classification of pediatric brain tumors in MR data.Materials and methods A subset of the “Children’s Brain Tumor Network” dataset was retrospectively used (n=178 subjects, female=72, male=102, NA=4, age-range [0.01, 36.49] years) with tumor types being low-grade astrocytoma (n=84), ependymoma (n=32), and medulloblastoma (n=62). T1w post-contrast (n=94 subjects), T2w (n=160 subjects), and ADC (n=66 subjects) MR sequences were used separately. Two deep-learning models were trained on transversal slices showing tumor. Joint fusion was implemented to combine image and age data, and two pre-training paradigms were utilized. Model explainability was investigated using gradient-weighted class activation mapping (Grad-CAM), and the learned feature space was visualized using principal component analysis (PCA).Results The highest tumor-type classification performance was achieved when using a vision transformer model pre-trained on ImageNet and fine-tuned on ADC images with age fusion (MCC: 0.77 ± 0.14 Accuracy: 0.87 ± 0.08), followed by models trained on T2w (MCC: 0.58 ± 0.11, Accuracy: 0.73 ± 0.08) and T1w post-contrast (MCC: 0.41 ± 0.11, Accuracy: 0.62 ± 0.08) data. Age fusion marginally improved the model’s performance. Both model architectures performed similarly across the experiments, with no differences between the pre-training strategies. Grad-CAMs showed that the models’ attention focused on the brain region. PCA of the feature space showed greater separation of the tumor-type clusters when using contrastive pre-training.Conclusion Classification of pediatric brain tumors on MR-images could be accomplished using deep learning, with the top-performing model being trained on ADC data, which is used by radiologists for the clinical classification of these tumors.Key pointsThe vision transformer model pre-trained on ImageNet and fine-tuned on ADC data with age fusion achieved the highest performance, which was significantly better than models trained on T2w (second-best) and T1w-Gd data.Fusion of age information with the image data marginally improved classification, and model architecture (ResNet50 -vs -ViT) and pre-training strategies (supervised -vs -self-supervised) did not show to significantly impact models’ performance.Model explainability, by means of class activation mapping and principal component analysis of the learned feature space, show that the models use the tumor region information for classification and that the tumor type clusters are better separated when using age information.Summary Deep learning-based classification of pediatric brain tumors can be achieved using single-sequence pre-operative MR data, showing the potential of automated decision support tools that can aid radiologists in the primary diagnosis of these tumors.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThe research was made possible in part due to The Children's Brain Tumor Tissue Consortium (CBTTC) / The children's brain tumor network (CBTN). The study was financed by Swedish Childhood Cancer Foundation (MT2021-0011, MT2022-0013), Joanna Cocozza's Foundation (2022-2024), Linkoping University's Cancer Strength Area (2022) and ALF Grants, Region OstergOtland (974566).Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:In this retrospective study, the dataset was obtained upon application to and approval from The Children's Brain Tumor Network (https://cbtn.org/) (accessed in 2021)I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesAll data used in this study is available upon reasonable request to The Children's Brain Tumor Tissue Consortium (CBTTC) / The children's brain tumor network (CBTN). https://cbtn.org/