Abstract
Background Radiation-associated lymphedema and fibrosis (LEF) is a significant toxicity following radiation therapy (RT) for head and neck cancer (HNC) patients. Recently, the CT Lymphedema and Fibrosis Assessment Tool (CT-LEFAT) was developed to standardize LEF diagnosis through fat stranding visualized on CT. This study aims to evaluate the inter-observer reliability and diagnostic accuracy of the CT-LEFAT criteria.
Materials and Methods This study retrospectively evaluated 26 HNC patients treated with RT that received a minimum of two contrast-enhanced CT scans. Qualitative review was conducted by five physician raters to assess the fat stranding observed on CT according to the CT-LEFAT criteria. Fleiss’ kappa analysis was used to assess the inter- and intra-rater reliability, and Receiver Operating Characteristic (ROC) Area Under the Curve (AUC) analysis was used to evaluate diagnostic accuracy.
Results The inter-rater reliability across the six CT-LEFAT regions generally indicated a slight to fair agreement across all raters (0.04 ≤ kappa ≤ 0.36). Intra-observer agreement was generally fair to moderate (overall kappa=0.44). The ROC AUC analysis varied based on aggregation method used (0.60 ≤ average AUC ≤ 0.70).
Conclusion This specific use-case evaluating CT-LEFAT criteria displays limited performance. This suggests that additional materials, such as further training, refinement of imaging methods, or other processes may be required before achieving clinically-ready diagnostic performance of LEF diagnosis.
Competing Interest Statement
KAH has received unrelated travel support from: University of Pittsburg Medical Center -Survivorship, The 15th International Netherlands Cancer Institute Head and Neck Symposium, LHNC, 9th Annual International Congress on Innovative Approaches in Head & Neck Oncology, IHNS. KAH holds leadership and/or fiduciary roles in: 10th ESSD Congress, American Head and Neck Society, Oropharynx Cancer Debate, Dysphagia Research Society, Atos Medical, MD Anderson Collaborative Webinar Series, Dysphagia Research Society, American Head and Neck Society, Concepts in Speech and Swallow Rehabilitation, American Society for Radiation Oncology, 3rd World Dysphagia Summit, Dysphagia Research Society, San Francisco, IFHNOS, 7th World Congress of the International Federation of Head & Neck Oncologic Societies, Rome, Italy, International AHNS Program, Montreal, Canada, Dysphagia Research Society Inter-Disciplinary Fall Conference, WI, ICHNO, 9th International Congress on Innovative Approaches in H&N Oncology, Barcelona, Spain. CDF has received related travel, speaker honoraria and/or registration fee waiver from: Elekta AB and unrelated travel, speaker honoraria and/or registration fee waiver from: The American Association for Physicists in Medicine; the University of Alabama-Birmingham; The American Society for Clinical Oncology; The Royal Australian and New Zealand College of Radiologists; The American Society for Radiation Oncology; The Radiological Society of North America; and The European Society for Radiation Oncology. CDF has received related direct industry grant/in-kind support, honoraria, and travel funding from Elekta AB and has served in an unrelated consulting capacity for Varian/Siemens Healthineers. Philips Medical Systems, and Oncospace, Inc.
Funding Statement
NAW is salary supported by a NIH National Institute of Dental and Craniofacial Research (NIDCR) Academic Industrial Partnership Grant (R01DE028290). ZK is supported by a pre-doctoral fellowship from the Cancer Prevention Research Institute of Texas grant #RP210042. SLM is supported by a training fellowship from UTHealth Houston Center for Clinical and Translational Sciences TL1 Program (TL1 TR003169). SYL, KAH, and CDF receive grant and infrastructure support from MD Anderson Cancer Center via the Charles and Daneen Stiefel Center for Head and Neck Cancer Oropharyngeal Cancer Research Program. SJF received funding from Hitachi, NIH/NCI, the National Association of Proton Therapy, Affirmed Pharma and NASA/Baylor College of Medicine and honoraria from IBA. SYL receives related supported through the CCSG Head and Neck Program (P30CA016672-48). KAH is supported through PRO-ACTIVE, Uncovering the Long-Term Impact of Oropharyngeal Cancer and Dysphagia on Dietary Quality and Nutrition among Veteran Cancer Survivors, Dissemination and implementation of DIGEST™ as an evidence-based measurement tool for dysphagia, hRAD, ATOS PATH, MD Anderson Head & Neck Collaborative, Atos Medical. ACM received salary and material support from the NIH/NIDCR via grants K12CA088084, R21DE031082, and K01DE030524. ACM receives philanthropic support from the MD Anderson Cancer Center Charles and Daneen Stiefel Center for Head and Neck Cancer Oropharyngeal Cancer Research Program Institution. CDF has received related funding and salary support from: NIH/NCI Cancer Center Support Grant (CCSG) Image-Driven Biologically-informed Therapy Program (P30CA016672), NIH NCI Research Project Grant (R01CA258827) and resource support from the MD Anderson Program in Image-guided Cancer Therapy.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
The dataset was sequentially sampled from an internal database of 104 patients on an internal protocol (PA16-0302) after institutional review board (IRB) approval at The University of Texas MD Anderson Cancer Center. Given the study's anonymized design, the need for informed consent was waived.
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
Footnotes
↵‡ collaborators:
↵* co-first authors
Funding Disclosures: NAW is salary supported by a NIH National Institute of Dental and Craniofacial Research (NIDCR) Academic Industrial Partnership Grant (R01DE028290).
ZK is supported by a pre-doctoral fellowship from the Cancer Prevention Research Institute of Texas grant #RP210042.
SLM is supported by a training fellowship from UTHealth Houston Center for Clinical and Translational Sciences TL1 Program (TL1 TR003169).
SYL, KAH, and CDF receive grant and infrastructure support from MD Anderson Cancer Center via the Charles and Daneen Stiefel Center for Head and Neck Cancer Oropharyngeal Cancer Research Program.
SJF received funding from Hitachi, NIH/NCI, the National Association of Proton Therapy, Affirmed Pharma and NASA/Baylor College of Medicine and honoraria from IBA.
SYL receives related supported through the CCSG Head and Neck Program (P30CA016672-48).
KAH is supported through PRO-ACTIVE, Uncovering the Long-Term Impact of Oropharyngeal Cancer and Dysphagia on Dietary Quality and Nutrition among Veteran Cancer Survivors, Dissemination and implementation of DIGEST™ as an evidence-based measurement tool for dysphagia, hRAD, ATOS PATH, MD Anderson Head & Neck Collaborative, Atos Medical.
ACM received salary and material support from the NIH/NIDCR via grants K12CA088084, R21DE031082, and K01DE030524. ACM receives philanthropic support from the MD Anderson Cancer Center Charles and Daneen Stiefel Center for Head and Neck Cancer Oropharyngeal Cancer Research Program Institution.
CDF has received related funding and salary support from: NIH/NCI Cancer Center Support Grant (CCSG) Image-Driven Biologically-informed Therapy Program (P30CA016672), NIH NCI Research Project Grant (R01CA258827) and resource support from the MD Anderson Program in Image-guided Cancer Therapy.
Conflicts of Interest KAH has received unrelated travel support from: University of Pittsburg Medical Center - Survivorship, The 15th International Netherlands Cancer Institute Head and Neck Symposium, LHNC, 9th Annual International Congress on Innovative Approaches in Head & Neck Oncology, IHNS. KAH holds leadership and/or fiduciary roles in: 10th ESSD Congress, American Head and Neck Society, Oropharynx Cancer Debate, Dysphagia Research Society, Atos Medical, MD Anderson Collaborative Webinar Series, Dysphagia Research Society, American Head and Neck Society, Concepts in Speech and Swallow Rehabilitation, American Society for Radiation Oncology, 3rd World Dysphagia Summit, Dysphagia Research Society, San Francisco, IFHNOS, 7th World Congress of the International Federation of Head & Neck Oncologic Societies, Rome, Italy, International AHNS Program, Montreal, Canada, Dysphagia Research Society Inter-Disciplinary Fall Conference, WI, ICHNO, 9th International Congress on Innovative Approaches in H&N Oncology, Barcelona, Spain.
CDF has received related travel, speaker honoraria and/or registration fee waiver from: Elekta AB and unrelated travel, speaker honoraria and/or registration fee waiver from: The American Association for Physicists in Medicine; the University of Alabama-Birmingham; The American Society for Clinical Oncology; The Royal Australian and New Zealand College of Radiologists; The American Society for Radiation Oncology; The Radiological Society of North America; and The European Society for Radiation Oncology. CDF has received related direct industry grant/in-kind support, honoraria, and travel funding from Elekta AB and has served in an unrelated consulting capacity for Varian/Siemens Healthineers. Philips Medical Systems, and Oncospace, Inc.
Data availability statement: The anonymized dataset is available in Figshare (10.6084/m9.figshare.27040849).
IRB Statement: The subset was sequentially sampled from an internal database of 104 patients on an internal protocol (PA16-0302) after institutional review board (IRB) approval at The University of Texas MD Anderson Cancer Center. Given the study’s anonymized design, the need for informed consent was waived.
Data Availability
The anonymized dataset is available in Figshare (10.6084/m9.figshare.27040849).
