ABSTRACT
Purpose Hyperspectral imaging (HSI) collects detailed spectral information across hundreds of narrow bands, providing valuable datasets for applications such as medical diagnostics. However, the large size of HSI datasets, often exceeding several gigabytes, creates significant challenges in data transmission, storage, and processing. This study aims to develop a wavelet-based compression method that addresses these challenges while preserving the integrity and quality of spectral information.
Approach The proposed method applies wavelet transforms to the spectral dimension of hyperspectral data in three steps: 1) wavelet transformation for dimensionality reduction, 2) spectral cropping to eliminate low-intensity bands, and 3) scale matching to maintain accurate wavelength mapping. Daubechies wavelets were used to achieve up to 32x compression while ensuring spectral fidelity and spatial feature retention.
Results The wavelet-based method achieved up to 32x compression, corresponding to a 96.88% reduction in data size without significant loss of important data. Unlike PCA and ICA, the method preserved the original wavelength scale, enabling straightforward spectral interpretation. Additionally, the compressed data exhibited minimal loss in spatial features, with improvements in contrast and noise reduction compared to spectral binning.
Conclusions This study demonstrates that wavelet-based compression is an effective solution for managing large HSI datasets in medical imaging. The method preserves critical spectral and spatial information, and therefore facilitates efficient data storage and processing, providing the way for practical integration of HSI technology in clinical applications.
Competing Interest Statement
Dr. Berezin is the founder of the company HSpeQ LLC, that licensed IDCubePro software from Washington University.
Funding Statement
NIH funding: 1R21NS135646, 5R21CA269099, and 1R01GM141344. NSF funding 1827656.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
The study used published datasets that were submitted in the previous publication: Du, T., Mishra, D. K., Shmuylovich, L., Yu, A., Hurbon, H., Wang, S. T., & Berezin, M. Y. (2020). Hyperspectral imaging and characterization of allergic contact dermatitis in the short‐wave infrared. Journal of biophotonics, 13(9), e202000040. The data are publicly available at the links shown below. The protocol was approved on 12/15/16 by The Washington University in St. Louis Institutional Review Board (IRB ID#201609125).
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
The Chan Zuckerberg Initiative, Cold Spring Harbor Laboratory, the Sergey Brin Family Foundation, California Institute of Technology, Centre National de la Recherche Scientifique, Fred Hutchinson Cancer Center, Imperial College London, Massachusetts Institute of Technology, Stanford University, University of Washington, and Vrije Universiteit Amsterdam.