Abstract
Objective Multiple studies have attempted to generate visual field (VF) mean deviation (MD) estimates using cross-sectional optical coherence tomography (OCT) data. However, whether such models offer any value in detecting longitudinal VF progression is unclear. We address this by developing a machine learning (ML) model to convert OCT data to MD and assessing its ability to detect longitudinal worsening.
Design Retrospective, longitudinal study
Participants A model dataset of 70,575 paired OCT/VFs to train an ML model converting OCT to VF-MD. A separate progression dataset of 4,044 eyes with ≥ 5 paired OCT/VFs to assess the ability of OCT-derived MD to detect worsening. Progression dataset eyes had two additional unpaired VFs (≥ 7 total) to establish a “ground truth” rate of progression defined by MD slope.
Methods We trained an ML model using paired VF/OCT data to estimate MD measurements for each OCT scan (OCT-MD). We used this ML model to generate longitudinal OCT-MD estimates for progression dataset eyes. We calculated MD slopes after substituting/supplementing VF-MD with OCT-MD and measured the ability to detect progression. We labeled true progressors using a ground truth MD slope <0.5 dB/year calculated from ≥ 7 VF-MD measurements. We compared the area under the curve (AUC) of MD slopes calculated using both VF-MD (with <7 measurements) and OCT-MD. Because we found OCT-MD substitution had a statistically inferior AUC to VF-MD, we simulated the effect of reducing OCT-MD mean absolute error (MAE) on the ability to detect worsening.
Main Outcome Measures AUC
Results OCT-MD estimates had an MAE of 1.62 dB. AUC of MD slopes with partial OCT-MD substitution was significantly worse than the VF-MD slope. Supplementing VF-MD with OCT-MD also did not improve AUC, regardless of MAE. OCT-MD estimates needed an MAE ≤ 1.00 dB before AUC was statistically similar to VF-MD alone.
Conclusion ML models converting OCT data to VF-MD with error levels lower than published in prior work (MAE: 1.62 dB) were inferior to VF-MD data for detecting trend-based VF progression. Models converting OCT data to VF-MD must achieve better prediction errors (MAE ≤ 1 dB) to be clinically valuable at detecting VF worsening.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
Supported by grants from the National Institute of Health 1K23EY032204-02,Research to Prevent Blindness Unrestricted Grant, BrightFocus Foundation G2023010S, and ARVO Epstein Award
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
Our study was approved by the Johns Hopkins University School of Medicine Institutional Review Board.
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
Footnotes
Meeting Presentation: Association for Research in Vision and Ophthalmology (ARVO) 2023
Financial Support: Supported by grants from the National Institute of Health 1K23EY032204-02,Research to Prevent Blindness Unrestricted Grant, BrightFocus Foundation G2023010S, and ARVO Epstein Award
Conflict of Interest: None relevant
Reprint Address: Wilmer Eye Institute, Johns Hopkins Hospital, 600 N. Wolfe St., Baltimore, MD 21287, USA.
Data Availability
All data produced in the present study are available upon reasonable request to the authors
Abbreviations and Acronyms
- VF
- visual field
- MD
- mean deviation
- dB
- decibels
- OCT
- optical coherence tomography
- RNFL
- retinal nerve fiber layer
- ML
- machine learning
- MAE
- mean absolute error
- SVM
- support vector machine
- AUC
- area under the curve