ABSTRACT
Objectives To develop, validate and implement algorithms to identify diabetic retinopathy (DR) cases and controls from electronic health care records (EHR)s. Methods: We developed and validated EHR-based algorithms to identify DR cases and individuals with type I or II diabetes without DR (controls) in three independent EHR systems: Vanderbilt University Medical Center Synthetic Derivative (VUMC), the VA Northeast Ohio Healthcare System (VANEOHS), and Massachusetts General Brigham (MGB). Cases were required to meet one of three criteria: 1) two or more dates with any DR ICD-9/10 code documented in the EHR, or 2) at least one affirmative health-factor or EPIC code for DR along with an ICD9/10 code for DR on a different day, or 3) at least one ICD-9/10 code for any DR occurring within 24 hours of an ophthalmology exam. Criteria for controls included affirmative evidence for diabetes as well as an ophthalmology exam.
Results The algorithms, developed and evaluated in VUMC through manual chart review, resulted in a positive predictive value (PPV) of 0.93 for cases and negative predictive value (NPV) of 0.97 for controls. Implementation of algorithms yielded similar metrics in VANEOHS (PPV=0.94; NPV=0.86) and lower in MGB (PPV=0.84; NPV=0.76). In comparison, use of DR definition as implemented in Phenome-wide association study (PheWAS) in VUMC, yielded similar PPV (0.92) but substantially reduced NPV (0.48). Implementation of the algorithms to the Million Veteran Program identified over 62,000 DR cases with genetic data including 14,549 African Americans and 6,209 Hispanics with DR.
Conclusions/Discussion We demonstrate the robustness of the algorithms at three separate health-care centers, with a minimum PPV of 0.84 and substantially improved NPV than existing high-throughput methods. We strongly encourage independent validation and incorporation of features unique to each EHR to enhance algorithm performance for DR cases and controls.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
Efforts were supported by the NIH/NEI F31EY033663 (J.H.B.), K12HD043483 (J.N.H.), R01-EY025295 (Y.S.), R01-EY032159 (Y.S.), 1K01DK120631 (A.G.), the VA Office of Research and Development [I01 CX001298 (Y.S.), I01CX001481 (Y.S.), I01BX005831 (L.S.P), I01BX004557 (N.S.P.), IK6BX005233 (N.S.P.)] and unrestricted awards from Research to Prevent Blindness.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
This work was conducted upon approval of Institutional Review Boards of Vanderbilt University Medical Center, VA Northeast Ohio Healthcare System (VANEOHS) Medical Clinic Eye Clinic, Massachusetts General Brigham (MGB), and Million Veteran Program (MVP) central and local offices.
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
ABBREVIATIONS
- DR
- Diabetic Retinopathy
- PDR
- Proliferative Diabetic Retinopathy
- EHR
- Electronic Health Record
- DM
- Diabetes Mellitus
- MVP
- Million Veteran Program
- PPV
- Positive Predictive Value
- NPV
- Negative Predictive Value
The Chan Zuckerberg Initiative, Cold Spring Harbor Laboratory, the Sergey Brin Family Foundation, California Institute of Technology, Centre National de la Recherche Scientifique, Fred Hutchinson Cancer Center, Imperial College London, Massachusetts Institute of Technology, Stanford University, University of Washington, and Vrije Universiteit Amsterdam.
Reviews and Context
0
Comment
0
TRIP Peer Reviews
0
Community Reviews
0
Automated Services
0
Blogs/Media
Author Videos