Establishing the Automatic Identification of Clinical Trial Cohorts from Electronic Health Records by Matching Normalized Eligibility Criteria and Patient Clinical Characteristics

Abstract

The use of electronic health records (EHRs) holds the potential to enhance clinical trial activities. However, the identification of eligible patients within EHRs presents considerable challenges. In this study, we developed a pipeline for phenotyping eligibility criteria, enabling the identification of patients from EHRs with clinical characteristics that match those criteria. We utilized clinical trial eligibility criteria from ClinicalTrials.gov and patient EHRs from the Mount Sinai Data Warehouse. The criteria and EHR data were normalized using national standard terminologies and in-house databases, facilitating computability and queryability. The pipeline employed rule-based pattern recognition and manual annotation. The quality of normalization was assessed using Cohen’s Kappa, with the precision, recall, and F1 score evaluated for patient matching. Our pipeline normalized 367 out of 640 unique eligibility criteria attributes, covering various medical conditions including non-small cell lung cancer, small cell lung cancer, prostate cancer, breast cancer, multiple myeloma, ulcerative colitis, Crohn’s disease, non-alcoholic steatohepatitis, and sickle cell anemia. 174 were encoded with standard terminologies and 193 were normalized using the in-house reference tables. The agreement between automated and manual normalization was high (Cohen’s Kappa = 0.82), and patient matching demonstrated a 0.94 F1 score. We developed a clinical phenotyping pipeline that improved the integration of eligibility criteria with EHR data. This system was successfully tested on EHRs from multiple institutions, indicating its wide applicability. The pipeline has the potential to greatly improve EHR use in clinical trial processes, leading to better patient selection and enhanced clinical research outcomes.