PT - JOURNAL ARTICLE AU - Park, Heekyong AU - Wang, Taowei David AU - Wattanasin, Nich AU - Castro, Victor M. AU - Gainer, Vivian AU - Goryachev, Sergey AU - Murphy, Shawn TI - The Digital Analytic Patient Reviewer (DAPR) for COVID-19 Data Mart Validation AID - 10.1101/2021.05.30.21257945 DP - 2021 Jan 01 TA - medRxiv PG - 2021.05.30.21257945 4099 - http://medrxiv.org/content/early/2021/06/01/2021.05.30.21257945.short 4100 - http://medrxiv.org/content/early/2021/06/01/2021.05.30.21257945.full AB - Objective To provide high-quality data for COVID-19 research, we validated COVID-19 clinical indicators and 22 associated computed phenotypes, which were derived by machine learning algorithms, in the Mass General Brigham (MGB) COVID-19 Data Mart.Materials and Methods Fifteen reviewers performed a manual chart review for 150 COVID-19 positive patients in the data mart. To support rapid chart review for a wide range of target data, we offered the Digital Analytic Patient Reviewer (DAPR). DAPR is a web-based chart review tool that integrates patient notes and provides note search functionalities and a patient-specific summary view linked with relevant notes. Within DAPR, we developed a COVID-19 validation task-oriented view and information extraction logic, enabled fast access to data, and considered privacy and security issues.Results The concepts for COVID-19 positive cohort, COVID-19 index date, COVID-19 related admission, and the admission date were shown to have high values in all evaluation metrics. For phenotypes, the overall specificities, PPVs, and NPVs were high. However, sensitivities were relatively low. Based on these results, we removed 3 phenotypes from our data mart. In the survey about using the tool, participants expressed positive attitudes towards using DAPR for chart review. They assessed the validation was easy and DAPR helped find relevant information. Some validation difficulties were also discussed.Discussion and Conclusion DAPR’s patient summary view accelerated the validation process. We are in the process of automating the workflow to use DAPR for chart reviews. Moreover, we will extend its use case to other domains.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThe authors received no financial support for the research, authorship, and/or publication of this article.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:This study was approved by the Institutional Review Board (IRB) of Mass General Brigham under protocols Digital Analytic Patient Reviewer (DAPR) (2020P000605) and Validating EHR data in the COVID-19 Mart and Summary Table (2020P001639). The Mass General Brigham Institutional Review Board approved for a waiver of patient informed consent.All necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines and uploaded the relevant EQUATOR Network research reporting checklist(s) and other pertinent material as supplementary files, if applicable.YesDue to privacy concerns, the source data cannot be made openly available.