Abstract
Background Diagnosis of mitral regurgitation (MR) requires careful evaluation of echocardiography with Doppler imaging. This study presents the development and validation of a fully automated deep learning pipeline for identifying apical-4-chamber view videos with color Doppler and detection of clinically significant (moderate or severe) mitral regurgitation from transthoracic echocardiography studies.
Methods A total of 58,614 studies (2,587,538 videos) from Cedars-Sinai Medical Center (CSMC) were used to develop and test an automated pipeline to identify apical-4-chamber view videos with color Doppler across the mitral valve and then assess mitral valve regurgitation severity. The model was tested on an internal test set of 1,800 studies (80,833 videos) from CSMC and externally evaluated in a geographically distinct cohort of 915 studies (46,890 videos) from Stanford Healthcare (SHC).
Results In the held-out CSMC test set, the view classifier demonstrated an AUC of 0.998 (0.998 - 0.999) and correctly identified 3,452 of 3,539 MR color Doppler videos (sensitivity of 0.975 (0.968-0.982) and specificity of 0.999 (0.999-0.999) compared with manually curated videos). In the external test cohort from SHC, the view classifier correctly identified 1,051 of 1,055 MR color Doppler videos (sensitivity of 0.996 (0.990 – 1.000) and specificity of 0.999 (0.999 – 0.999) compared with manually curated videos). For evaluating clinically significant MR, in the CSMC test cohort, moderate-or-severe MR was detected with AUC of 0.916 (0.899 - 0.932) and severe MR was detected with an AUC of 0.934 (0.913 - 0.953). In the SHC test cohort, the model detected moderate-or-severe MR with an AUC of 0.951 (0.924 - 0.973) and severe MR with an AUC of 0.969 (0.946 - 0.987).
Conclusions In this study, we developed and validated an automated pipeline for identifying clinically significant MR from transthoracic echocardiography studies. Such an approach has potential for automated screening of MR and precision evaluation for surveillance.
Competing Interest Statement
A.V., G.D., M.V., and D.L. report no disclosures. S.C. reports consulting fees from UCB and Viz.ai and research grants NIH R01-HL131532 and NIH R01-HL142983. D.O. reports support from NIH NHLBI, NIH grant R00-HL157421 and AstraZeneca Alexion, as well as consulting from EchoIQ, Ultromics, Pfizer, InVision, Korean Society of Echo, and Japanese Society of Echo.
Funding Statement
A.V. is a research fellow supported by the Sarnoff Cardiovascular Research Award. S.C. reports support from the Erika J Glazer Family Foundation and NIH grants R01-HL131532 and NIH R01-HL142983. D.O. reports support from NIH NHLBI and NIH grant R00-HL157421.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
This study was approved by the Institutional Review Boards at Cedars-Sinai Medical Center and Stanford Healthcare.
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
Data Availability
The dataset of videos used in this study is not publicly available due to its potentially identifiable nature.
