ABSTRACT
Background Point-of-care ultrasonography (POCUS) enables cardiac imaging at the bedside and in communities but is limited by abbreviated protocols and variation in quality. We developed and tested artificial intelligence (AI) models to automate the detection of underdiagnosed cardiomyopathies from cardiac POCUS.
Methods In a development set of 290,245 transthoracic echocardiographic videos across the Yale-New Haven Health System (YNHHS), we used augmentation approaches and a customized loss function weighted for view quality to derive a POCUS-adapted, multi-label, video-based convolutional neural network (CNN) that discriminates HCM (hypertrophic cardiomyopathy) and ATTR-CM (transthyretin amyloid cardiomyopathy) from controls without known disease. We evaluated the final model across independent, internal and external, retrospective cohorts of individuals who underwent cardiac POCUS across YNHHS and Mount Sinai Health System (MSHS) emergency departments (EDs) (2011-2024) to prioritize key views and validate the diagnostic and prognostic performance of single-view screening protocols.
Findings We identified 33,127 patients (median age 61 [IQR: 45-75] years, n=17,276 [52·2%] female) at YNHHS and 5,624 (57 [IQR: 39-71] years, n=1,953 [34·7%] female) at MSHS with 78,054 and 13,796 eligible cardiac POCUS videos, respectively. An AI-enabled single-view screening approach successfully discriminated HCM (AUROC of 0·90 [YNHHS] & 0·89 [MSHS]) and ATTR-CM (YNHHS: AUROC of 0·92 [YNHHS] & 0·99 [MSHS]). In YNHHS, 40 (58·0%) HCM and 23 (47·9%) ATTR-CM cases had a positive screen at median of 2·1 [IQR: 0·9-4·5] and 1·9 [IQR: 1·0-3·4] years before clinical diagnosis. Moreover, among 24,448 participants without known cardiomyopathy followed over 2·2 [IQR: 1·1-5·8] years, AI-POCUS probabilities in the highest (vs lowest) quintile for HCM and ATTR-CM conferred a 15% (adj.HR 1·15 [95%CI: 1·02-1·29]) and 39% (adj.HR 1·39 [95%CI: 1·22-1·59]) higher age- and sex-adjusted mortality risk, respectively.
Interpretation We developed and validated an AI framework that enables scalable, opportunistic screening of treatable cardiomyopathies wherever POCUS is used.
Funding National Heart, Lung and Blood Institute, Doris Duke Charitable Foundation, BridgeBio
Evidence before this study Point-of-care ultrasonography (POCUS) can support clinical decision-making at the point-of-care as a direct extension of the physical exam. POCUS has benefited from the increasing availability of portable and smartphone-adapted probes and even artificial intelligence (AI) solutions that can assist novices in acquiring basic views. However, the diagnostic and prognostic inference from POCUS acquisitions is often limited by the short acquisition duration, suboptimal scanning conditions, and limited experience in identifying subtle pathology that goes beyond the acute indication for the study. Recent solutions have shown the potential of AI-augmented phenotyping in identifying traditionally under-diagnosed cardiomyopathies on standard transthoracic echocardiograms performed by expert operators with strict protocols. However, these are not optimized for opportunistic screening using videos derived from typically lower-quality POCUS studies. Given the widespread use of POCUS across communities, ambulatory clinics, emergency departments (ED), and inpatient settings, there is an opportunity to leverage this technology for diagnostic and prognostic inference, especially for traditionally under-recognized cardiomyopathies, such as hypertrophic cardiomyopathy (HCM) or transthyretin amyloid cardiomyopathy (ATTR-CM) which may benefit from timely referral for specialized care.
Added value of this study We present a multi-label, view-agnostic, video-based convolutional neural network adapted for POCUS use, which can reliably discriminate cases of ATTR-CM and HCM versus controls across more than 90,000 unique POCUS videos acquired over a decade across EDs affiliated with two large and diverse health systems. The model benefits from customized training that emphasizes low-quality acquisitions as well as off-axis, non-traditional views, outperforming view-specific algorithms and approaching the performance of standard TTE algorithms using single POCUS videos as the sole input. We further provide evidence that among reported controls, higher probabilities for HCM or ATTR-CM-like phenotypes are associated with worse long-term survival, suggesting possible under-diagnosis with prognostic implications. Finally, among confirmed cases with previously available POCUS imaging, positive AI-POCUS screens were seen at median of 2 years before eventual confirmatory testing, highlighting an untapped potential for timely diagnosis through opportunistic screening.
Implications of all available evidence We define an AI framework with excellent performance in the automated detection of underdiagnosed yet treatable cardiomyopathies. This framework may enable scalable screening, detecting these disorders years before their clinical recognition, thus improving the diagnostic and prognostic inference of POCUS imaging in clinical practice.
Competing Interest Statement
R.K. is an Associate Editor of JAMA and receives research support, through Yale, from the Blavatnik Foundation, Bristol-Myers Squibb, Novo Nordisk, and BridgeBio. He is a coinventor of Pending Patent Applications WO2023230345A1, US20220336048A1, 63/346,610, 63/484,426, 63/508,315, 63/580,137, 63/606,203, 63/619,241, and 63/562,335, and a co-founder of Ensight-AI, Inc and Evidence2Health, LLC. E.K.O. is a co-founder of Evidence2Health LLC, and has been a consultant for Ensight-AI, Inc, and Caristo Diagnostics, Ltd. He is a co-inventor of patent applications (US17/720,068, 63/619,241, 63/177,117, 63/580,137, 63/606,203, 63/562,335, WO2018078395A1, WO2020058713A1) and has received royalty fees from technology licensed through the University of Oxford, outside the submitted work. H.M.K. works under contract with the Centers for Medicare & Medicaid Services to support quality measurement programs, was a recipient of a research grant from Johnson & Johnson, through Yale University, to support clinical trial data sharing; was a recipient of a research agreement, through Yale University, from the Shenzhen Center for Health Information for work to advance intelligent disease prevention and health promotion; collaborates with the National Center for Cardiovascular Diseases in Beijing; receives payment from the Arnold & Porter Law Firm for work related to the Sanofi clopidogrel litigation, from the Martin Baughman Law Firm for work related to the Cook Celect IVC filter litigation, and from the Siegfried and Jensen Law Firm for work related to Vioxx litigation; chairs a Cardiac Scientific Advisory Board for UnitedHealth; was a member of the IBM Watson Health Life Sciences Board; is a member of the Advisory Board for Element Science, the Advisory Board for Facebook, and the Physician Advisory Board for Aetna; and is the co-founder of Hugo Health, a personal health information platform, and co-founder of Refactor Health, a healthcare AI-augmented data management company, and Ensight-AI, Inc. All other authors declare no competing interests.
Funding Statement
This study was supported by grants R01HL167858 (RK), K23HL153775 (RK), 1F32HL170592 (EKO) from the National Heart, Lung, and Blood Institute of the National Institutes of Health, award 2022060 (RK) from the Doris Duke Charitable Foundation, and BridgeBio through an investigator-initiated study. The funders had no role in the design and conduct of the study; collection, management, analysis, and interpretation of the data; preparation, review, or approval of the manuscript; and decision to submit the manuscript for publication.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
The study was approved by the Yale School of Medicine Institutional Review Board.
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
Footnotes
This revised version includes external validation results from a second hospital system, as well as retrospective associations with long-term clinical outcomes.
Data Availability
All data produced in the present study are available upon reasonable request to the authors.