Abstract
Background Heart failure (HF) is a prevalent condition associated with significant morbidity. Patients may have questions that they feel embarrassed to ask or will face delays awaiting responses from their healthcare providers which may impact their health behavior. We aimed to investigate the potential of chat-based artificial intelligence (AI) platforms in complementing the delivery of patient-centered care.
Methods Using online patient forums and physician experience, we created 30 questions related to diagnosis, management and prognosis of HF. The questions were posed to two artificial intelligence (AI) chatbots (OpenAI’s ChatGPT-3.5 and Google’s Bard). Each set of answers was evaluated by two HF experts, independently and blinded to each other, for accuracy (adequacy of content) and consistency of content.
Results ChatGPT provided mostly appropriate answers (27/30, 90%) and showed a high degree of consistency (93%). Bard provided a similar content in its answers and thus was evaluated only for adequacy (23/30, 77%). The two HF experts’ grades were concordant in 83% and 67% of the questions for ChatGPT and Bard, respectively. Both platforms suffered from issues related to “hallucination” of facts and/or difficulty with more contemporary recommendations.
Conclusion AI based chatbots may have potential in improving HF education and empowering patients, but their limitations should be considered and addressed in future research.
Competing Interest Statement
Dr. Tedford reports no direct conflicts of interest related to this manuscript. He reports general disclosures to include consulting relationships with Medtronic, Abbott, Acorai, Aria CV Inc., Acceleron/Merck, Alleviant, CareDx, Cytokinetics, Itamar, Edwards LifeSciences, Eidos Therapeutics, Lexicon Pharmaceuticals, and Gradient. Dr. Tedford is the national principal investigator for the RIGHT-FLOW clinical trial (Edwards), serves on steering committee for Merck, Edwards, and Abbott as well as a research advisory board for Abiomed. He also does hemodynamic core lab work for Merck. Dr. Wehbe reports investments in Microsoft Corporation. Unrelated to this manuscript, he also reports general disclosures including research funding from Pfizer Inc. and consulting relationships with GE Healthcare. He has a patent pending (US20230153997A1) outside the scope of this work. All other authors report no disclosures related to this manuscript.
Funding Statement
This study did not receive any funding.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
The Chan Zuckerberg Initiative, Cold Spring Harbor Laboratory, the Sergey Brin Family Foundation, California Institute of Technology, Centre National de la Recherche Scientifique, Fred Hutchinson Cancer Center, Imperial College London, Massachusetts Institute of Technology, Stanford University, University of Washington, and Vrije Universiteit Amsterdam.
Subject Area
Reviews and Context
0
Comment
0
TRIP Peer Reviews
0
Community Reviews
0
Automated Services
0
Blogs/Media
Author Videos