RT Journal Article
SR Electronic
T1 EndoGPT: A Proof-of-concept Large Language Model Based Assistant for the Management of Thyroid Nodules
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2024.05.29.24308002
DO 10.1101/2024.05.29.24308002
A1 Shah, Meghal
A1 Kuo, Eric J.
A1 Kuo, Jennifer H.
A1 Hsu, Shawn
A1 McManus, Catherine
A1 Liou, Rachel
A1 Lee, James A.
A1 Sathe, Tejas S.
YR 2024
UL http://medrxiv.org/content/early/2024/05/31/2024.05.29.24308002.abstract
AB Large language models (LLMs) are increasingly being explored for their potential to simulate clinical reasoning. Here, we demonstrate our initial experience using the GPT-4o LLM along with prompt engineering and knowledge retrieval to develop EndoGPT, a clinical decision support tool for the management of thyroid nodules. In a pilot study of 50 cases, EndoGPT demonstrated an 83% concordance rate with expert surgeons’ assessments and plans. The highest concordance was in diagnosis (93%), followed by the need for an operation (82%) and type of operation (69%). This work suggests that LLM-based assistants may play a useful role in assisting clinicians in the future.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThis study did not receive any funding.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesThe details of the IRB/oversight body that provided approval or exemption for the research described are given below:The institutional review board (IRB) of Columbia University waive ethical approval for this work (Protocol AAAV1151).I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesOur data and code are available on GitHub. https://github.com/tsathe/endogpt