Evaluating Large Language Models in Extracting Cognitive Exam Dates and Scores

Hao Zhang; Neil Jethani; Simon Jones; Nicholas Genes; Vincent J. Major; Ian S. Jaffe; Anthony B. Cardillo; Noah Heilenbach; Nadia Fazal Ali; Luke J. Bonanni; Andrew J. Clayburn; Zain Khera; Erica C. Sadler; Jaideep Prasad; Jamie Schlacter; Kevin Liu; Benjamin Silva; Sophie Montgomery; Eric J. Kim; Jacob Lester; Theodore M. Hill; Alba Avoricani; Ethan Chervonski; James Davydov; William Small; Eesha Chakravartty; Himanshu Grover; John A. Dodson; Abraham A. Brody; Yindalon Aphinyanaphongs; Arjun Masurkar; Narges Razavian

doi:10.1101/2023.07.10.23292373

Evaluating Large Language Models in Extracting Cognitive Exam Dates and Scores

Hao Zhang, View ORCID ProfileNeil Jethani, Simon Jones, View ORCID ProfileNicholas Genes, View ORCID ProfileVincent J. Major, View ORCID ProfileIan S. Jaffe, View ORCID ProfileAnthony B. Cardillo, View ORCID ProfileNoah Heilenbach, View ORCID ProfileNadia Fazal Ali, View ORCID ProfileLuke J. Bonanni, View ORCID ProfileAndrew J. Clayburn, View ORCID ProfileZain Khera, View ORCID ProfileErica C. Sadler, View ORCID ProfileJaideep Prasad, View ORCID ProfileJamie Schlacter, View ORCID ProfileKevin Liu, View ORCID ProfileBenjamin Silva, View ORCID ProfileSophie Montgomery, View ORCID ProfileEric J. Kim, View ORCID ProfileJacob Lester, View ORCID ProfileTheodore M. Hill, View ORCID ProfileAlba Avoricani, View ORCID ProfileEthan Chervonski, James Davydov, William Small, View ORCID ProfileEesha Chakravartty, Himanshu Grover, John A. Dodson, View ORCID ProfileAbraham A. Brody, View ORCID ProfileYindalon Aphinyanaphongs, View ORCID ProfileArjun Masurkar, View ORCID ProfileNarges Razavian

doi: https://doi.org/10.1101/2023.07.10.23292373

Hao Zhang

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Neil Jethani

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Neil Jethani

Simon Jones

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Nicholas Genes

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Nicholas Genes

Vincent J. Major

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Vincent J. Major

Ian S. Jaffe

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Ian S. Jaffe

Anthony B. Cardillo

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Anthony B. Cardillo

Noah Heilenbach

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Noah Heilenbach

Nadia Fazal Ali

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Nadia Fazal Ali

Luke J. Bonanni

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Luke J. Bonanni

Andrew J. Clayburn

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Andrew J. Clayburn

Zain Khera

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Zain Khera

Erica C. Sadler

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Erica C. Sadler

Jaideep Prasad

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Jaideep Prasad

Jamie Schlacter

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Jamie Schlacter

Kevin Liu

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Kevin Liu

Benjamin Silva

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Benjamin Silva

Sophie Montgomery

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Sophie Montgomery

Eric J. Kim

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Eric J. Kim

Jacob Lester

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Jacob Lester

Theodore M. Hill

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Theodore M. Hill

Alba Avoricani

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Alba Avoricani

Ethan Chervonski

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Ethan Chervonski

James Davydov

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

William Small

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Eesha Chakravartty

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Eesha Chakravartty

Himanshu Grover

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

John A. Dodson

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Abraham A. Brody

2NYU Rory Meyers College of Nursing, NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Abraham A. Brody

Yindalon Aphinyanaphongs

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Yindalon Aphinyanaphongs

Arjun Masurkar

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Arjun Masurkar

Narges Razavian

1NYU Grossman School of Medicine

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Narges Razavian
For correspondence: narges.razavian@nyulangone.org

Abstract
Full Text
Info/History
Metrics
Supplementary material
Data/Code
Preview PDF

Data Availability

The data contains private patient information and will not be made available.

View the discussion thread.

PreviousNext

Posted February 13, 2024.

Download PDF

Supplementary Material

Data/Code

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Your Email *

Your Name *

Send To *

Enter multiple addresses on separate lines or separate them with commas.

You are going to email the following Evaluating Large Language Models in Extracting Cognitive Exam Dates and Scores

Message Subject (Your Name) has forwarded a page to you from medRxiv

Message Body (Your Name) thought you would like to see this page from the medRxiv website.

Your Personal Message

CAPTCHA

This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

Evaluating Large Language Models in Extracting Cognitive Exam Dates and Scores

Hao Zhang, Neil Jethani, Simon Jones, Nicholas Genes, Vincent J. Major, Ian S. Jaffe, Anthony B. Cardillo, Noah Heilenbach, Nadia Fazal Ali, Luke J. Bonanni, Andrew J. Clayburn, Zain Khera, Erica C. Sadler, Jaideep Prasad, Jamie Schlacter, Kevin Liu, Benjamin Silva, Sophie Montgomery, Eric J. Kim, Jacob Lester, Theodore M. Hill, Alba Avoricani, Ethan Chervonski, James Davydov, William Small, Eesha Chakravartty, Himanshu Grover, John A. Dodson, Abraham A. Brody, Yindalon Aphinyanaphongs, Arjun Masurkar, Narges Razavian

medRxiv 2023.07.10.23292373; doi: https://doi.org/10.1101/2023.07.10.23292373

Share This Article: