Multimodal Large Language Model Passes Specialty Board Examination and Surpasses Human Test-Taker Scores: A Comparative Analysis Examining the Stepwise Impact of Model Prompting Strategies on Performance

Jamil S. Samaan; Samuel Margolis; Nitin Srinivasan; Apoorva Srinivasan; Yee Hui Yeo; Rajsavi Anand; Fadi S. Samaan; James Mirocha; Seyed Amir Ahmad Safavi-Naini; Bara El Kurdi; Ali Soroush; Rabindra Watson; Srinivas Gaddam; Joann G. Elmore; Brennan M.R. Spiegel; Nicholas P. Tatonetti

doi:10.1101/2024.07.27.24310809

Multimodal Large Language Model Passes Specialty Board Examination and Surpasses Human Test-Taker Scores: A Comparative Analysis Examining the Stepwise Impact of Model Prompting Strategies on Performance

Jamil S. Samaan, View ORCID ProfileSamuel Margolis, Nitin Srinivasan, Apoorva Srinivasan, Yee Hui Yeo, Rajsavi Anand, Fadi S. Samaan, James Mirocha, Seyed Amir Ahmad Safavi-Naini, Bara El Kurdi, Ali Soroush, Rabindra Watson, Srinivas Gaddam, Joann G. Elmore, Brennan M.R. Spiegel, Nicholas P. Tatonetti

doi: https://doi.org/10.1101/2024.07.27.24310809

Jamil S. Samaan

1Karsh Division of Gastroenterology and Hepatology, Cedars-Sinai Medical Center, 8700 Beverly Blvd, Los Angeles, CA 90048

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Samuel Margolis

2David Geffen School Medicine University of California, Los Angeles, 10833 Le Conte Ave, Los Angeles, CA 90095

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
ORCID record for Samuel Margolis

Nitin Srinivasan

3Keck School of Medicine of USC, Health Care Consultation Center, 1510 San Pablo St #514, Los Angeles, CA 90033

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Apoorva Srinivasan

4Department of Computational Biomedicine, Cedars-Sinai Medical Center, West Hollywood, California, USA

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Yee Hui Yeo

1Karsh Division of Gastroenterology and Hepatology, Cedars-Sinai Medical Center, 8700 Beverly Blvd, Los Angeles, CA 90048

MD, MSc

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Rajsavi Anand

1Karsh Division of Gastroenterology and Hepatology, Cedars-Sinai Medical Center, 8700 Beverly Blvd, Los Angeles, CA 90048

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Fadi S. Samaan

1Karsh Division of Gastroenterology and Hepatology, Cedars-Sinai Medical Center, 8700 Beverly Blvd, Los Angeles, CA 90048

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

James Mirocha

5Cedars-Sinai Medical Center, Biostatistics and Bioinformatics Research Center, Los Angeles, CA, USA

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Seyed Amir Ahmad Safavi-Naini

6Division of Data-Driven and Digital Medicine (D3M), Icahn School of Medicine at Mount Sinai, New York, NY USA

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Bara El Kurdi

7Division of Gastroenterology and Hepatology, Department of Medicine, Virginia Tech Carilion School of Medicine, Roanoke, VA, USA

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Ali Soroush

6Division of Data-Driven and Digital Medicine (D3M), Icahn School of Medicine at Mount Sinai, New York, NY USA

8Henry D. Janowitz Division of Gastroenterology, Icahn School of Medicine at Mount Sinai, New York, NY USA

MD, MS

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Rabindra Watson

1Karsh Division of Gastroenterology and Hepatology, Cedars-Sinai Medical Center, 8700 Beverly Blvd, Los Angeles, CA 90048

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Srinivas Gaddam

1Karsh Division of Gastroenterology and Hepatology, Cedars-Sinai Medical Center, 8700 Beverly Blvd, Los Angeles, CA 90048

MD, MPH

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Joann G. Elmore

2David Geffen School Medicine University of California, Los Angeles, 10833 Le Conte Ave, Los Angeles, CA 90095

MD, MPH

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Brennan M.R. Spiegel

1Karsh Division of Gastroenterology and Hepatology, Cedars-Sinai Medical Center, 8700 Beverly Blvd, Los Angeles, CA 90048

MD, MSHS

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site

Nicholas P. Tatonetti

4Department of Computational Biomedicine, Cedars-Sinai Medical Center, West Hollywood, California, USA

9Cedars-Sinai Cancer, Cedars-Sinai Medical Center, 8700 Beverly Blvd. Los Angeles, CA, USA

10Department of Biomedical Informatics, Columbia University, New York, New York, USA

PhD

Find this author on Google Scholar
Find this author on PubMed
Search for this author on this site
For correspondence: nicholas.tatonetti@cshs.org

Abstract
Full Text
Info/History
Metrics
Supplementary material
Data/Code
Preview PDF

Article usage

Article usage: July 2024 to November 2024

	Abstract	Full	Pdf
Jul 2024	198	1	33
Aug 2024	136	17	54
Sep 2024	53	6	17
Oct 2024	52	8	13
Nov 2024	11	0	3

View the discussion thread.

PreviousNext

Posted July 29, 2024.

Download PDF

Supplementary Material

Data/Code

Thank you for your interest in spreading the word about medRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Your Email *

Your Name *

Send To *

Enter multiple addresses on separate lines or separate them with commas.

You are going to email the following Multimodal Large Language Model Passes Specialty Board Examination and Surpasses Human Test-Taker Scores: A Comparative Analysis Examining the Stepwise Impact of Model Prompting Strategies on Performance

Message Subject (Your Name) has forwarded a page to you from medRxiv

Message Body (Your Name) thought you would like to see this page from the medRxiv website.

Your Personal Message

CAPTCHA

This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.

Multimodal Large Language Model Passes Specialty Board Examination and Surpasses Human Test-Taker Scores: A Comparative Analysis Examining the Stepwise Impact of Model Prompting Strategies on Performance

Jamil S. Samaan, Samuel Margolis, Nitin Srinivasan, Apoorva Srinivasan, Yee Hui Yeo, Rajsavi Anand, Fadi S. Samaan, James Mirocha, Seyed Amir Ahmad Safavi-Naini, Bara El Kurdi, Ali Soroush, Rabindra Watson, Srinivas Gaddam, Joann G. Elmore, Brennan M.R. Spiegel, Nicholas P. Tatonetti

medRxiv 2024.07.27.24310809; doi: https://doi.org/10.1101/2024.07.27.24310809

Share This Article: