Follow this preprint
The Limits of Prompt Engineering in Medical Problem-Solving: A Comparative Analysis with ChatGPT on calculation based USMLE Medical Questions
View ORCID ProfileDhavalkumar Patel, View ORCID ProfileGanesh Raut, Eyal Zimlichman, Satya Narayan Cheetirala, View ORCID ProfileGirish Nadkarni, View ORCID ProfileBenjamin S Glicksberg, Robert Freeman, View ORCID ProfilePrem Timsina, View ORCID ProfileEyal Klang
doi: https://doi.org/10.1101/2023.08.06.23293710
This article is a preprint and has not been peer-reviewed [what does this mean?]. It reports new medical research that has yet to be evaluated and so should not be used to guide clinical practice.
Dhavalkumar Patel
1Mount Sinai Health System
2Hospital Management, Sheba Medical Center, Affiliated to Tel-Aviv University
3ARC Innovation Center, Sheba Medical Center, Affiliated to Tel-Aviv University
4The Charles Bronfman Institute of Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
Ganesh Raut
1Mount Sinai Health System
2Hospital Management, Sheba Medical Center, Affiliated to Tel-Aviv University
3ARC Innovation Center, Sheba Medical Center, Affiliated to Tel-Aviv University
4The Charles Bronfman Institute of Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
Eyal Zimlichman
1Mount Sinai Health System
2Hospital Management, Sheba Medical Center, Affiliated to Tel-Aviv University
3ARC Innovation Center, Sheba Medical Center, Affiliated to Tel-Aviv University
4The Charles Bronfman Institute of Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
Satya Narayan Cheetirala
1Mount Sinai Health System
2Hospital Management, Sheba Medical Center, Affiliated to Tel-Aviv University
3ARC Innovation Center, Sheba Medical Center, Affiliated to Tel-Aviv University
4The Charles Bronfman Institute of Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
Girish Nadkarni
1Mount Sinai Health System
2Hospital Management, Sheba Medical Center, Affiliated to Tel-Aviv University
3ARC Innovation Center, Sheba Medical Center, Affiliated to Tel-Aviv University
4The Charles Bronfman Institute of Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
Benjamin S Glicksberg
1Mount Sinai Health System
2Hospital Management, Sheba Medical Center, Affiliated to Tel-Aviv University
3ARC Innovation Center, Sheba Medical Center, Affiliated to Tel-Aviv University
4The Charles Bronfman Institute of Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
Robert Freeman
1Mount Sinai Health System
2Hospital Management, Sheba Medical Center, Affiliated to Tel-Aviv University
3ARC Innovation Center, Sheba Medical Center, Affiliated to Tel-Aviv University
4The Charles Bronfman Institute of Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
Prem Timsina
1Mount Sinai Health System
2Hospital Management, Sheba Medical Center, Affiliated to Tel-Aviv University
3ARC Innovation Center, Sheba Medical Center, Affiliated to Tel-Aviv University
4The Charles Bronfman Institute of Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
Eyal Klang
1Mount Sinai Health System
2Hospital Management, Sheba Medical Center, Affiliated to Tel-Aviv University
3ARC Innovation Center, Sheba Medical Center, Affiliated to Tel-Aviv University
4The Charles Bronfman Institute of Personalized Medicine, Icahn School of Medicine at Mount Sinai, New York, New York, USA
![Loading Loading](https://www.medrxiv.org/sites/all/modules/contrib/panels_ajax_tab/images/loading.gif)
Data Availability
All data produced in the present study are available upon reasonable request to the authors
Posted August 09, 2023.
The Limits of Prompt Engineering in Medical Problem-Solving: A Comparative Analysis with ChatGPT on calculation based USMLE Medical Questions
Dhavalkumar Patel, Ganesh Raut, Eyal Zimlichman, Satya Narayan Cheetirala, Girish Nadkarni, Benjamin S Glicksberg, Robert Freeman, Prem Timsina, Eyal Klang
medRxiv 2023.08.06.23293710; doi: https://doi.org/10.1101/2023.08.06.23293710
This article is a preprint and has not been peer-reviewed [what does this mean?]. It reports new medical research that has yet to be evaluated and so should not be used to guide clinical practice.
Subject Area
Subject Areas
- Addiction Medicine (408)
- Allergy and Immunology (719)
- Anesthesia (214)
- Cardiovascular Medicine (3041)
- Dermatology (258)
- Emergency Medicine (456)
- Epidemiology (12962)
- Forensic Medicine (12)
- Gastroenterology (848)
- Genetic and Genomic Medicine (4772)
- Geriatric Medicine (440)
- Health Economics (747)
- Health Informatics (3028)
- Health Policy (1095)
- Hematology (405)
- HIV/AIDS (952)
- Medical Education (450)
- Medical Ethics (119)
- Nephrology (490)
- Neurology (4544)
- Nursing (242)
- Nutrition (671)
- Oncology (2364)
- Ophthalmology (666)
- Orthopedics (264)
- Otolaryngology (332)
- Pain Medicine (296)
- Palliative Medicine (86)
- Pathology (512)
- Pediatrics (1231)
- Primary Care Research (515)
- Public and Global Health (7135)
- Radiology and Imaging (1587)
- Respiratory Medicine (940)
- Rheumatology (456)
- Sports Medicine (396)
- Surgery (504)
- Toxicology (63)
- Transplantation (218)
- Urology (187)