Can ChatGPT-4o really pass medical science exams? A pragmatic analysis using novel questions
View ORCID ProfilePhilip M. Newton, Christopher J. Summers, Uzman Zaheer, Maira Xiromeriti, Jemima R. Stokes, Jaskaran Singh Bhangu, Elis G. Roome, Alanna Roberts-Phillips, Darius Mazaheri-Asadi, Cameron D. Jones, Stuart Hughes, Dominic Gilbert, Ewan Jones, Keioni Essex, Emily C. Ellis, Ross Davey, Adrienne A. Cox, Jessica A. Bassett
doi: https://doi.org/10.1101/2024.06.29.24309595
Philip M. Newton
Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Christopher J. Summers
Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Uzman Zaheer
Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Maira Xiromeriti
Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Jemima R. Stokes
Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Jaskaran Singh Bhangu
Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Elis G. Roome
Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Alanna Roberts-Phillips
Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Darius Mazaheri-Asadi
Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Cameron D. Jones
Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Stuart Hughes
Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Dominic Gilbert
Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Ewan Jones
Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Keioni Essex
Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Emily C. Ellis
Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Ross Davey
Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Adrienne A. Cox
Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Jessica A. Bassett
Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
![Loading Loading](https://www.medrxiv.org/sites/all/modules/contrib/panels_ajax_tab/images/loading.gif)
Data Availability
All data produced in the present work are contained in the manuscript
Posted July 02, 2024.
Can ChatGPT-4o really pass medical science exams? A pragmatic analysis using novel questions
Philip M. Newton, Christopher J. Summers, Uzman Zaheer, Maira Xiromeriti, Jemima R. Stokes, Jaskaran Singh Bhangu, Elis G. Roome, Alanna Roberts-Phillips, Darius Mazaheri-Asadi, Cameron D. Jones, Stuart Hughes, Dominic Gilbert, Ewan Jones, Keioni Essex, Emily C. Ellis, Ross Davey, Adrienne A. Cox, Jessica A. Bassett
medRxiv 2024.06.29.24309595; doi: https://doi.org/10.1101/2024.06.29.24309595
Can ChatGPT-4o really pass medical science exams? A pragmatic analysis using novel questions
Philip M. Newton, Christopher J. Summers, Uzman Zaheer, Maira Xiromeriti, Jemima R. Stokes, Jaskaran Singh Bhangu, Elis G. Roome, Alanna Roberts-Phillips, Darius Mazaheri-Asadi, Cameron D. Jones, Stuart Hughes, Dominic Gilbert, Ewan Jones, Keioni Essex, Emily C. Ellis, Ross Davey, Adrienne A. Cox, Jessica A. Bassett
medRxiv 2024.06.29.24309595; doi: https://doi.org/10.1101/2024.06.29.24309595
Subject Area
Subject Areas
- Addiction Medicine (330)
- Allergy and Immunology (652)
- Anesthesia (174)
- Cardiovascular Medicine (2527)
- Dermatology (211)
- Emergency Medicine (387)
- Epidemiology (12005)
- Forensic Medicine (10)
- Gastroenterology (721)
- Genetic and Genomic Medicine (3920)
- Geriatric Medicine (368)
- Health Economics (655)
- Health Informatics (2536)
- Health Policy (978)
- Hematology (353)
- HIV/AIDS (814)
- Medical Education (390)
- Medical Ethics (106)
- Nephrology (420)
- Neurology (3681)
- Nursing (205)
- Nutrition (548)
- Oncology (1915)
- Ophthalmology (558)
- Orthopedics (231)
- Otolaryngology (299)
- Pain Medicine (244)
- Palliative Medicine (71)
- Pathology (466)
- Pediatrics (1078)
- Primary Care Research (436)
- Public and Global Health (6354)
- Radiology and Imaging (1342)
- Respiratory Medicine (847)
- Rheumatology (389)
- Sports Medicine (336)
- Surgery (427)
- Toxicology (51)
- Transplantation (180)
- Urology (157)