Can ChatGPT-4o really pass medical science exams? A pragmatic analysis using novel questions
View ORCID ProfilePhilip M. Newton, View ORCID ProfileChristopher J. Summers, View ORCID ProfileUzman Zaheer, View ORCID ProfileMaira Xiromeriti, View ORCID ProfileJemima R. Stokes, Jaskaran Singh Bhangu, View ORCID ProfileElis G. Roome, Alanna Roberts-Phillips, View ORCID ProfileDarius Mazaheri-Asadi, Cameron D. Jones, Stuart Hughes, View ORCID ProfileDominic Gilbert, View ORCID ProfileEwan Jones, Keioni Essex, View ORCID ProfileEmily C. Ellis, View ORCID ProfileRoss Davey, View ORCID ProfileAdrienne A. Cox, View ORCID ProfileJessica A. Bassett
doi: https://doi.org/10.1101/2024.06.29.24309595
Philip M. Newton
1Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Christopher J. Summers
1Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Uzman Zaheer
1Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Maira Xiromeriti
1Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Jemima R. Stokes
1Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Jaskaran Singh Bhangu
1Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Elis G. Roome
1Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Alanna Roberts-Phillips
1Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Darius Mazaheri-Asadi
1Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Cameron D. Jones
1Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Stuart Hughes
1Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Dominic Gilbert
1Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Ewan Jones
1Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Keioni Essex
1Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Emily C. Ellis
1Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Ross Davey
1Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Adrienne A. Cox
1Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Jessica A. Bassett
1Swansea University Medical School, Swansea, Wales, United Kingdom, SA2 8PP
Posted June 30, 2024.
Can ChatGPT-4o really pass medical science exams? A pragmatic analysis using novel questions
Philip M. Newton, Christopher J. Summers, Uzman Zaheer, Maira Xiromeriti, Jemima R. Stokes, Jaskaran Singh Bhangu, Elis G. Roome, Alanna Roberts-Phillips, Darius Mazaheri-Asadi, Cameron D. Jones, Stuart Hughes, Dominic Gilbert, Ewan Jones, Keioni Essex, Emily C. Ellis, Ross Davey, Adrienne A. Cox, Jessica A. Bassett
medRxiv 2024.06.29.24309595; doi: https://doi.org/10.1101/2024.06.29.24309595
Can ChatGPT-4o really pass medical science exams? A pragmatic analysis using novel questions
Philip M. Newton, Christopher J. Summers, Uzman Zaheer, Maira Xiromeriti, Jemima R. Stokes, Jaskaran Singh Bhangu, Elis G. Roome, Alanna Roberts-Phillips, Darius Mazaheri-Asadi, Cameron D. Jones, Stuart Hughes, Dominic Gilbert, Ewan Jones, Keioni Essex, Emily C. Ellis, Ross Davey, Adrienne A. Cox, Jessica A. Bassett
medRxiv 2024.06.29.24309595; doi: https://doi.org/10.1101/2024.06.29.24309595
Subject Area
Subject Areas
- Addiction Medicine (382)
- Allergy and Immunology (699)
- Anesthesia (191)
- Cardiovascular Medicine (2840)
- Dermatology (243)
- Emergency Medicine (428)
- Epidemiology (12551)
- Forensic Medicine (10)
- Gastroenterology (802)
- Genetic and Genomic Medicine (4424)
- Geriatric Medicine (401)
- Health Economics (715)
- Health Informatics (2849)
- Health Policy (1047)
- Hematology (375)
- HIV/AIDS (893)
- Medical Education (413)
- Medical Ethics (114)
- Nephrology (461)
- Neurology (4183)
- Nursing (221)
- Nutrition (616)
- Oncology (2199)
- Ophthalmology (623)
- Orthopedics (254)
- Otolaryngology (317)
- Pain Medicine (267)
- Palliative Medicine (81)
- Pathology (486)
- Pediatrics (1171)
- Primary Care Research (482)
- Public and Global Health (6774)
- Radiology and Imaging (1487)
- Respiratory Medicine (899)
- Rheumatology (430)
- Sports Medicine (369)
- Surgery (473)
- Toxicology (57)
- Transplantation (200)
- Urology (174)