Performance of ChatGPT and GPT-4 on Neurosurgery Written Board Examinations
Rohaid Ali, Oliver Y. Tang, Ian D. Connolly, Patricia L. Zadnik Sullivan, John H. Shin, Jared S. Fridley, Wael F. Asaad, Deus Cielo, Adetokunbo A. Oyelese, Curtis E. Doberstein, Ziya L. Gokaslan, Albert E. Telfeian
doi: https://doi.org/10.1101/2023.03.25.23287743
Rohaid Ali
1Department of Neurosurgery, The Warren Alpert Medical School of Brown University, Providence, RI, USA
MDOliver Y. Tang
1Department of Neurosurgery, The Warren Alpert Medical School of Brown University, Providence, RI, USA
2Department of Neurosurgery, University of Pittsburgh, Pittsburgh, PA, USA
BSIan D. Connolly
3Department of Neurosurgery, Massachusetts General Hospital, Boston, MA, USA
MD, MSPatricia L. Zadnik Sullivan
1Department of Neurosurgery, The Warren Alpert Medical School of Brown University, Providence, RI, USA
MDJohn H. Shin
3Department of Neurosurgery, Massachusetts General Hospital, Boston, MA, USA
MDJared S. Fridley
1Department of Neurosurgery, The Warren Alpert Medical School of Brown University, Providence, RI, USA
MDWael F. Asaad
1Department of Neurosurgery, The Warren Alpert Medical School of Brown University, Providence, RI, USA
MD, PhDDeus Cielo
1Department of Neurosurgery, The Warren Alpert Medical School of Brown University, Providence, RI, USA
MDAdetokunbo A. Oyelese
1Department of Neurosurgery, The Warren Alpert Medical School of Brown University, Providence, RI, USA
MD, PhDCurtis E. Doberstein
1Department of Neurosurgery, The Warren Alpert Medical School of Brown University, Providence, RI, USA
MDZiya L. Gokaslan
1Department of Neurosurgery, The Warren Alpert Medical School of Brown University, Providence, RI, USA
MDAlbert E. Telfeian
1Department of Neurosurgery, The Warren Alpert Medical School of Brown University, Providence, RI, USA
MD, PhDData Availability
Due to the proprietary nature of the dataset used for this study (Self- Assessment Neurosurgery Exams American Board of Neurological Surgery Self-Assessment Exam 1), the authors are unable to post the raw data used for the analysis. However, the authors are able to share any collected data (ex. word count, question classification, ChatGPT responses, etc.) on request to other investigators who have access to this self-assessment exam. Code used for this study's analyses is available to download from a public GitHub repository.
Posted March 29, 2023.
Performance of ChatGPT and GPT-4 on Neurosurgery Written Board Examinations
Rohaid Ali, Oliver Y. Tang, Ian D. Connolly, Patricia L. Zadnik Sullivan, John H. Shin, Jared S. Fridley, Wael F. Asaad, Deus Cielo, Adetokunbo A. Oyelese, Curtis E. Doberstein, Ziya L. Gokaslan, Albert E. Telfeian
medRxiv 2023.03.25.23287743; doi: https://doi.org/10.1101/2023.03.25.23287743
Performance of ChatGPT and GPT-4 on Neurosurgery Written Board Examinations
Rohaid Ali, Oliver Y. Tang, Ian D. Connolly, Patricia L. Zadnik Sullivan, John H. Shin, Jared S. Fridley, Wael F. Asaad, Deus Cielo, Adetokunbo A. Oyelese, Curtis E. Doberstein, Ziya L. Gokaslan, Albert E. Telfeian
medRxiv 2023.03.25.23287743; doi: https://doi.org/10.1101/2023.03.25.23287743
Subject Area
Subject Areas
- Addiction Medicine (404)
- Allergy and Immunology (713)
- Anesthesia (208)
- Cardiovascular Medicine (2973)
- Dermatology (254)
- Emergency Medicine (446)
- Epidemiology (12828)
- Forensic Medicine (12)
- Gastroenterology (834)
- Genetic and Genomic Medicine (4626)
- Geriatric Medicine (424)
- Health Economics (733)
- Health Informatics (2945)
- Health Policy (1074)
- Hematology (394)
- HIV/AIDS (935)
- Medical Education (430)
- Medical Ethics (116)
- Nephrology (476)
- Neurology (4423)
- Nursing (238)
- Nutrition (653)
- Oncology (2299)
- Ophthalmology (653)
- Orthopedics (260)
- Otolaryngology (327)
- Pain Medicine (284)
- Palliative Medicine (85)
- Pathology (503)
- Pediatrics (1201)
- Primary Care Research (503)
- Public and Global Health (7014)
- Radiology and Imaging (1551)
- Respiratory Medicine (922)
- Rheumatology (446)
- Sports Medicine (386)
- Surgery (491)
- Toxicology (60)
- Transplantation (213)
- Urology (185)