Comparing the Performance of ChatGPT and GPT-4 versus a Cohort of Medical Students on an Official University of Toronto Undergraduate Medical Education Progress Test
View ORCID ProfileChristopher Meaney, View ORCID ProfileRyan S. Huang, Kevin (Jia Qi) Lu, Adam W. Fischer, View ORCID ProfileFok-Han Leung, View ORCID ProfileKulamakan Kulasegaram, Katina Tzanetos, View ORCID ProfileAngela Punnett
doi: https://doi.org/10.1101/2023.09.14.23295571
Christopher Meaney
1Department of Family and Community Medicine, University of Toronto, Toronto, Ontario, Canada
Ryan S. Huang
2Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
Kevin (Jia Qi) Lu
2Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
Adam W. Fischer
3Department of Computer Science, University of Guelph, Guelph, Ontario, Canada
Fok-Han Leung
1Department of Family and Community Medicine, University of Toronto, Toronto, Ontario, Canada
Kulamakan Kulasegaram
1Department of Family and Community Medicine, University of Toronto, Toronto, Ontario, Canada
Katina Tzanetos
2Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
Angela Punnett
2Temerty Faculty of Medicine, University of Toronto, Toronto, Ontario, Canada
Data Availability
University of Toronto Undergraduate Medical Education Progress Test questions (input prompts to ChatGPT/GPT-4) are considered proprietary information, and are not available publicly.
Posted September 14, 2023.
Comparing the Performance of ChatGPT and GPT-4 versus a Cohort of Medical Students on an Official University of Toronto Undergraduate Medical Education Progress Test
Christopher Meaney, Ryan S. Huang, Kevin (Jia Qi) Lu, Adam W. Fischer, Fok-Han Leung, Kulamakan Kulasegaram, Katina Tzanetos, Angela Punnett
medRxiv 2023.09.14.23295571; doi: https://doi.org/10.1101/2023.09.14.23295571
Comparing the Performance of ChatGPT and GPT-4 versus a Cohort of Medical Students on an Official University of Toronto Undergraduate Medical Education Progress Test
Christopher Meaney, Ryan S. Huang, Kevin (Jia Qi) Lu, Adam W. Fischer, Fok-Han Leung, Kulamakan Kulasegaram, Katina Tzanetos, Angela Punnett
medRxiv 2023.09.14.23295571; doi: https://doi.org/10.1101/2023.09.14.23295571
Subject Area
Subject Areas
- Addiction Medicine (380)
- Allergy and Immunology (695)
- Anesthesia (186)
- Cardiovascular Medicine (2809)
- Dermatology (241)
- Emergency Medicine (424)
- Epidemiology (12499)
- Forensic Medicine (10)
- Gastroenterology (796)
- Genetic and Genomic Medicine (4364)
- Geriatric Medicine (398)
- Health Economics (711)
- Health Informatics (2813)
- Health Policy (1042)
- Hematology (372)
- HIV/AIDS (888)
- Medical Education (411)
- Medical Ethics (113)
- Nephrology (460)
- Neurology (4130)
- Nursing (219)
- Nutrition (613)
- Oncology (2178)
- Ophthalmology (616)
- Orthopedics (253)
- Otolaryngology (316)
- Pain Medicine (260)
- Palliative Medicine (80)
- Pathology (482)
- Pediatrics (1166)
- Primary Care Research (480)
- Public and Global Health (6719)
- Radiology and Imaging (1475)
- Respiratory Medicine (893)
- Rheumatology (427)
- Sports Medicine (359)
- Surgery (468)
- Toxicology (57)
- Transplantation (197)
- Urology (173)