Follow this preprint
How Does ChatGPT Perform on the Medical Licensing Exams? The Implications of Large Language Models for Medical Education and Knowledge Assessment
View ORCID ProfileAidan Gilson, View ORCID ProfileConrad Safranek, Thomas Huang, View ORCID ProfileVimig Socrates, View ORCID ProfileLing Chi, View ORCID ProfileR. Andrew Taylor, View ORCID ProfileDavid Chartash
doi: https://doi.org/10.1101/2022.12.23.22283901
This article is a preprint and has not been peer-reviewed [what does this mean?]. It reports new medical research that has yet to be evaluated and so should not be used to guide clinical practice.
Aidan Gilson
1Section for Biomedical Informatics and Data Science, Yale University School of Medicine
2Department of Emergency Medicine, Yale School of Medicine
Conrad Safranek
1Section for Biomedical Informatics and Data Science, Yale University School of Medicine
Thomas Huang
2Department of Emergency Medicine, Yale School of Medicine
Vimig Socrates
1Section for Biomedical Informatics and Data Science, Yale University School of Medicine
3Program of Computational Biology and Bioinformatics, Yale University
Ling Chi
1Section for Biomedical Informatics and Data Science, Yale University School of Medicine
R. Andrew Taylor
1Section for Biomedical Informatics and Data Science, Yale University School of Medicine
2Department of Emergency Medicine, Yale School of Medicine
David Chartash
1Section for Biomedical Informatics and Data Science, Yale University School of Medicine
4School of Medicine, University College Dublin - National University of Ireland, Dublin

Data Availability
All data produced in the present work are available online at the following link:
Posted December 26, 2022.
How Does ChatGPT Perform on the Medical Licensing Exams? The Implications of Large Language Models for Medical Education and Knowledge Assessment
Aidan Gilson, Conrad Safranek, Thomas Huang, Vimig Socrates, Ling Chi, R. Andrew Taylor, David Chartash
medRxiv 2022.12.23.22283901; doi: https://doi.org/10.1101/2022.12.23.22283901
This article is a preprint and has not been peer-reviewed [what does this mean?]. It reports new medical research that has yet to be evaluated and so should not be used to guide clinical practice.
Subject Area
Reviews and Context
0
Comment
0
TRIP Peer Reviews
0
Community Reviews
0
Automated Services
4
Blogs/Media
0
Author Videos
Subject Areas
- Addiction Medicine (418)
- Allergy and Immunology (741)
- Anesthesia (217)
- Cardiovascular Medicine (3183)
- Dermatology (268)
- Emergency Medicine (469)
- Epidemiology (13160)
- Forensic Medicine (18)
- Gastroenterology (880)
- Genetic and Genomic Medicine (4995)
- Geriatric Medicine (460)
- Health Economics (765)
- Health Informatics (3145)
- Health Policy (1116)
- Hematology (418)
- HIV/AIDS (989)
- Medical Education (463)
- Medical Ethics (122)
- Nephrology (512)
- Neurology (4742)
- Nursing (253)
- Nutrition (702)
- Oncology (2438)
- Ophthalmology (692)
- Orthopedics (273)
- Otolaryngology (335)
- Pain Medicine (316)
- Palliative Medicine (89)
- Pathology (525)
- Pediatrics (1267)
- Primary Care Research (539)
- Public and Global Health (7308)
- Radiology and Imaging (1641)
- Respiratory Medicine (956)
- Rheumatology (468)
- Sports Medicine (411)
- Surgery (528)
- Toxicology (66)
- Transplantation (226)
- Urology (196)