Evaluating Capabilities of Large Language Models: Performance of GPT4 on Surgical Knowledge Assessments
View ORCID ProfileBrendin R Beaulieu-Jones, Sahaj Shah, View ORCID ProfileMargaret T Berrigan, View ORCID ProfileJayson S Marwaha, Shuo-Lun Lai, View ORCID ProfileGabriel A Brat
doi: https://doi.org/10.1101/2023.07.16.23292743
Brendin R Beaulieu-Jones
1Department of Surgery, Beth Israel Deaconess Medical Center, Boston, MA
2Department of Biomedical Informatics, Harvard Medical School, Boston, MA
MD MBASahaj Shah
3Geisinger Commonwealth School of Medicine, Scranton, PA
BSMargaret T Berrigan
1Department of Surgery, Beth Israel Deaconess Medical Center, Boston, MA
MDJayson S Marwaha
4Division of Colorectal Surgery, National Taiwan University Hospital, Taipei, Taiwan
MD MBIShuo-Lun Lai
4Division of Colorectal Surgery, National Taiwan University Hospital, Taipei, Taiwan
MDGabriel A Brat
1Department of Surgery, Beth Israel Deaconess Medical Center, Boston, MA
2Department of Biomedical Informatics, Harvard Medical School, Boston, MA
MD, FACS, MPHCopyright
The copyright holder for this preprint is the author/funder, who has granted medRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Posted July 24, 2023.
Evaluating Capabilities of Large Language Models: Performance of GPT4 on Surgical Knowledge Assessments
Brendin R Beaulieu-Jones, Sahaj Shah, Margaret T Berrigan, Jayson S Marwaha, Shuo-Lun Lai, Gabriel A Brat
medRxiv 2023.07.16.23292743; doi: https://doi.org/10.1101/2023.07.16.23292743
Subject Area
Subject Areas
- Addiction Medicine (399)
- Allergy and Immunology (708)
- Anesthesia (200)
- Cardiovascular Medicine (2918)
- Dermatology (249)
- Emergency Medicine (438)
- Epidemiology (12711)
- Forensic Medicine (12)
- Gastroenterology (827)
- Genetic and Genomic Medicine (4567)
- Geriatric Medicine (415)
- Health Economics (726)
- Health Informatics (2913)
- Health Policy (1068)
- Hematology (386)
- HIV/AIDS (922)
- Medical Education (422)
- Medical Ethics (115)
- Nephrology (467)
- Neurology (4335)
- Nursing (234)
- Nutrition (636)
- Oncology (2261)
- Ophthalmology (643)
- Orthopedics (258)
- Otolaryngology (324)
- Pain Medicine (278)
- Palliative Medicine (83)
- Pathology (499)
- Pediatrics (1196)
- Primary Care Research (494)
- Public and Global Health (6916)
- Radiology and Imaging (1524)
- Respiratory Medicine (915)
- Rheumatology (436)
- Sports Medicine (383)
- Surgery (486)
- Toxicology (60)
- Transplantation (210)
- Urology (178)