Comparative Analysis of GPT-4Vision, GPT-4 and Open Source LLMs in Clinical Diagnostic Accuracy: A Benchmark Against Human Expertise
Tianyu Han, Lisa C Adams, Keno Bressem, Felix Busch, Luisa Huck, View ORCID ProfileSven Nebelung, Daniel Truhn
doi: https://doi.org/10.1101/2023.11.03.23297957
Tianyu Han
1Uniklinik RWTH Aachen
Lisa C Adams
2Technical University of Munich
Keno Bressem
3Charite - Universitaetsmedizin Berlin
Felix Busch
3Charite - Universitaetsmedizin Berlin
Luisa Huck
1Uniklinik RWTH Aachen
Sven Nebelung
1Uniklinik RWTH Aachen
Daniel Truhn
1Uniklinik RWTH Aachen

Data Availability
The data that support the findings of this study are openly available (https://jamanetwork.com/collections/44038/clinical-challenge and https://www.nejm.org/case-challenges). Specific data related to AI model responses can be accessed freely, ensuring transparency and reproducibility of the research.
Posted November 08, 2023.
Comparative Analysis of GPT-4Vision, GPT-4 and Open Source LLMs in Clinical Diagnostic Accuracy: A Benchmark Against Human Expertise
Tianyu Han, Lisa C Adams, Keno Bressem, Felix Busch, Luisa Huck, Sven Nebelung, Daniel Truhn
medRxiv 2023.11.03.23297957; doi: https://doi.org/10.1101/2023.11.03.23297957
Comparative Analysis of GPT-4Vision, GPT-4 and Open Source LLMs in Clinical Diagnostic Accuracy: A Benchmark Against Human Expertise
Tianyu Han, Lisa C Adams, Keno Bressem, Felix Busch, Luisa Huck, Sven Nebelung, Daniel Truhn
medRxiv 2023.11.03.23297957; doi: https://doi.org/10.1101/2023.11.03.23297957
Subject Area
Subject Areas
- Addiction Medicine (410)
- Allergy and Immunology (725)
- Anesthesia (214)
- Cardiovascular Medicine (3086)
- Dermatology (260)
- Emergency Medicine (462)
- Epidemiology (13014)
- Forensic Medicine (13)
- Gastroenterology (860)
- Genetic and Genomic Medicine (4834)
- Geriatric Medicine (445)
- Health Economics (750)
- Health Informatics (3057)
- Health Policy (1101)
- Hematology (410)
- HIV/AIDS (956)
- Medical Education (453)
- Medical Ethics (119)
- Nephrology (499)
- Neurology (4606)
- Nursing (244)
- Nutrition (684)
- Oncology (2385)
- Ophthalmology (673)
- Orthopedics (268)
- Otolaryngology (333)
- Pain Medicine (300)
- Palliative Medicine (87)
- Pathology (514)
- Pediatrics (1239)
- Primary Care Research (520)
- Public and Global Health (7189)
- Radiology and Imaging (1601)
- Respiratory Medicine (943)
- Rheumatology (459)
- Sports Medicine (403)
- Surgery (509)
- Toxicology (65)
- Transplantation (221)
- Urology (189)