Benchmarking Human-AI Collaboration for Common Evidence Appraisal Tools
View ORCID ProfileTim Woelfle, View ORCID ProfileJulian Hirt, View ORCID ProfilePerrine Janiaud, View ORCID ProfileLudwig Kappos, View ORCID ProfileJohn P. A. Ioannidis, View ORCID ProfileLars G. Hemkens
doi: https://doi.org/10.1101/2024.04.21.24306137
Tim Woelfle
1Pragmatic Evidence Lab, Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), Switzerland
2Department of Neurology, University Hospital Basel, Switzerland
3Translational Imaging in Neurology (ThINk), Department of Biomedical Engineering, University Hospital and University of Basel, Switzerland
MDJulian Hirt
1Pragmatic Evidence Lab, Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), Switzerland
4Department of Clinical Research, University Hospital Basel and University of Basel, Switzerland
5Institute of Nursing Science, Department of Health, Eastern Switzerland University of Applied Sciences, St. Gallen, Switzerland
PhDPerrine Janiaud
1Pragmatic Evidence Lab, Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), Switzerland
4Department of Clinical Research, University Hospital Basel and University of Basel, Switzerland
PhDLudwig Kappos
1Pragmatic Evidence Lab, Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), Switzerland
MDJohn P. A. Ioannidis
6Meta-Research Innovation Center at Stanford (METRICS), Stanford University, USA
7Departments of Medicine, of Epidemiology and Population Health, of Biomedical Data Science, and of Statistics, Stanford University, USA
MD DScLars G. Hemkens
1Pragmatic Evidence Lab, Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), Switzerland
4Department of Clinical Research, University Hospital Basel and University of Basel, Switzerland
6Meta-Research Innovation Center at Stanford (METRICS), Stanford University, USA
8Meta-Research Innovation Center Berlin (METRIC-B), Berlin Institute of Health, Berlin, Germany
MD MPH![Loading Loading](https://www.medrxiv.org/sites/all/modules/contrib/panels_ajax_tab/images/loading.gif)
Data Availability
All codes and data are openly available on GitHub at https://github.com/timwoelfle/Evidence-Appraisal-AI, reference number 36.
Posted April 22, 2024.
Benchmarking Human-AI Collaboration for Common Evidence Appraisal Tools
Tim Woelfle, Julian Hirt, Perrine Janiaud, Ludwig Kappos, John P. A. Ioannidis, Lars G. Hemkens
medRxiv 2024.04.21.24306137; doi: https://doi.org/10.1101/2024.04.21.24306137
Subject Area
Subject Areas
- Addiction Medicine (336)
- Allergy and Immunology (664)
- Anesthesia (178)
- Cardiovascular Medicine (2600)
- Dermatology (218)
- Emergency Medicine (391)
- Epidemiology (12139)
- Forensic Medicine (10)
- Gastroenterology (752)
- Genetic and Genomic Medicine (4035)
- Geriatric Medicine (380)
- Health Economics (671)
- Health Informatics (2607)
- Health Policy (995)
- Hematology (359)
- HIV/AIDS (833)
- Medical Education (397)
- Medical Ethics (109)
- Nephrology (426)
- Neurology (3804)
- Nursing (208)
- Nutrition (567)
- Oncology (1991)
- Ophthalmology (578)
- Orthopedics (235)
- Otolaryngology (303)
- Pain Medicine (250)
- Palliative Medicine (73)
- Pathology (470)
- Pediatrics (1100)
- Primary Care Research (443)
- Public and Global Health (6473)
- Radiology and Imaging (1379)
- Respiratory Medicine (866)
- Rheumatology (395)
- Sports Medicine (337)
- Surgery (438)
- Toxicology (52)
- Transplantation (185)
- Urology (165)