A pen mark is all you need - Incidental prompt injection attacks on Vision Language Models in real-life histopathology
View ORCID ProfileJan Clusmann, Stefan J. K. Schulz, Dyke Ferber, Isabella C. Wiest, Aurélie Fernandez, Markus Eckstein, Fabienne Lange, Nic G. Reitsam, Franziska Kellers, Maxime Schmitt, Peter Neidlinger, Paul-Henry Koop, Carolin V. Schneider, Daniel Truhn, Wilfried Roth, Moritz Jesinghaus, Jakob N. Kather, Sebastian Foersch
doi: https://doi.org/10.1101/2024.12.11.24318840
Jan Clusmann
1Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
2Department of Medicine III, University Hospital RWTH Aachen, Aachen, Germany
Stefan J. K. Schulz
3Institute of Pathology, University Medical Center Mainz, Mainz, Germany
Dyke Ferber
1Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
4Department of Medical Oncology, National Center for Tumor Diseases (NCT), Heidelberg University Hospital, Heidelberg, Germany
Isabella C. Wiest
1Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
5Department of Medicine II, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany
Aurélie Fernandez
3Institute of Pathology, University Medical Center Mainz, Mainz, Germany
Markus Eckstein
6Universitätsklinikum Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany & Comprehensive Cancer Center Erlangen-EMN (CCC ER-EMN), Erlangen, Germany & Comprehensive Cancer Center Alliance WERA (CCC WERA)
7Bavarian Cancer Research Center (BZKF)
Fabienne Lange
6Universitätsklinikum Erlangen, Friedrich-Alexander-Universität Erlangen-Nürnberg (FAU), Erlangen, Germany & Comprehensive Cancer Center Erlangen-EMN (CCC ER-EMN), Erlangen, Germany & Comprehensive Cancer Center Alliance WERA (CCC WERA)
7Bavarian Cancer Research Center (BZKF)
Nic G. Reitsam
1Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
7Bavarian Cancer Research Center (BZKF)
8Pathology, Faculty of Medicine, University of Augsburg, Augsburg, Germany
Franziska Kellers
9Department of Pathology, University Hospital Schleswig-Holstein, Campus Kiel, Kiel, Germany
Maxime Schmitt
10Institute of Pathology, Philipps-University Marburg und University Hospital Marburg, Marburg, Germany
Peter Neidlinger
1Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
Paul-Henry Koop
1Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
2Department of Medicine III, University Hospital RWTH Aachen, Aachen, Germany
Carolin V. Schneider
2Department of Medicine III, University Hospital RWTH Aachen, Aachen, Germany
Daniel Truhn
11Department of Diagnostic and Interventional Radiology, University Hospital Aachen, Germany
Wilfried Roth
3Institute of Pathology, University Medical Center Mainz, Mainz, Germany
Moritz Jesinghaus
10Institute of Pathology, Philipps-University Marburg und University Hospital Marburg, Marburg, Germany
Jakob N. Kather
1Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
12Department of Medicine I, University Hospital Dresden, Dresden, Germany
Sebastian Foersch
3Institute of Pathology, University Medical Center Mainz, Mainz, Germany
Data availability
The original data (images, prompts, model outputs, ratings, summary statistics) are available in the supplementary data and supplementary information. The following publicly accessible data was used for this study: COAD-READ, the THCA, the OV, and the PRAD cohort of the TCGA, can be found at https://portal.gdc.cancer.gov/. Slides for the lymph node metastasis scenario can be found at https://www.cancerimagingarchive.net/collection/sln-breast/.
Posted December 12, 2024.
A pen mark is all you need - Incidental prompt injection attacks on Vision Language Models in real-life histopathology
Jan Clusmann, Stefan J. K. Schulz, Dyke Ferber, Isabella C. Wiest, Aurélie Fernandez, Markus Eckstein, Fabienne Lange, Nic G. Reitsam, Franziska Kellers, Maxime Schmitt, Peter Neidlinger, Paul-Henry Koop, Carolin V. Schneider, Daniel Truhn, Wilfried Roth, Moritz Jesinghaus, Jakob N. Kather, Sebastian Foersch
medRxiv 2024.12.11.24318840; doi: https://doi.org/10.1101/2024.12.11.24318840
A pen mark is all you need - Incidental prompt injection attacks on Vision Language Models in real-life histopathology
Jan Clusmann, Stefan J. K. Schulz, Dyke Ferber, Isabella C. Wiest, Aurélie Fernandez, Markus Eckstein, Fabienne Lange, Nic G. Reitsam, Franziska Kellers, Maxime Schmitt, Peter Neidlinger, Paul-Henry Koop, Carolin V. Schneider, Daniel Truhn, Wilfried Roth, Moritz Jesinghaus, Jakob N. Kather, Sebastian Foersch
medRxiv 2024.12.11.24318840; doi: https://doi.org/10.1101/2024.12.11.24318840
Subject Area
Subject Areas
- Addiction Medicine (399)
- Allergy and Immunology (708)
- Anesthesia (201)
- Cardiovascular Medicine (2940)
- Dermatology (249)
- Emergency Medicine (439)
- Epidemiology (12743)
- Forensic Medicine (12)
- Gastroenterology (828)
- Genetic and Genomic Medicine (4582)
- Geriatric Medicine (417)
- Health Economics (729)
- Health Informatics (2914)
- Health Policy (1069)
- Hematology (389)
- HIV/AIDS (924)
- Medical Education (425)
- Medical Ethics (115)
- Nephrology (468)
- Neurology (4350)
- Nursing (236)
- Nutrition (639)
- Oncology (2268)
- Ophthalmology (646)
- Orthopedics (258)
- Otolaryngology (325)
- Pain Medicine (279)
- Palliative Medicine (83)
- Pathology (501)
- Pediatrics (1196)
- Primary Care Research (496)
- Public and Global Health (6935)
- Radiology and Imaging (1527)
- Respiratory Medicine (915)
- Rheumatology (437)
- Sports Medicine (385)
- Surgery (488)
- Toxicology (60)
- Transplantation (212)
- Urology (180)