HIBRID: Histology and ct-DNA based Risk-stratification with Deep Learning
View ORCID ProfileChiara M.L. Loeffler, View ORCID ProfileHideaki Bando, Srividhya Sainath, View ORCID ProfileHannah Sophie Muti, Xiaofeng Jiang, Marko van Treeck, View ORCID ProfileNic Gabriel Reitsam, View ORCID ProfileZunamys I. Carrero, View ORCID ProfileTomomi Nishikawa, Toshihiro Misumi, Saori Mishima, Daisuke Kotani, Hiroya Taniguchi, Ichiro Takemasa, Takeshi Kato, Eiji Oki, Tanwei Yuan, Durgesh Wankhede, View ORCID ProfileSebastian Foersch, Hermann Brenner, View ORCID ProfileMichael Hoffmeister, Yoshiaki Nakamura, Takayuki Yoshino, View ORCID ProfileJakob Nikolas Kather
doi: https://doi.org/10.1101/2024.07.23.24310822
Chiara M.L. Loeffler
1Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
2Medical Department 1, University Hospital and Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
3National Center for Tumor Diseases Dresden (NCT/UCC), a partnership between DKFZ, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology, and Helmholtz-Zentrum Dresden - Rossendorf (HZDR), Dresden, Germany
Hideaki Bando
4Department of Data Science, National Cancer Center Hospital East, Kashiwa, Japan
5Department of Gastroenterology and Gastrointestinal Oncology, National Cancer Center Hospital East, Kashiwa, Japan
6Translational Research Support Office, National Cancer Center Hospital East, Kashiwa, Japan
Srividhya Sainath
1Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
Hannah Sophie Muti
1Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
2Medical Department 1, University Hospital and Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
7Department for Visceral, Thoracic and Vascular Surgery, University Hospital and Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
Xiaofeng Jiang
1Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
Marko van Treeck
1Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
Nic Gabriel Reitsam
1Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
8Pathology, Faculty of Medicine, University of Augsburg, Augsburg, Germany
9Bavarian Cancer Research Center (BZKF), Augsburg, Germany
Zunamys I. Carrero
1Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
Tomomi Nishikawa
4Department of Data Science, National Cancer Center Hospital East, Kashiwa, Japan
Toshihiro Misumi
4Department of Data Science, National Cancer Center Hospital East, Kashiwa, Japan
Saori Mishima
5Department of Gastroenterology and Gastrointestinal Oncology, National Cancer Center Hospital East, Kashiwa, Japan
Daisuke Kotani
5Department of Gastroenterology and Gastrointestinal Oncology, National Cancer Center Hospital East, Kashiwa, Japan
Hiroya Taniguchi
10Department of Clinical Oncology, Aichi Cancer Center Hospital, Nagoya, Japan
Ichiro Takemasa
11Department of Surgery, Surgical Oncology and Science, Sapporo Medical University, Sapporo, Japan
Takeshi Kato
12Department of Surgery, NHO Osaka National Hospital, Osaka, Japan
Eiji Oki
13Department of Surgery and Science, Graduate School of Medical Sciences, Kyushu University, Fukuoka, Japan
Tanwei Yuan
14Division of Clinical Epidemiology and Aging Research, German Cancer Research Center (DKFZ), Heidelberg, Germany
Durgesh Wankhede
14Division of Clinical Epidemiology and Aging Research, German Cancer Research Center (DKFZ), Heidelberg, Germany
Sebastian Foersch
15Institute of Pathology, University Medical Center Mainz, Mainz, Germany
Hermann Brenner
14Division of Clinical Epidemiology and Aging Research, German Cancer Research Center (DKFZ), Heidelberg, Germany
16Medical Oncology, National Center for Tumor Diseases (NCT), University Hospital Heidelberg, Heidelberg, Germany
Michael Hoffmeister
14Division of Clinical Epidemiology and Aging Research, German Cancer Research Center (DKFZ), Heidelberg, Germany
Yoshiaki Nakamura
5Department of Gastroenterology and Gastrointestinal Oncology, National Cancer Center Hospital East, Kashiwa, Japan
6Translational Research Support Office, National Cancer Center Hospital East, Kashiwa, Japan
Takayuki Yoshino
4Department of Data Science, National Cancer Center Hospital East, Kashiwa, Japan
5Department of Gastroenterology and Gastrointestinal Oncology, National Cancer Center Hospital East, Kashiwa, Japan
6Translational Research Support Office, National Cancer Center Hospital East, Kashiwa, Japan
Jakob Nikolas Kather
1Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany
2Medical Department 1, University Hospital and Faculty of Medicine Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
3National Center for Tumor Diseases Dresden (NCT/UCC), a partnership between DKFZ, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology, and Helmholtz-Zentrum Dresden - Rossendorf (HZDR), Dresden, Germany
16Medical Oncology, National Center for Tumor Diseases (NCT), University Hospital Heidelberg, Heidelberg, Germany
Data Availability
Our whole slide image preprocessing pipeline is available here: https://github.com/KatherLab/end2end-WSI-preprocessing. The code for the pretrained vision encoder UNI can be found under: https://github.com/mahmoodlab/uni. Our DL model codes are publicly available at https://github.com/KatherLab/marugoto/tree/survival-transformer/marugoto/survival. The respective study Principal Investigators provided the remaining data. For detailed data sharing policies, please refer to the original publications.
https://github.com/KatherLab/end2end-WSI-preprocessing
https://github.com/mahmoodlab/uni
https://github.com/KatherLab/marugoto/tree/survival-transformer/marugoto/survival
Posted July 23, 2024.
HIBRID: Histology and ct-DNA based Risk-stratification with Deep Learning
Chiara M.L. Loeffler, Hideaki Bando, Srividhya Sainath, Hannah Sophie Muti, Xiaofeng Jiang, Marko van Treeck, Nic Gabriel Reitsam, Zunamys I. Carrero, Tomomi Nishikawa, Toshihiro Misumi, Saori Mishima, Daisuke Kotani, Hiroya Taniguchi, Ichiro Takemasa, Takeshi Kato, Eiji Oki, Tanwei Yuan, Durgesh Wankhede, Sebastian Foersch, Hermann Brenner, Michael Hoffmeister, Yoshiaki Nakamura, Takayuki Yoshino, Jakob Nikolas Kather
medRxiv 2024.07.23.24310822; doi: https://doi.org/10.1101/2024.07.23.24310822
HIBRID: Histology and ct-DNA based Risk-stratification with Deep Learning
Chiara M.L. Loeffler, Hideaki Bando, Srividhya Sainath, Hannah Sophie Muti, Xiaofeng Jiang, Marko van Treeck, Nic Gabriel Reitsam, Zunamys I. Carrero, Tomomi Nishikawa, Toshihiro Misumi, Saori Mishima, Daisuke Kotani, Hiroya Taniguchi, Ichiro Takemasa, Takeshi Kato, Eiji Oki, Tanwei Yuan, Durgesh Wankhede, Sebastian Foersch, Hermann Brenner, Michael Hoffmeister, Yoshiaki Nakamura, Takayuki Yoshino, Jakob Nikolas Kather
medRxiv 2024.07.23.24310822; doi: https://doi.org/10.1101/2024.07.23.24310822
Subject Area
Subject Areas
- Addiction Medicine (383)
- Allergy and Immunology (699)
- Anesthesia (192)
- Cardiovascular Medicine (2854)
- Dermatology (244)
- Emergency Medicine (430)
- Epidemiology (12563)
- Forensic Medicine (10)
- Gastroenterology (807)
- Genetic and Genomic Medicine (4437)
- Geriatric Medicine (402)
- Health Economics (716)
- Health Informatics (2851)
- Health Policy (1049)
- Hematology (375)
- HIV/AIDS (893)
- Medical Education (413)
- Medical Ethics (114)
- Nephrology (464)
- Neurology (4196)
- Nursing (222)
- Nutrition (617)
- Oncology (2204)
- Ophthalmology (624)
- Orthopedics (254)
- Otolaryngology (318)
- Pain Medicine (268)
- Palliative Medicine (82)
- Pathology (486)
- Pediatrics (1172)
- Primary Care Research (483)
- Public and Global Health (6784)
- Radiology and Imaging (1490)
- Respiratory Medicine (900)
- Rheumatology (430)
- Sports Medicine (369)
- Surgery (473)
- Toxicology (57)
- Transplantation (202)
- Urology (174)