Abstract
Structured reporting may improve the radiological workflow and communication among physicians. Artificial intelligence applications in medicine are growing fast. Large language models (LLMs) are recently gaining importance as valuable tools in radiology and are currently being tested for the critical task of structured reporting. We compared four LLMs models in terms of knowledge on structured reporting and templates proposal. LLMs hold a great potential for generating structured reports in radiology but additional formal validations are needed on this topic.
This is a preview of subscription content, log in via an institution to check access.
References
Granata V, Faggioni L, Grassi R, Fusco R, Reginelli A, Rega D, Maggialetti N, Buccicardi D, Frittoli B, Rengo M, Bortolotto C, Prost R, Lacasella GV, Montella M, Ciaghi E, Bellifemine F, De Muzio F, Grazzini G, De Filippo M, Cappabianca S, Laghi A, Grassi R, Brunese L, Neri E, Miele V, Coppola F (2022) Structured reporting of computed tomography in the staging of colon cancer: a Delphi consensus proposal. Radiol Med 127(1):21–29. https://doi.org/10.1007/s11547-021-01418-9
Neri E, Granata V, Montemezzi S, Belli P, Bernardi D, Brancato B, Caumo F, Calabrese M, Coppola F, Cossu E, Faggioni L, Frigerio A, Fusco R, Petrillo A, Girardi V, Iacconi C, Marini C, Marino MA, Martincich L, Nori J, Pediconi F, Saguatti G, Sansone M, Sardanelli F, Scaperrotta GP, Zuiani C, Ciaghi E, Montella M, Miele V, Grassi R (2022) Structured reporting of x-ray mammography in the first diagnosis of breast cancer: a Delphi consensus proposal. Radiol Med 127(5):471–483. https://doi.org/10.1007/s11547-022-01478-5
Granata V, Fusco R, Cozzi D, Danti G, Faggioni L, Buccicardi D, Prost R, Ferrari R, Trinci M, Galluzzo M, Iacobellis F, Scaglione M, Tonerini M, Coppola F, Bortolotto C, Caruso D, Ciaghi E, Gabelloni M, Rengo M, Giacobbe G, Grassi F, Romano L, Pinto A, Caranci F, Bertelli E, D’Andrea P, Neri E, Giovagnoni A, Grassi R, Miele V (2023) Structured reporting of computed tomography in the polytrauma patient assessment: a Delphi consensus proposal. Radiol Med 128(2):222–233. https://doi.org/10.1007/s11547-023-01596-8
Belfiore MP, Urraro F, Grassi R, Giacobbe G, Patelli G, Cappabianca S, Reginelli A (2020) Artificial intelligence to codify lung CT in Covid-19 patients. Radiol Med 125(5):500–504. https://doi.org/10.1007/s11547-020-01195-x
Mallio CA, Napolitano A, Castiello G, Giordano FM, D’Alessio P, Iozzino M, Sun Y, Angeletti S, Russano M, Santini D, Tonini G, Zobel BB, Vincenzi B, Quattrocchi CC (2021) Deep learning algorithm trained with COVID-19 pneumonia also identifies immune checkpoint inhibitor therapy-related pneumonitis. Cancers 13(4):652. https://doi.org/10.3390/cancers13040652
Buvat I, Weber W (2023) Nuclear medicine from a novel perspective: buvat and weber talk with OpenAI’s ChatGPT. J Nucl Med 64(4):505–507. https://doi.org/10.2967/jnumed.123.265636
Lecler A, Duron L, Soyer P (2023) Revolutionizing radiology with GPT-based models: current applications, future possibilities and limitations of ChatGPT. Diagn Interv Imaging. https://doi.org/10.1016/j.diii.2023.02.003
Adams LC, Truhn D, Busch F, Kader A, Niehues SM, Makowski MR, Bressem KK (2023) Leveraging GPT-4 for post hoc transformation of free-text radiology reports into structured reporting: a multilingual feasibility study. Radiology 4:230725. https://doi.org/10.1148/radiol.230725
Nobel JM, Kok EM, Robben SGF (2020) Redefining the structure of structured reporting in radiology. Insights Imaging 11(1):10. https://doi.org/10.1186/s13244-019-0831-6
Larson DB, Towbin AJ, Pryor RM, Donnelly LF (2013) Improving consistency in radiology reporting through the use of department-wide standardized structured reporting. Radiology 267(1):240–250. https://doi.org/10.1148/radiol.12121502
Funding
The authors declare that no funds, grants or other support were received during the preparation of this manuscript.
Author information
Authors and Affiliations
Contributions
All authors contributed to the study conception and design. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Conflict of interest
The authors have no relevant financial or non-financial interests to disclose.
Ethical approval
This article does not contain any studies with human participants or animals performed by any of the authors.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Mallio, C.A., Sertorio, A.C., Bernetti, C. et al. Large language models for structured reporting in radiology: performance of GPT-4, ChatGPT-3.5, Perplexity and Bing. Radiol med 128, 808–812 (2023). https://doi.org/10.1007/s11547-023-01651-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11547-023-01651-4