RT Journal Article
SR Electronic
T1 Can GPT-4 suggest the optimal sequence for brain magnetic resonance imaging?
JF medRxiv
FD Cold Spring Harbor Laboratory Press
SP 2024.07.31.24311123
DO 10.1101/2024.07.31.24311123
A1 Suzuki, Kazufumi
A1 Abe, Kayoko
A1 Sakai, Shuji
YR 2024
UL http://medrxiv.org/content/early/2024/08/02/2024.07.31.24311123.abstract
AB Purpose This study aimed to evaluate the potential of GPT-4, a large language model, in assisting radiologists to determine brain magnetic resonance imaging (MRI) protocols.Materials and methods We used brain MRI protocols from a specific hospital, covering 20 diseases or examination purposes, excluding brain tumor protocols. GPT-4 was given system prompts to add one MRI sequence for the basic brain MRI protocol and disease names were input as user prompts. The model’s suggestions were evaluated by two radiologists with over 20 years of relevant experience. Suggestions were scored based on their alignment with the hospital’s protocol as follows: 0 for inappropriate, 1 for acceptable but nonmatching, and 2 for matching the protocol. The experiment was conducted in both Japanese and English to compare GPT-4’s performance in different languages.Results GPT-4 scored 27/40 points in English and 28/40 points in Japanese. GPT-4 gave inappropriate suggestions for Moyamoya disease and neuromyelitis optica in both languages and cerebral infarction in Japanese. For the other protocols, the suggested sequences were either appropriate or better. The suggestions in English differed from those in Japanese for seven protocols.Conclusion GPT-4 generally suggested suitable MRI sequences. The study demonstrates that GPT-4 can help radiologists to determine protocols; however, further research is required for the radiological application of LLMs.Competing Interest StatementThe authors have declared no competing interest.Funding StatementThe author received no financial support for the research, authorship, and/or publication of this article.Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesI confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesAll data obtained from GPT-4 are compiled in an Excel sheet containing data sheets in both English and Japanese and available as Supplement.