Abstract
Objectives The objective of this study was to evaluate the potential of Generative Artificial Intelligence (AI) in facilitating clinical communication, particularly in addressing sexual health concerns, which are often challenging for patients to discuss.
Methods We employed the Generative Pre-trained Transformer-3.5 (GPT) as the generative AI platform and utilized DocsBot for citation retrieval (June 2023). A structured prompt was devised to generate 100 questions from the AI, based on epidemiological survey data regarding sexual difficulties among cancer survivors. These questions were submitted to Bot1 (standard GPT) and Bot2 (sourced from two clinical guidelines). The responses from both bots were compared to assess consistency and adherence to clinical guidelines.
Results Our analysis revealed no censorship of sexual expressions or medical terms. The most common themes among the generated questions were cancer treatment, sexual health, and advice. The similarity rate between responses from Bot1 and Bot2 averaged 92.5% (range 77.0% to 98.4%), with notably lower similarity for items not covered in the guidelines. Despite the lack of reflection on guideline recommendations, counseling and other non-pharmacological interventions were significantly more prevalent in both bots’ responses compared to drug interventions, with odds ratios of 4.8 (p=0.04) in Bot1 and 14.9 (p<0.001) in Bot2.
Discussion Generative AI can serve for providing health information on sensitive topics such as sexual health, despite the potential for policy-restricted content. There was a significant skew towards non-pharmacological interventions in responses, possibly due to the prohibitive nature of medical topics. This shift warrants attention as it could potentially trigger patients’ expectations for non-pharmacological interventions.
Competing Interest Statement
The authors have declared no competing interest.
Funding Statement
This study was supported in part by RIKEN, which was not involved in the study design, data collection and analysis, decision to publish, or manuscript preparation.
Author Declarations
I confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.
Yes
The details of the IRB/oversight body that provided approval or exemption for the research described are given below:
The study used the data generated by Chat GPT(https://chat.openai.com/) and DocsBot (https://docsbot.ai/).
I confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.
Yes
I understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).
Yes
I have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.
Yes
