PT - JOURNAL ARTICLE AU - Ayre, Julie AU - Mac, Olivia AU - McCaffery, Kirsten AU - McKay, Brad R AU - Liu, Mingyi AU - Shi, Yi AU - Rezwan, Atria AU - Dunn, Adam G TI - New frontiers in health literacy: Using ChatGPT to simplify health information for people in the community AID - 10.1101/2023.07.24.23292591 DP - 2023 Jan 01 TA - medRxiv PG - 2023.07.24.23292591 4099 - http://medrxiv.org/content/early/2023/07/27/2023.07.24.23292591.short 4100 - http://medrxiv.org/content/early/2023/07/27/2023.07.24.23292591.full AB - Background Most health information does not meet the health literacy needs of our communities. Writing health information in plain language is time-consuming but the release of tools like ChatGPT may make it easier to produce reliable plain language health information.Objective To investigate the capacity for ChatGPT to produce plain language versions of health texts.Design Observational study.Subjects Twenty-six health texts from reputable websites.Interventions ChatGPT was prompted to ‘rewrite the text for people with low literacy.’ Researchers captured three revised versions of each original text.Main Measures Objective health literacy assessment, including Simple Measure of Gobbledygook (SMOG), proportion of the text that contains complex language (%), number of instances of passive voice, and subjective ratings of key messages retained (%).Key Results On average, original texts were written at Grade 12.8 (SD=2.2) and revised to Grade 11.0 (SD=1.2), p<0.001. Original texts were on average 22.8% complex (SD=7.5%) compared to 14.4% (SD=5.6%) in revised texts. Original texts had on average 4.7 instances (SD=3.2) of passive text compared to 1.7 (SD=1.2) in revised texts. On average 80% of key messages were retained. The more complex original texts showed more improvements than less complex original texts. For example, when original texts were ≥ Grade 13, revised versions improved by an average 3.3 Grades (SD=2.2), p<0.001. Simpler original texts (< Grade 11) improved by an average 0.5 grades (SD=1.4), p<0.001.Conclusions This study used multiple objective assessments of health literacy to demonstrate that ChatGPT can simplify health information while retaining most key messages. However, the revised texts typically did not meet health literacy targets for grade reading level, and improvements were marginal for texts that were already relatively simple.Competing Interest StatementMembers of the research team (JA, KM) are directors of a health literacy consultancy (Health Literacy Solutions Ltd., Pty). No other declared conflicts of interest.Funding StatementDr Ayre is supported by a National Health and Medical Research Council fellowship (APP 2017278).Author DeclarationsI confirm all relevant ethical guidelines have been followed, and any necessary IRB and/or ethics committee approvals have been obtained.YesI confirm that all necessary patient/participant consent has been obtained and the appropriate institutional forms have been archived, and that any patient/participant/sample identifiers included were not known to anyone (e.g., hospital staff, patients or participants themselves) outside the research group so cannot be used to identify individuals.YesI understand that all clinical trials and any other prospective interventional studies must be registered with an ICMJE-approved registry, such as ClinicalTrials.gov. I confirm that any such study reported in the manuscript has been registered and the trial registration ID is provided (note: if posting a prospective study registered retrospectively, please provide a statement in the trial ID field explaining why the study was not registered in advance).YesI have followed all appropriate research reporting guidelines, such as any relevant EQUATOR Network research reporting checklist(s) and other pertinent material, if applicable.YesAll data produced are available in Appendix