Medical students’ perceptions towards artificial intelligence in education and practice: A multinational, multicenter cross-sectional study

Introduction

The popularity of artificial intelligence (AI) in healthcare has exponentially risen in recent years, attracting the attention of professionals and students alike [1, 2]. With the debut of OpenAI’s Chat Generative Pre-trained Transformer (ChatGPT) in November 2022, a large language model (LLM)-based chatbot with human-like conversational capabilities, this development has gained further momentum [3, 4]. Although not primarily trained with medical data, ChatGPT-3.5 was barely able to pass the United States Medical Licensing Examination (USMLE), while its successor, GPT-4, surpassed it substantially with a zero short accuracy of 84.3% [5]. Specialized medical LLMs, such as Google’s MedPaLM-2, have advanced the field even further, achieving over 85% accuracy on the MedQA dataset of USMLE-like questions and being the first model to pass the MedMCQA dataset, which includes medical exam questions from the All India Institute for Medical Sciences and the National Eligibility cum Entrance Test [6].

Similarly, specialized machine learning models have demonstrated their potential in clinical applications, achieving expert-level results in areas such as breast cancer screening, pathology detection on chest radiographs, or high accuracy in predicting survival and treatment response [7–10].

Given the range and capabilities of potential applications in medicine, the integration of AI into the medical curriculum holds promise, for example, by supporting the teaching of medical students through explaining medical terminology, answering medical questions, creating intelligent learning plans, providing real-time automated feedback, curating data, or simulating patient conversations [11–14]. In addition, teaching AI in medicine may ensure that medical students are familiar with the AI tools and technologies they will inevitably encounter in their professional lives [15, 16].

On the other hand, the introduction of medical AI into clinical routine and medical education poses new challenges, such as ensuring patient and user autonomy, beneficence, non-maleficence, and justice according to the core biomedical ethical principles [11, 17, 18]. Therefore, especially in a field as critical as medicine, where vital measures can be taught and sensible data is handled, it is essential to include education about both the benefits and risks of AI already in the medical curriculum, preparing students for its qualified and responsible use from their career’s onset [19–21].

While previous studies have partially explored the attitudes of healthcare students towards AI, reporting positive views and a desire for its inclusion in the curriculum, they have been primarily limited by their small sample size, restricted scope, or geographic specificity, precluding a comprehensive international comparison of perceptions [22]. To address these limitations, the present study is an international, multicenter effort to conduct an online survey to assess and compare the perspectives of medical, dental, and veterinary students regarding: 1) their technological literacy and understanding of informatics and AI, 2) the current state of AI in their respective curricula and preferences for AI education, and 3) their attitudes toward the role of AI in their respective fields. In addition, the study seeks to explore regional differences in perspectives.

Methods

This multicenter cross-sectional study was conducted in accordance with the STROBE statement and received ethical approval from the Institutional Review Board at Charité – University Medicine Berlin (EA4/213/22), serving as the principal institution, in compliance with the Declaration of Helsinki and its later amendments. To ensure participant anonymity, the necessity for informed consent was waived.

Results

Study cohort

Between the first of April and the first of October 2023, 4,900 responses were recorded, of which 4,345 (88.7%) were collected via the English survey and 555 (11.3%) via the Spanish survey version. Of these, 283 (5.8%) respondents reported degrees other than medicine, dentistry, or veterinary medicine or indicated that they had completed their studies, while 21 (0.4%) did not respond to any multiple-choice item or did not indicate their degree. The final study cohort comprised 4,596 participants from 192 faculty and 48 countries, of whom 4,313 (93.8%) were medical, 205 (4.5%) dentistry, and 78 (1.7%) veterinary medicine students. Of 5,575,307 enrolled students from all degrees at the 183 (95.3%) participating faculties in which the total enrollment number was publicly available, the survey achieved an average response rate of 0.2% (standard deviation: 0.4%). Most respondents studied in Southern/Eastern European (N=1,240, 27.0%) countries, followed by Northern/Western Europe (N=1,110, 24.2%), Asia (N=944, 20.5%), South America (N=555, 12.1%), North America (N=515, 11.2%), Africa (N=125, 2.7%), and Australia (N=104, 2.3%). Please refer to Fig 1 to view the distribution of participating institutions in relation to the number of participants on a world map. A detailed list of survey participants divided by country, faculty, city, degree, number of enrolled students, and response rate is provided in the supplemental material (S1 Table). The median age of the study population was 22 years (IQR: 20-24 years). 56.6% of the participants were female (N=2,600) and 42.4% male (N=1,946), with a median academic year of 3 (IQR: 2-5 years). Full descriptive data, including items on technological literacy and preferences for AI teaching in the medical curriculum, are displayed in Table 1.

• Download figure
• Open in new tab

Fig 1.

The world map displays the geographical distribution of participating institutions (blue dots) in relation to the number of respondents per institution.

Any free field comments of the survey participants are listed in the supplements (S2 Table), with selected comments highlighted in Fig 2.

• Download figure
• Open in new tab

Fig 2. Diverse perspectives from medical students on the integration of artificial intelligence (AI) in healthcare education and practice.

The selected quotes reflect a range of sentiments, from concerns about dehumanization and potential challenges in low-resource settings to viewing AI as a beneficial tool that complements rather than replaces the human touch in medicine.

View this table:

• View inline
• View popup
• Download powerpoint

Table 1. Descriptive data of the study population and results of the questions about tech- savviness and topic preferences for AI teaching in the medical curriculum.

Collective perceptions towards artificial intelligence

Table 2 displays the survey results for Likert scale items. Students generally reported a rather or extremely positive attitude towards the application of AI in medicine (3,091, 67.6%). The highest positive attitude towards AI in the medical profession was recorded for the item “How do you estimate the effect of artificial intelligence (AI) on the efficiency of healthcare processes in the next 10 years?” with 4,042 respondents (88.4%) estimating a moderate or great improvement. Contrarily, 3,171 students (69.4%) rather or completely agreed with the item “The use of artificial intelligence (AI) in medicine will increasingly lead to legal and ethical conflicts.”. Regarding AI education and knowledge, 3,451 students (75.3%) reported no or little knowledge of AI, and 3,474 (76.1%) rather or completely agreed that they would like to have more teaching on AI in medicine as part of their curricula. On the other hand, 3,497 (76.3%) students responded that they did not have any curricular events on AI as part of their degree, as illustrated on the country level in Fig 3. Variability in responses was observed, ranging from 0.279 for the item “How would you rate your general knowledge of artificial intelligence (AI)?” —measured on a four-point Likert scale— to 1.372 for “With my current knowledge, I feel sufficiently prepared to work with artificial intelligence (AI) in my future profession as a physician.”. Notably, the items capturing the trade-offs in medical AI diagnostics revealed that most students preferred AI explainability (N=3,659, 80.2%) over a higher accuracy (N=902, 19.8%) and higher sensitivity (N=2,906, 63.9%) over higher specificity (N=1,118, 24.6%) or equal sensitivity/specificity (N=524, 11.5%), as visualized in Fig 4.

View this table:

• View inline
• View popup

Table 2. Survey results of Likert scale format items on attitudes towards the medical degree, AI in the medical profession, AI education and knowledge, and results of the regional comparisons.

• Download figure
• Open in new tab

Fig 3. Pie charts illustrating student responses at the country level for the item “As part of my studies, there are curricular events on artificial intelligence (AI) in medicine.”.

A more filled, darker red chart indicates a higher proportion of students reporting no AI events, while a less filled, greener chart indicates fewer students reporting the absence of AI events. The missing portion of each chart displays the proportion of students who reported AI events, regardless of the duration. An all-white pie chart indicates that all students reported AI events in the medical curriculum. The absolute number of responses per country is shown above each chart. Analysis of the pie charts from countries with a representative sample of at least 50 respondents reveals that, among 28 nations, only four (Indonesia, Switzerland, Vietnam, and China) exhibited over 50% of students reporting the inclusion of AI events within their medical curriculum. Data from the USA displayed an equal proportion of students reporting the presence or absence of AI events in their curriculum (50% each). The residual 23 countries, encompassing Germany, Portugal, Mexico, Brazil, Poland, UAE, Austria, Italy, India, Argentina, Macedonia, Canada, Slovenia, Ecuador, Australia, Azerbaijan, Japan, Spain, Chile, Moldova, South Africa, Nepal, and Nigeria, had a lower proportion of students reporting the integration of AI in the medical curriculum. UAE, United Arab Emirates; USA, United States of America.

• Download figure
• Open in new tab

Fig 4. Gantt diagrams depicting medical students’ preferences in AI diagnostics.

a) AI explainability (N=3,659, 80.2%) versus higher accuracy (N=902, 19.8%) and b) higher sensitivity (N=2,906, 63.9%) versus higher specificity (N=1,118, 24.6%) or equal sensitivity and specificity (N=524, 11.5%).

Discussion

This multicenter survey of 4,596 medical, dental, and veterinary students from 192 faculties in 48 countries reveals an optimistic outlook of medical students about the future role of AI in healthcare practice. However, this optimism is mixed with concerns, with a majority foreseeing increasing ethical and legal challenges as AI technologies become more integrated into medical practice and feeling inadequately prepared to use AI in their later careers. In terms of AI knowledge and education, our results demonstrate that most students report no or little AI knowledge and favor the inclusion of AI teaching in their curriculum, while over three-quarters did not have any events on AI as part of their studies. The subgroup analyses revealed regional differences in perceptions, although predominantly with small effect sizes.

To date, multiple studies have examined healthcare students’ attitudes towards AI in medicine [22]. Focusing on studies with large sample sizes of at least 500 medical or dental students, predominantly positive attitudes toward the application of AI in medicine were reported [24, 38–42]. For instance, a 2021 study by Bisdas et al., spanning 2,495 medical and 638 dental students in 63 countries, most of whom studying in Libya (N=790), Jordan (N=450), and the United Kingdom (N=331), found that 88.2% (N=2,766) of respondents either strongly or somewhat agree that AI will generally enhance medical practice, while about half (N=1,655, 52.8%) indicated that they would usually or always incorporate AI in their future practice [24]. Similarly, a 2022 survey of 2,981 medical students in Turkey by Civaner et al. demonstrated that 85.8% (N=2,558) of participants acknowledge AI’s role in facilitating physicians’ access to information, while 74.4% (N=2,218) of students affirm that widespread AI usage would make them better physicians and 70.5% (N=2,102) believe that AI application would lead to reduced errors [38]. Another large-scale survey conducted in 2020 among 1,103 dental students in Turkey by Yüzbaşıoğlu et al. demonstrated a significant agreement (N=945, 85.7%) on the prospective major advancements in dentistry and medicine through AI, which was similar to a 2022 study by Swed et al., comprising a cohort of 1,251 medical students and 243 physicians in Syria, with 1,317 respondents (87.4%) either strongly agreeing or agreeing on the crucial role of AI in the medical field [39, 40]. These findings are consistent with those of our study, in which most participants generally expressed positive attitudes toward the use of AI in medicine, the increase in efficiency of healthcare processes through AI, the positive impact of AI on the medical profession, and the availability of AI as a second opinion on medical issues.

Despite these positive attitudes, our study revealed a pronounced deficit in both self- reported AI knowledge and the integration of AI education into the medical curriculum, with about three-quarters of participants reporting little or no AI knowledge, no curricular events on AI, and the desire for AI teaching, respectively. However, the lack of AI knowledge and education among medical and dentistry students is not a novel phenomenon. Depending on the study and item design, self-reported AI knowledge in the literature ranges from 2.8% of 2,981 medical students in Turkey in 2022 who reported feeling informed about the use of AI in medicine to 51.8% of 900 medical students in Jordan in 2021 who indicated having read articles about AI or machine learning in the past two years [24, 38–42]. On the other hand, the reported prevalence of AI training in the medical curriculum ranges, for instance, from 9.2% in a 2020 survey of 484 medical students in the United Kingdom up to 24.4% in a 2022 study among 2,981 medical students in Turkey, although variations in item designs and demographic contexts hinder a comprehensive longitudinal analysis [25, 38, 40, 41, 43]. In our study, less than 18% (N=5) of countries with a sample size of 50 or more participants had a higher or equal proportion of students reporting any duration of AI teaching, pointing to a persistent deficit in medical AI education across various demographic landscapes.

Consequently, the incorporation of AI into medical education on a broader national or international scale is limited, and the adoption of frameworks, certification programs, interdisciplinary collaborations, modules, and formal lectures seems still to be at an early stage [18, 44–46].

In terms of educational preferences, most of the participants in our study indicated their interest in learning practical skills, followed by future perspectives and legal and ethical aspects of medical AI. On the other hand, the majority rather or completely agreed with the item that AI will increasingly lead to legal and ethical conflicts in the medical profession.

Similarly, a 2021 survey by Mehta et al. of 321 medical students at four medical schools in Canada found that 95% of medical students surveyed believe AI would introduce new ethical and social challenges, whereas Civaner et al. reported in 2022 that 93.8% of 2,981 medical students in Turkey consider AI training to address the ethical dilemmas raised by AI a necessary component of their education [38, 47]. This underscores the great potential of AI education to not only improve medical students’ oversight, knowledge, and practical skills in using AI but also to educate about ethical, legal, and societal implications — topics that are also addressed in other AI education frameworks, such as the United Nations Educational, Scientific and Cultural Organization K-12 AI curricula report [48].

In our subgroup analysis of respondents across continents, two items displayed moderate to large effect sizes. First, participants from South America were less likely to agree that the use of medical AI will increase ethical and legal conflicts compared to participants from Northern/Western Europe and Australia. Yet, students’ median responses in these regions were identical. Thus, the level of effect size primarily reflects outliers rather than a uniform regional disparity in opinion. Second, Asian students reported being better prepared to work with AI in their future careers. Although these differences in perceived preparedness could be driven by different national AI policies and educational strategies as well as macroeconomic factors, our study design and varying sample sizes across regions complicate a causal analysis [49, 50]. However, it is noteworthy that three of four countries in which more than 50% of medical students reported receiving AI training were located on the Asian continent, which may have contributed to Asian students indicating a higher preparedness towards applying AI in their future profession.

Finally, we observed a strong preference among medical students for AI systems that are explainable rather than highly accurate. This mirrors the growing emphasis on ’Explainable AI’ in the medical field and underscores the urgent need for developing AI algorithms that transparently disclose their decisions and limitations, especially when applied to the medical domain, to promote trust and acceptance among healthcare students, professionals, and patients [51–54].

This study has limitations. First, the uneven regional distribution of participants potentially biased results in favor of overrepresented regions. Additionally, the online design and language availability in either English or Spanish may have introduced selection bias, precluding students without internet access, as well as students who are not proficient in either language. Another potential source of selection bias could be that respondents with a specific interest in or experience with AI were more likely to participate in the survey.

Furthermore, the calculated response rate appeared to be rather low due to the lack of data on the number of students enrolled in each medical discipline for most participating institutions. Consequently, we derived the response rate using the total student enrollment numbers, which significantly underestimated the true rate of participation among medical students as it assumes that all students within each institute received an invitation to participate. Moreover, the presence of 20 institutions with fewer than 50 student respondents has skewed the response rate further downward.

In conclusion, our study —the currently largest survey of medical students’ perceptions towards AI in healthcare education and practice—reveals a broadly optimistic view of AI’s role in healthcare. It draws on insights from students with diverse geographical, sociodemographic, and cultural backgrounds, underlining the critical need for AI education in medical curricula around the world and identifying a universal challenge and opportunity: to adeptly prepare healthcare students for a future that integrates AI into healthcare practice.

Financial disclosure statement

This research is funded by the European Union (COMFORT (Computational Models FOR patienT stratification in urologic cancers – Creating robust and trustworthy multimodal AI for health care), project number: 101079894, authors involved: FB, MRM, LCA, PDB, AB, RC, GDV, VD, AH, LJ, GK, AL, PS, principal investigator: KKB, sponsors’ website: https://www.comfort-ai.eu). Views and opinions expressed are, however, those of the authors only and do not necessarily reflect those of the European Union. The European Union cannot be held responsible for them. The funding had no role in the study design, data collection and analysis, manuscript preparation, or decision to publish.

Competing interests

KKB reports grants from the Wilhelm Sander Foundation and receives speaker fees from Canon Medical Systems Corporation. KKB is a member of the advisory board of the EU Horizon 2020 LifeChamps project (875329) and the EU IHI project IMAGIO (101112053). MA reports consultant fees from Segmed, Inc. The competing interests had no role in the study design, data collection and analysis, manuscript preparation, or decision to publish. All other authors declare no financial or non-financial competing interests.

ICJME authorship contributions

Conceptualization: Felix Busch, Lena Hoffmann, Daniel Truhn, Marcus R. Makowski, Keno K. Bressem, Lisa C. Adams, Antonios Billis, Renato Cuocolo, Guillermo de Velasco, Luis Gorospe, Alessa Hering, Lili Jiang, Alexander Loeser, Javier Soto-Pérez- Olivares, Petros Sountoulides, Lina Xu; Project administration: Felix Busch, Lena Hoffmann, Keno K. Bressem, Lisa C. Adams; Resources: Felix Busch, Keno K. Bressem, Lisa C. Adams, COMFORT consortium; Software: Felix Busch, Lena Hoffmann, Keno K. Bressem, Lisa C. Adams; Data curation: Felix Busch, Lena Hoffmann, Keno K. Bressem, Lisa C. Adams; Formal analysis: Felix Busch, Lena Hoffmann, Keno K. Bressem, Lisa C. Adams, COMFORT consortium; Funding acquisition: Felix Busch, Marcus R. Makowski, Keno K. Bressem, Lisa C. Adams, Panagiotis D. Bamidis, Antonios Billis, Renato Cuocolo, Guillermo de Velasco, Virginia Dignum, Alessa Hering, Lili Jiang, George Kolostoumpis, Alexander Loeser, Petros Sountoulides; Investigation: Felix Busch, Lena Hoffmann, Keno K. Bressem, Lisa C. Adams; Methodology: Felix Busch, Lena Hoffmann, Daniel Truhn, Keno K. Bressem, Lisa C. Adams; Supervision: Felix Busch, Keno K. Bressem; Validation: Felix Busch, Lena Hoffmann, Daniel Truhn, Esteban Ortiz-Prado, Marcus R. Makowski, Keno K. Bressem, Lisa C. Adams, COMFORT consortium; Visualization: Felix Busch, Esteban Ortiz-Prado, Keno K. Bressem; Writing – original draft preparation: Felix Busch, Keno K. Bressem, Lisa C. Adams; Writing – review & editing: Felix Busch, Lena Hoffmann, Daniel Truhn, Esteban Ortiz-Prado, Marcus R. Makowski, Keno K. Bressem, Lisa C. Adams, COMFORT consortium.

All COMFORT consortia authors equally contributed to the data collection at their institutions, critically revised the final version of the manuscript for intellectual content, gave their final approval of the version to be published, and agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Data availability statement

Upon acceptance of the peer-reviewed article, the collected and analyzed dataset will be publicly available under CC-BY 4.0 license: Busch F, Hoffmann L, Truhn D, Ortiz-Prado E, Makowski MR, Bressem KK, et al. Dataset: Medical students’ perceptions towards artificial intelligence in education and practice: A multinational, multicenter cross-sectional study. Database: figshare [Internet]. doi:10.6084/m9.figshare.24422422 [Reserved]. For peer review, a private anonymized link is provided.

Supporting information captions

S1 Table. Overview of survey participants divided by country, faculty, city, degree, number of enrolled students, and response rate.

S2 Table. Free-field comments by survey participants

S3 Table. Subgroup analysis by gender.

S4 Table. Subgroup analysis by age.

S5 Table. Subgroup analysis by study year.

S6 Table. Subgroup analysis by weekly use of technical devices.

S7 Table. Subgroup analysis by previous coding experience.

S8 Table. Subgroup analysis by AI knowledge.

S9 Table. Subgroup analysis by students who reported curricular events on AI in medicine of any duration versus those who indicated no curricular events

S10 Table. STROBE Statement—Checklist of items that should be included in reports of cross-sectional studies