Understanding transfer of learning from an online self-directed learning and clinical decision support resource (BMJ Best Practice) for health professions education: a capability approach perspective

INTRODUCTION

An essential aspect of all learning interventions is transfer – the extent to which new learning in one situation can be applied to another situation. Estimates from the world of management training indicate that transfer of learning to produce impact on performance can be as low as 30 – 40 percent^[1]. The two most important factors that enable transfer to impact on performance appear to be whether the learning intervention (content and methods) meets the needs of the learner and the influence of the contextual environment within which the new learning is expected to be applied ^[2]. There are similar concerns about the transfer of learning of continuing professional development (CPD) in health professions education ^{[3, 4]}. An area of specific interest to our research team within the field of transfer is the increasing use of technology for CPD, especially where learning is self-directed^[5].

Sen’s capability approach has been increasingly recognized as a useful perspective for understanding and developing policy and practice in various educational contexts^[6].

We have recently developed a model for understanding transfer of learning that is based on Sen’s capability approach^[7]. This model has a self-directed and learner-centered focus that considers how learners actively identify aspects of their daily practice that require further development through an educational experience. These areas for development are considered by the learners as being something that they value as being important (valued outcomes). The concept of value has recently been highlighted as having a more holistic and individual perspective on human development and learning than the use of the term learning needs ^[8].

Importantly from a capability approach perspective, understanding transfer of learning requires identification of the extent to which the learners’ valued outcomes can be achieved from both the educational experience and also the extent to which the learning through the experience can be applied to practice. In addition, it is important to understand the factors that enable and constrain the learner in achieving their valued outcomes.

BMJ Best Practice (http://bestpractice.bmj.com) is a unique self-directed online learning and clinical decision support resource to support diagnosis and treatment decisions, including shared decision-making with patients and their carers. Research evidence, guidelines and expert opinion are presented in a step-by-step approach. The resources are reviewed by experts to ensure relevance and quality of content. Transfer of the knowledge within this resource into actual clinical practice is essential to the implementation of evidence-based medicine.

We are not aware of previous research that has had a specific focus on understanding the complexity of transfer of learning in this area of online self-directed learning in health professions education, or the use of a capability approach perspective. The purpose of this research is to understand transfer of learning of an online self-directed learning and clinical decision support resource for health professionals informed by Sen’s capability approach.

METHODS

RESULTS

200 physicians at Air Force Medical Center were invited to take part in this study. 184 physicians including 20 interns, 78 residents, 64 attending doctors and 22 vice-directors and directors completed the online questionnaire. All the physicians had access to BMJ Best Practice.

Evidence-based diagnosis

84.2% (155/184) of physicians had a valued outcome of being able to make an evidence-based diagnosis (Figure 1). 84.8% (156/184) of physicians had used BMJ Best Practice to help them make an evidence-based diagnosis. 71.1% of physicians “agreed” and 15.2% “strongly agreed” that the information provided by BMJ Best Practice had enabled them to achieve their valued outcome by reinforcing their existing knowledge of a topic. Also, (a) 66.3% of physicians “agreed” and 15.2% “strongly agreed” that the information provided by BMJ Best Practice provided them with new knowledge of a topic, (b) 71.2% of physicians “agreed” and 14.7% “strongly agreed” that the information provided by BMJ Best Practice on the topics was useful, and (c) 70.7% of physicians “agreed” and 14.7% “strongly agreed” that they could apply the information obtained from BMJ Best Practice to make an evidence-based diagnosis in clinical practice (Table 1).

View this table:

• View inline
• View popup
• Download powerpoint

Table 1 Extent of transfer of learning from BMJ Best Practice

(created by Da Zhang and permitted to reuse by all authors)

• Download figure
• Open in new tab

Figure 1

The extent to which users valued being able to: make an evidence-based diagnosis, start evidence-based treatment, and share decision-making. (created by Da Zhang and permitted to reuse by all authors)

16.3% (30/184) physicians encountered barriers that hindered them from using the information from BMJ Best Practice in making an evidence-based diagnosis. The most common barriers were technological barriers (such as slow speed), lack of local guidelines, and inability to find sufficiently detailed information about specific diseases.

There was no association between usage of BMJ Best Practice and the extent to which users value being able to make an evidence-based diagnosis (p>0.05). Usage of BMJ Best Practice was associated with users feeling that they have fewer barriers to making an evidenced based diagnosis (p<0.05). The more that users value being able to make an evidence-based diagnosis the more that they value BMJ Best Practice (p<0.05) (Table 2).

View this table:

• View inline
• View popup
• Download powerpoint

Table 2 Factors in BMJ Best Practice that enable and constrain a learner to obtain and apply knowledge in clinical practice

(created by Da Zhang and permitted to reuse by all authors)

DISCUSSION

There has been increasing interest in transforming medical education to ensure that it is appropriate to meet the healthcare needs of the twenty-first century^{[10, 11]}. We consider that Sen’s capability approach can provide an innovative and useful model to further understand health professions education since it highlights the importance of the learner perspective of valued outcomes, including the difficulties associated with the effective transfer of learning in CPD.

Diagnosis, treatment and sharing decision-making with patients and their carers are key processes in clinical practice. In this study, about 80 percent of physicians agreed that BMJ Best Practice enabled a learner to achieve their valued outcomes that were identified in daily practice and to apply their new knowledge to inform their practice. The extent to which physicians valued evidence-based medicine and their experience in using BMJ Best Practice were factors that enabled them to achieve their valued outcomes and apply their knowledge. Physicians who had not used BMJ Best Practice or did not value evidence-based medicine encountered more barriers in the contextual environment of clinical practice.

Our study design and data have several strengths. This is a real-life study based on the experiences of physicians who are directly providing care to patients. The study also has strong theoretical foundations – being based as it is on Sen’s capability approach. Lastly it covers the vital subject of the application of medical knowledge in actual practice – in the important domains of diagnosis, management, and shared decision making.

Our study design and data had a few limitations. The research design is a cross-sectional survey. The study did not investigate whether physicians’ reflections on their valued outcomes and achievements might have changed over time. This study was carried out in a single centre, which is a tertiary care medical institution containing around 1500 inpatient beds and about 400 internal medicine physicians. Lastly there were some technical problems in the use of BMJ Best Practice in this centre – which might have acted as an additional barrier to achieving valued outcomes and the transfer of knowledge.

In this research, the majority of physicians felt that BMJ Best Practice helped learners to achieve valued outcomes that were identified in daily practice and to apply their new knowledge in practice. Sen’s capability approach offers an innovative and useful model to further understand health professions education since it highlights the importance of the learner perspective of valued outcomes, including the difficulties associated with the effective transfer of learning in CPD.

Funding

This project was supported by the Military Logistics Special Project for Health Care (18BJZ07)

Competing interests

KW works for BMJ which produces the resource BMJ Best Practice.

Availability of data and materials

The datasets collected in this study are available from the corresponding author on reasonable request.

Ethics approval and consent to participate

The study was approved by the Air Force Medical Center for Research Data (No. 2020-143-PJ01).

Each author’s contribution

Da Zhang led the study; made substantial contributions to the acquisition, analysis, or interpretation of data for the work; wrote the first draft and revised it critically for important intellectual content; approved the final version; and agrees to be accountable for all aspects of the work.

Li Xiao helped conduct the study; made substantial contributions to the acquisition, analysis, or interpretation of data for the work; revised it critically for important intellectual content; approved the final version; and agrees to be accountable for all aspects of the work.

Jingqi Duan helped conduct the study; made substantial contributions to the acquisition, analysis, or interpretation of data for the work; revised it critically for important intellectual content; approved the final version; and agrees to be accountable for all aspects of the work.

Xinxin Chang helped conduct the study; made substantial contributions to the acquisition, analysis, or interpretation of data for the work; revised it critically for important intellectual content; approved the final version; and agrees to be accountable for all aspects of the work.

Kieran Walsh made substantial contributions to the conception or design of the work; revised it critically for important intellectual content; approved the final version; and agrees to be accountable for all aspects of the work.

John Sandars made substantial contributions to the conception or design of the work; revised it critically for important intellectual content; approved the final version; and agrees to be accountable for all aspects of the work.

Jeremy Brown made substantial contributions to the conception or design of the work; revised it critically for important intellectual content; approved the final version; and agrees to be accountable for all aspects of the work.

Xiaorong Dang made substantial contributions to the acquisition, analysis, or interpretation of data for the work; revised it critically for important intellectual content; approved the final version; and agrees to be accountable for all aspects of the work. Wei Shen made substantial contributions to the acquisition, analysis, or interpretation of data for the work; revised it critically for important intellectual content; approved the final version; and agrees to be accountable for all aspects of the work.

Junjie Du made substantial contributions to the acquisition, analysis, or interpretation of data for the work; revised it critically for important intellectual content; approved the final version; and agrees to be accountable for all aspects of the work.

Yanjie Cao contributed to the design; made substantial contributions to the acquisition, analysis, or interpretation of data for the work; revised it critically for important intellectual content; approved the final version; and agrees to be accountable for all aspects of the work.

Open access

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.