Protocol for a mixed methods process evaluation of the Smoking Treatment Optimisation in Pharmacies (STOP) trial ================================================================================================================ * Sandra Jumbe * Vichithranie Madurasinghe * Colin Houlihan * Samantha L Jumbe * Wai-Yee James * Stephanie JC Taylor * Robert Walton ## Abstract **Introduction** Assessing the fidelity of complex behavioural interventions and examining the contextual reasons why such interventions succeed, or fail are important activities but challenging and rarely reported. The Smoking Treatment Optimisation in Pharmacies (STOP) trial is a cluster randomised trial evaluating the effectiveness of a complex intervention to optimise the National Health Service (NHS) Stop Smoking Service delivered in community pharmacies. This complex intervention comprises a training package for pharmacy staff involving motivational interviewing and communication skills aimed at increasing smoking cessation knowledge and proactive client engagement. We report on a process evaluation which was planned alongside the trial to offer findings that will assist in the interpretation of the main trial results and help inform potential implementation in community pharmacy settings on a wider scale. **Methods and analysis** Quantitative data on recruitment and retention process of pharmacies, pharmacy staff and service users has been collected during the trial along with data on dose and fidelity of the intervention delivery from participating intervention arm pharmacies to identify potential implementation issues. Simulated client data on behaviour change skills and display of intervention materials from both control and intervention pharmacies is being assessed. These data will be combined with qualitative data; including adviser-smoker consultation recordings that provide a snapshot of behaviour skills delivery by stop smoking advisers and semi-structured interviews with pharmacy staff and services users from the intervention arm. **Discussion** Published protocols for process evaluations of complex health interventions are still rare despite increasing funding for this work to facilitate understanding of trial outcomes from an implementation perspective. This mixed methods protocol will contribute to the developing literature around the conduct of process evaluation and the value they add to health services research. ***Trial registration number*** [ISRCTN16351033](http://medrxiv.org/external-ref?link_type=ISRCTN&access_num=ISRCTN16351033). **Strengths and limitations of this study** * A planned mixed methods process evaluation that draws together data from different sources to help explain the trial results and establish the feasibility of scaling this complex intervention up in community pharmacy settings. * A strength is the use of a previously tested mystery shopping method to assess fidelity of skills performance at the pharmacy counter * The process evaluation relies on willing pharmacy staff and service users involved in the trial to collect some of the data, which may introduce bias. * This paper also provides a detailed example of how to use the MRC framework for process evaluation of complex interventions to design an extensive process evaluation within trial settings. Key words * community pharmacy * smoking cessation * process evaluation ## Introduction The Smoking Treatment Optimisation in Pharmacies (STOP) trial is a cluster randomised trial to evaluate the effectiveness of a complex intervention to optimise the NHS Stop Smoking Service delivered in community pharmacies [1]. The trial involves 60 pharmacies across London, Coventry and Cwm Taf in Wales. Thirty of these pharmacies are randomised to the intervention group, where consenting pharmacy staff are invited to a half-day session which includes motivational interviewing and communication skills training to improve smoker engagement and equip them as facilitators for health behaviour change [2, 3]. Intervention pharmacies are also given badges, a poster and a desk calendar to use in their pharmacy environment as prompts for more proactive smoking cessation dialogue with potential clients. The control pharmacies continue to deliver their service as normal over the trial duration. The primary outcome is rate of smoker recruitment into the NHS stop smoking service [1]. The trial, along with this process evaluation, was funded the NIHR Programme Grant for Applied Research [RP-PG-0609-10181]. In this paper we describe the protocol for a process evaluation which aims to evaluate how the intervention is implemented, the mechanisms by which it works and how these may be affected by the context in which the intervention is operating [4]. Process evaluations can be used to assess the fidelity and quality of implementation of an intervention, clarify causal mechanisms and identify contextual factors associated with variation in outcomes [4]. They are recommended to contextualise the results of randomised controlled trials to answer key questions about why an intervention has failed or succeeded and how it was implemented [5]. Process evaluations are particularly relevant to complex, multi-faceted interventions such as STOP that involve multiple targets (for example, pharmacy staff and patients/ service users), have various active components and where their complexity makes it difficult to measure their effects [2, 6]. In our previous STOP qualitative and pilot studies, stop smoking advisers felt they lacked the interpersonal skills necessary to engage well with smokers and help them to quit [7]. Advisers suggested regular skills training for all pharmacy staff, including staff not formally trained as stop smoking advisers, to improve uptake to their stop smoking service [2-3, 7-8]. Despite expanding the intervention training to include staff members that were not directly involved in delivering the pharmacy smoking cessation service in the main trial, we noticed a high level of staff turnover in a majority of participating trial pharmacies which may affect the reach/implementation of the intervention. Specifically, even if high levels of attendance to the intervention training are achieved, the effectiveness of the behavioural aspect of the intervention may be constrained/ diluted over time if many intervention trained staff leave the pharmacy for whatever reason. Variations in organisational structures of pharmacies and commissioning systems also caused complications in the process of the trial. We noted that the routes to receiving payment (e.g. smoker registration vs 4 week quit outcome) and payments offered (total amount received per smoker plus bonus for specific groups) for pharmacies providing the NHS Stop Smoking Service differed in London, Coventry and Wales depending on each service commissioner’s policy [9]. These differences also extend into data collection where the type of routine data that is collected in each geographical location varied because of the different computer systems used. London and Coventry for example both used electronic portals to track and upload claims and patient data, but did not collect the exact same data fields. On the other extreme Wales relied more heavily on paper records which the STOP team used to collect and manually transcribe onto an electronic spreadsheet. The above challenges highlighted a need to conduct a pragmatic process evaluation that allows us to understand better the contextual factors and causal mechanisms in community pharmacy settings that could affect implementation of the STOP intervention during the trial and subsequent trial outcomes. The process evaluation will support quantitative data collected from the 60 participating pharmacies across three regions – London, Coventry and Cwm Taf. The evaluation will enable us to place the pharmacies in context, assess fidelity of the intervention, quantify the intervention dose delivered, the intervention dose received and the extent to which the target population participated in the intervention (including recruitment rates for pharmacies, staff and smokers). The design of the process evaluation is underpinned by the Medical Research Council guidance [4] and the theoretical framework used to develop the STOP intervention [2, 3]. Specifically, development of this protocol is based on the key components of process evaluation proposed by Moore and colleagues [4] which are: context, reach, dose delivered, dose received, fidelity, implementation and recruitment [10]. From a theoretical perspective, outputs from the activities outlined in the final STOP logic model (Figure 1) alongside the STOP programme theories will be used to identify the causal processes through which change comes about as a result of a programme’s strategies and action [11]. In addition, we decided that it was important to include the views and opinions of participants, including pharmacy staff who attended the STOP intervention training and consenting STOP Trial service users, who used the stop smoking service at participating pharmacies. Their experiences, their attitudes to the intervention and how they think the intervention could be improved will play an important part in interpreting the outcome data and developing subsequent implementation. This process evaluation protocol establishes how we will evaluate the fidelity of implementation of the STOP intervention, clarify causal mechanisms and identify factors associated with variation in the STOP Trial outcomes [1]. ![Figure 1:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/03/21/2020.03.17.20037499/F1.medium.gif) [Figure 1:](http://medrxiv.org/content/early/2020/03/21/2020.03.17.20037499/F1) Figure 1: STOP Trial Logic model The specific process evaluation aims for the STOP Trial are; 1. To provide findings that will assist in the interpretation of the clinical trial results, particularly understanding how and in what circumstances the STOP Intervention improves smoker uptake (or not) 2. To inform potential implementation of the STOP training intervention in community pharmacy settings on a wider scale ## Methods ### Design This process evaluation will use quantitative and qualitative data. The use of mixed methods research is increasingly common in health services research and evaluation [12]. Specific to process evaluations, a mixed method approach can help researchers to explore apparent discrepancies between findings [12-13]. There are practicalities to this methodological approach that require careful forward planning including how each method will complement the other, and which data collection methods to use to achieve the project’s goals [13]. Quantitative data (e.g. intervention dosage, pharmacy staff client engagement scores from simulated clients; facilitator training adherence scores) will be complemented by qualitative data from pharmacy staff and service user interviews, intervention training attendees’ feedback, plus field notes from pharmacy booster visits and simulated client visits to illuminate why the intervention was effective or not [3, 13]. ### Process evaluation objectives * ➢ Collect quantitative data on number of pharmacies recruited, and pharmacy staff consented to the STOP Trial, records of pharmacy staff trained in informed consent in research and trial related processes during site initiation visits. Include reported numbers of staff employed by participating pharmacies to assess reach * ➢ Collect quantitative data on the proportion of pharmacy staff invited and attending training with reasons for non-attendance from the intervention arm. Data on training venues will also be collected * ➢ Collate and analyse quantitative data from simulated clients regarding display of intervention materials and client engagement by pharmacy staff at the counter. This data will also include field notes to be analysed qualitatively * ➢ Analyse audio recordings of STOP training sessions to assess fidelity of intervention delivery by training facilitators * ➢ Assess acceptability of the STOP intervention by interviewing pharmacy staff about their views of the STOP training, and perceived impact of the intervention on their NHS stop smoking service. These interviews will be transcribed, then later analysed qualitatively alongside pharmacy staff post training feedback data collected after each training session and 5 months later. * ➢ Collate data on service user satisfaction of the NHS SSS from the NCSCT questionnaire * ➢ Carry out interviews with consenting service users on their views of the stop smoking service from participating pharmacies * ➢ Collate data on number of booster visits conducted in intervention pharmacies, and analyse field notes, describing contextual factors reported by pharmacy staff that hindered or facilitated implementation of the STOP intervention in their environment * ➢ Interpret key outputs and results to provide informative descriptive reports and statistical analyses * ➢ Disseminate comprehensive process evaluation outcomes report through peer reviewed articles, and presentations at academic conferences and stakeholder events Figure 2 provides a summary of key process evaluation components in accordance with MRC guidance, associated theoretical assumptions (see Figure 1), and how these will be measured within data collected. ![Figure 2:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/03/21/2020.03.17.20037499/F2.medium.gif) [Figure 2:](http://medrxiv.org/content/early/2020/03/21/2020.03.17.20037499/F2) Figure 2: Key MRC process evaluation components, associated STOP process evaluation theoretical assumptions and data a from MRC guidance (Moore et al, 2015) b based on STOP Logic model c outlined in the STOP Trial protocol (Sohanpal et al, 2019) ### Data Collection Methods Table 1 outlines the methods used to collect specific STOP Trial data for this process evaluation. View this table: [Table 1:](http://medrxiv.org/content/early/2020/03/21/2020.03.17.20037499/T1) Table 1: Summary of STOP Trial process data collection Fidelity assessment will be conducted in three ways: 1. Audio-recordings of STOP pharmacy staff training sessions 2. Assessment of prompts and client engagement with staff at the pharmacy counter using simulated clients 3. Audio-recordings of advisor-smoker consultations Audio-recordings of STOP pharmacy staff training sessions Audio-recordings of training sessions will only be obtained if the group provides verbal consent to be recorded. Specifically, before starting each training session, the training facilitators (or study team) will ask attendees being trained if they are happy for their session to be recorded. Facilitators will explain the reason for this i.e. to assess adherence to intervention content being delivered according to the STOP intervention training manual. Content in this training manual has been previously coded into component behaviour change techniques (BCTs) by two health psychologists from the study team (see table 2) with previous training and experience in coding using the BCT taxonomy [2, 3]. View this table: [Table 2:](http://medrxiv.org/content/early/2020/03/21/2020.03.17.20037499/T2) Table 2: STOP Trial Intervention Training Content Two qualitative researchers (independent from the study team) will independently listen to each recording and rate (coded as 0 (NO) or 1 (YES) whether the facilitator applied all specified BCTs outlined in the manual,[14] and learnt during the training in practice. They will then subsequently meet to review their ratings and resolve any discrepancies along with the process evaluation team/ study health psychologist. If the researchers rate the BCTs within a section of the training the same, agreement will be registered. Where one researcher verifies a BCT and the other does not, disagreement will be registered. ### Assessing client engagement in pharmacies using simulated clients Actors will visit each pharmacy and present at the counter with different smoking related scenarios which have been designed to present an opportunity for the pharmacy staff to engage the potential client with the smoking cessation service. Details on the actors’ training and the specific scenarios used for this process and how the actors rate client engagement are outlined in a previously published paper [3]. In brief, after completing their smoking related scenario with a member of staff at the pharmacy counter, the simulated client will rate the interaction, providing a subjective assessment of skills delivery. They will also make a note of any visible NHS stop smoking service or STOP Trial promotional materials e.g. STOP badges, desktop calendars. Each actor will complete this assessment using a checklist after each pharmacy visit which has the option of adding brief notes [3]. All actors will receive training in this mystery shopper approach by the study team. The data collected will be analysed using descriptive statistics. ### Audio-recording of adviser-smoker consultations Over the trial duration, the study team will ask stop smoking advisers from participating pharmacies in the intervention arm to record one or two of their consultations with consenting smokers who have joined their stop smoking service. These recordings will be used to assess enactment and retention of behaviour change skills from advisers. Advisers who agree to do this will be given an encrypted audio recorder to use for this purpose. The data collected will undergo Roter interaction analysis which is a method widely used to code medical interactions worldwide [15]. The Roter interaction analysis system (RIAS) emerged in the late 90s when research studies looking at doctor–patient communication grew markedly. Effective communication between providers and patients is very important to the provision of safe and high-quality healthcare. Failures in the communication process can have significant implications for patients’ experience, negatively affecting patient satisfaction, adherence, resource utilisation, and health outcomes [16]. RIAS is based on social exchange theories and linguistic-based techniques of communication analysis, with a coding framework based on the ‘‘three function model” of medical interviewing [15]. The coding is performed directly from the audio recording without transcription, and data are directly entered into RIAS software. The coders assign each word (or complete thought) spoken by the healthcare provider or patient to mutually exclusive and exhaustive categories. These categories can then be combined to reflect four larger functional groupings, namely data gathering, patient education and counselling, building a relationship, and activating and partnering. For example, in the context of STOP, if coders heard open ended questions in a consultation recording, they would categorise this to ‘task focused communication’, where the adviser is ‘gathering data’ to understand the smoker’s problems [16]. Overall, RIAS offers a practical, functional, flexible, and methodologically rigorous approach for reliably analysing patient and provider interactions in a range of contexts [15]. ### Pharmacy staff and service user interviews To assess acceptability of the STOP intervention, we will conduct interviews with a purposive sample of pharmacy staff from participating pharmacies in the intervention arm only and service users who provided their consent during the STOP trial to be subsequently approached at 6 months about their smoking status [1]. We will put emphasis on capturing regional variation so we will purposefully try to get interview participants from all three recruitment sites in case there are differences that impact on service delivery or service user experience [17]. The STOP Trial recruitment targets are 165 staff and 1200 service users [1]. From this potential participant pool, we feel interviewing samples of approximately 10 staff and 25 service users will be sufficient to reach data saturation, considering the homogeneity of the population in each group [18]. Consenting staff will be approached 5 months after training completion to ask if they are willing to participate in a recorded interview. Face-to-face and telephone interviews will be conducted depending on respondents’ location. Service users will be approached during their 6 month follow up, where long term smoking abstinence is assessed. After completing their 6 month follow up questionnaire, the STOP researcher will ask the service user if they would be willing to participate in a recorded interview to give more detail about their experience of using their local pharmacy’s NHS stop smoking service. These interviews will also be conducted by telephone or face to face, whatever is more convenient for the service user. All the interviews will be conducted by members of the STOP team who were not involved in delivery of the STOP intervention training. The interview questions will be guided by semi-structured topic guides (see table 3). View this table: [Table 3:](http://medrxiv.org/content/early/2020/03/21/2020.03.17.20037499/T3) Table 3: Summary of topic guides for pharmacy staff and service user interviews ### Booster visit Field notes After a pharmacy receives STOP intervention training and has been visited by a simulated client (approximately 3 months), the STOP training facilitator will visit the pharmacy to conduct a booster visit. During this visit, the facilitator will meet with the lead stop smoking adviser and/or STOP local champion for the pharmacy (self nominated during the STOP Training) to discuss the pharmacy’s progress implementing the STOP intervention. This will include gauging presence and usefulness of the STOP promotional materials. The facilitator will also give the pharmacy feedback on their simulated client results. Field notes of interactions from these visits will be captured using a STOP Booster Visit Checklist (Figure 3). These field notes will be later analysed to give insights on the extent to which the target population (pharmacy staff) are participating in the intervention. ![Figure 3:](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2020/03/21/2020.03.17.20037499/F3.medium.gif) [Figure 3:](http://medrxiv.org/content/early/2020/03/21/2020.03.17.20037499/F3) Figure 3: STOP booster visit checklist ### Qualitative Analysis Interviews and adviser-smoker consultations will be digitally recorded, subject to permission of each participant, and transcribed verbatim by a Queen Mary approved transcription service in line with data management standard operating procedures. The recordings will be stored in a secure virtual environment maintained by our host Centre and will be accessed by authorised study researchers for analysis. Thematic analysis facilitated by the software package NVivo [19] will be used for analysis of the qualitative data. Researcher bias will be minimised through regular crosschecking of data and findings by the members of research team. Anonymised quotations will be used where possible as exemplars of key points in the writing up of these data. Themes emerging from qualitative data will also be discussed and refined by the Process Evaluation Team. To ensure reliability and validity, each team member will code a sample (1-2 transcripts) that have already been coded by another member of the team for subsequent reviewing and reflection as a group on emerging themes. ### Quantitative Analysis Quantitative data will be analysed using the statistical package PASW Statistics [20]. Descriptive statistics will be generated and comparisons made between intervention and control pharmacies from the mystery shopper data. Regional comparisons will also be examined. For the training audio-recording data, the first author will summarise total ratings of the pre-classified BCTs. Observed adherence will be expressed as the number of BCTs applied by the facilitator, divided by the number of BCTs specified in the training manual. The data analysis for the process evaluation data will be an ongoing process and will occur in parallel but independently of the main study, before the two data sets are combined [5]. To ensure good quality data, the process evaluation team will share and review extracted data results at regular intervals. ### Ethics and dissemination The STOP trial and its process evaluation has ethical approval from the UK National Research Ethics Service (NHS REC reference 17/SC/0067) given on 3 April 2017. Findings will be disseminated via peer reviewed journals and conferences. Considering the limited research and training culture observed in the community pharmacy setting, we also plan to deliver workshops or seminars on methodology of the process evaluation to relevant stakeholders and service commissioning. Brief reports will be shared with participants, mystery shoppers and funder. ## Discussion This paper describes the design and methodology for the planned process evaluation of the STOP trial using a mixed methods approach. The process evaluation protocol and results will contribute to the continuously developing literature around the conduct of process evaluation for complex health interventions and the value they add to health services research and delivery. The process evaluation protocol follows recommendations intended to help standardise the design and reporting of process evaluation. This will hopefully enable future trials to conduct similar evaluations of their work, resulting in synthesis of stronger evidence base regarding effective interventions. ### Trial status The current approved STOP Trial protocol is version 4.0 dated 21.03.17. Recruitment to the trial began on 3rd April 2017. Data collection for the process evaluation is still ongoing; to be completed in April 2020. ## Data Availability The datasets used and/or analysed during the current study are available following completion of the project from the study guarantor, Professor Robert Walton, r.walton@qmul.ac.uk on reasonable request. ## Declarations ### Ethics approval and consent to participate The STOP trial and its process evaluation received ethical approval from South Central - Hampshire A NHS Research Ethics Committee (NHS REC reference 17/SC/0067) on 3rd April 2017 ### Consent for publication “Not applicable” ### Availability of data and materials The datasets used and/or analysed during the current study are available following completion of the project from the study guarantor, Professor Robert Walton, r.walton{at}qmul.ac.uk on reasonable request. ### Competing interests “The authors declare that they have no competing interests” ### Funding This study is funded by the National Institute for Health Research (NIHR) Programme Grants for Applied Research (RP-PG-0609-10181) of which RW is the chief investigator and ST is a co-investigator. The views expressed are those of the author(s) and not necessarily those of the NIHR or the Department of Health and Social Care. ### Authors’ contributions SJ led on the process evaluation protocol design and acquisition of data with substantial support from CH, SLJ and WYJ. SJ drafted the manuscript and RW, ST and VM substantially contributed to revised versions. All authors have reviewed and commented on the final version. ## Acknowledgements The authors want to acknowledge all the actors in London, Coventry and Cwm Taf who provided invaluable data from their pharmacy mystery shopper visits. They also thank all the pharmacy staff and service user participants who were willing to be interviewed and audio-recorded. ## Footnotes * Email: s.jumbe{at}qmul.ac.uk, Email: v.madurasinghe{at}qmul.ac.uk, Email: c.houlihan{at}qmul.ac.uk, Email: sam.jumbe{at}nhs.net, Email: w.y.james{at}qmul.ac.uk, Email: s.j.c.taylor{at}qmul.ac.uk, Email: r.walton{at}qmul.ac.uk ## List of abbreviations STOP : Smoking Treatment Optimisation in Pharmacies NHS : National Health Service BCTs : Behaviour Change Techniques CPD : Continuing Professional Development RPS : Royal Pharmaceutical Society RIAS : Roter Interaction Analysis System REC : Research Ethics Committee * Received March 17, 2020. * Revision received March 17, 2020. * Accepted March 20, 2020. * © 2020, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution-NonCommercial-NoDerivs 4.0 International), CC BY-NC-ND 4.0, as described at [http://creativecommons.org/licenses/by-nc-nd/4.0/](http://creativecommons.org/licenses/by-nc-nd/4.0/) ## References 1. 1.Sohanpal R, Jumbe S, James WY, Steed L, Yau T, Rivas C, Madurasinghe V, Houlihan C, Berdunisov V, Taylor M, Taylor SJ. Evaluating the effectiveness and cost-effectiveness of the Smoking Treatment Optimisation in Pharmacies (STOP) intervention: protocol for a cluster randomised controlled trial. Trials. 2019 Dec;20(1):337. 2. 2.Steed L, Sohanpal R, James WY, Rivas C, Jumbe S, Chater A, Todd A, Edwards E, Macneil V, Macfarlane F, Greenhalgh T. Equipping community pharmacy workers as agents for health behaviour change: developing and testing a theory-based smoking cessation intervention. BMJ open. 2017 Aug 1;7(8):e015637. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYm1qb3BlbiI7czo1OiJyZXNpZCI7czoxMToiNy84L2UwMTU2MzciO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMC8wMy8yMS8yMDIwLjAzLjE3LjIwMDM3NDk5LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 3. 3.Jumbe S, James WY, Madurasinghe V, Steed L, Sohanpal R, Yau TK, Taylor S, Eldridge S, Griffiths C, Walton R. Evaluating NHS Stop Smoking Service engagement in community pharmacies using simulated smokers: fidelity assessment of a theory-based intervention. BMJ open. 2019 May 1;9(5):e026841. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYm1qb3BlbiI7czo1OiJyZXNpZCI7czoxMToiOS81L2UwMjY4NDEiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMC8wMy8yMS8yMDIwLjAzLjE3LjIwMDM3NDk5LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 4. 4.Moore GF, Audrey S, Barker M, Bond L, Bonell C, Hardeman W, Moore L, O’Cathain A, Tinati T, Wight D, Baird J. Process evaluation of complex interventions: Medical Research Council guidance. bmj. 2015 Mar 19;350:h1258. 5. 5.Oakley A, Strange V, Bonell C, Allen E, Stephenson J: Process evaluation in randomised controlled trials of complex interventions. BMJ. 2006, 332: 413–416. doi:10.1136/bmj.332.7538.413. [FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiRlVMTCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjEyOiIzMzIvNzUzOC80MTMiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMC8wMy8yMS8yMDIwLjAzLjE3LjIwMDM3NDk5LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 6. 6.Johnson MJ, May CR. Promoting professional behaviour change in healthcare: what interventions work, and why? A theory-led overview of systematic reviews. BMJ open. 2015 Sep 1;5(9):e008592. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYm1qb3BlbiI7czo1OiJyZXNpZCI7czoxMToiNS85L2UwMDg1OTIiO3M6NDoiYXRvbSI7czo1MDoiL21lZHJ4aXYvZWFybHkvMjAyMC8wMy8yMS8yMDIwLjAzLjE3LjIwMDM3NDk5LmF0b20iO31zOjg6ImZyYWdtZW50IjtzOjA6IiI7fQ==) 7. 7.Sohanpal R, Rivas C, Steed L, MacNeill V, Kuan V, Edwards E, Griffiths C, Eldridge S, Taylor S, Walton R. Understanding recruitment and retention in the NHS community pharmacy stop smoking service: perceptions of smoking cessation advisers. BMJ open. 2016 Jul 1;6(7):e010921. 8. 8.Jee SD, Schafheutle EI, Noyce PR. Using longitudinal mixed methods to study the development of professional behaviours during pharmacy work-based training. Health & social care in the community. 2017 May;25(3):975–86. 9. 9.Houle SK, Carter CA, Tsuyuki RT, Grindrod KA. Remunerated patient care services and injections by pharmacists: An international update. Journal of the American Pharmacists Association. 2019 Jan 1;59(1):89–107. 10. 10.Steckler A, Linnan L, (Eds.): Process Evaluation for Public Health Interventions and Research. 2002, San Francisco: Jossey-Bass 11. 11.Weiss CH: How can theory-based evaluation make greater headway?. Evaluation Review. 1997, 21: 501–524. doi:10.1177/0193841X9702100405. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/0193841X9702100405&link_type=DOI) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1997XQ07300005&link_type=ISI) 12. 12.Bryman A: Integrating quantitative and qualitative research: how is it done?. Qualitative Research. 2006, 6: 97–113. doi:10.1177/1468794106058877. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1177/1468794106058877&link_type=DOI) 13. 13.Ellard DR, Taylor SJ, Parsons S, Thorogood M. The OPERA trial: a protocol for the process evaluation of a randomised trial of an exercise intervention for older people in residential and nursing accopmmodation. Trials. 2011 Dec;12(1):28. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1186/1745-6215-12-28&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=21288341&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F03%2F21%2F2020.03.17.20037499.atom) 14. 14.Hardeman W, Michie S, Fanshawe T, Prevost AT, Mcloughlin K, Kinmonth AL. Fidelity of delivery of a physical activity intervention: predictors and consequences. Psychology and Health. 2008 Jan 1;23(1):11–24. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1080/08870440701615948&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=25159904&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F03%2F21%2F2020.03.17.20037499.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000252353300003&link_type=ISI) 15. 15.Roter D, Larson S. The Roter interaction analysis system (RIAS): utility and flexibility for analysis of medical interactions. Patient education and counseling. 2002 Apr 1;46(4):243–51 [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1016/S0738-3991(02)00012-5&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=11932123&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F03%2F21%2F2020.03.17.20037499.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=000177118700003&link_type=ISI) 16. 16.McCarthy DM, Buckley BA, Engel KG, Forth VE, Adams JG, Cameron KA. Understanding patient–provider conversations: what are we talking about?. Academic Emergency Medicine. 2013 May;20(5):441–8. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/acem.12138&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23672357&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2020%2F03%2F21%2F2020.03.17.20037499.atom) 17. 17.Palinkas LA, Horwitz SM, Green CA, Wisdom JP, Duan N, Hoagwood K. Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and policy in mental health and mental health services research. 2015 Sep 1;42(5):533–44. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1007/s10488-013-0528-y&link_type=DOI) 18. 18.Boddy CR. Sample size for qualitative research. Qualitative Market Research: An International Journal. 2016 Sep 12;19(4):426–32. 19. 19.Bazeley P, Jackson K, editors. Qualitative data analysis with NVivo. Sage Publications Limited; 2013 Apr 25. 20. 20.Cronk BC. How to use SPSS®: A step-by-step guide to analysis and interpretation. Routledge; 2017 Nov 10.