International medical graduates’ experiences of clinical competency assessment in postgraduate and licensing examinations: a scoping review protocol ====================================================================================================================================================== * Helen Hynes * Anél Wiese * Nora McCarthy * Catherine Sweeney * Tony Foley * Deirdre Bennett ## Abstract An international medical graduate (IMG) is a doctor who has received their basic medical qualification from a medical school located in a different country from that in which they practice or intend to practice. IMGs are known to face difficulties in their working lives, including differential attainment in assessment. The objective of this review is to map key concepts and types of evidence in academic and gray literature relating to international medical graduates’ experiences of clinical competency assessment and to identify knowledge gaps on this topic by systematically searching, selecting, and synthesizing existing knowledge. All studies will relate to IMGs. The concept of interest will be IMGs’ experiences of assessment. The context will be postgraduate, licensing or credentialing medical assessments of clinical competence. This review will be conducted in accordance with the Joanna Briggs Institute (JBI) methodology for scoping reviews. Seven electronic databases will be searched for literature published between 2009 and 2024: the Australian Education Index, British Education Index, ERIC, PubMed, PsycINFO, Scopus, and SocINDEX. Gray literature will be searched using Google, Google Scholar, and published reports from postgraduate training bodies and medical licensing organizations. Documents will be independently screened, selected, and extracted by two researchers using a piloted data-extraction tool. Data will be analyzed and presented in tables and in a narrative format. **Scoping review registration** Open Science Framework: [https://osf.io/8gdm7](https://osf.io/8gdm7) Keywords * Clinical competence * differential attainment * educational measurement * emigration and immigration * foreign medical graduates ## Introduction The term ‘international medical graduate’ (IMG) refers to a doctor who received their basic medical qualification from a medical school located in a different country from that in which they practice or intend to practice.1,2 In 2021, nearly one-fifth (19%) of doctors across OECD countries had obtained at least their basic medical qualification in another country, up from 15% a decade earlier, with the percentage of foreign-trained doctors currently exceeding 24% in Canada, 31% in the UK, 32% in Australia, 40% in Ireland, and 42% in New Zealand.3 International medical graduates often fill in gaps in healthcare provision and are more likely to work in underserved areas or in non-training service positions.4,5 Many studies have shown that IMGs experience adaptation difficulties when beginning to work in a new country, including professional disorientation, integration difficulties, and barriers to training entry.1,2,6,7 A number of recent systematic and scoping reviews have examined the evidence relating to IMGs’ integration difficulties and the discrimination they face in their working lives.2,6,7 Common themes included inadequate professional recognition, lack of opportunities, marginalization, subtle interpersonal exclusions, stereotypes, stigma, and favoring local graduates. While many of the issues relating to unfavorable treatment may affect IMGs’ performance and assessment outcomes, their experiences in relation to assessment were not explored in these reviews.2,6,7. Lack of training opportunities and difficulty in passing exams are cited reasons why IMGs may be dissatisfied with work in their adopted countries.1 There is a growing body of evidence to suggest the existence of a discrepancy in postgraduate assessment performance between IMGs and locally trained graduates.8,9 This gap between the attainment levels of different groups of doctors is known as differential attainment.10 Differential attainment has been observed when comparing examination performance and career progression between IMGs, locally trained white doctors, and locally trained doctors from Black and Minority Ethnic groups.11 It has been observed in both licensing and postgraduate examinations.12,13 The difference in attainment exists despite correcting for possible confounders.11 Studies from the United Kingdom have revealed differential attainment in the assessments for membership of postgraduate training bodies when IMGs’ performance is compared with UK graduates’ performance.8,12,13 Differential attainment has been observed in knowledge-based multiple-choice examinations14,15 as well as in clinical examinations.8,12 An independent review in 2013 found that white UK trained candidates were four times more likely to pass the Royal College of General Practitioners (RCGP) Clinical Skills Assessment than ethnic minority UK trained candidates and 14 times more likely to pass than candidates who had trained overseas.8 This finding led the British Association of Physicians of Indian Origin to bring a judicial review against the RCGP and the General Medical Council (GMC) claiming discrimination.16 This judicial review found that the RCGP was neither racially discriminatory nor in breach of its public sector equality duty, but it highlighted that there was a disparity in results between different groups, and that the RCGP must take action. It concluded that “*If it* [the RCGP] *does not act and its failure to act is the subject of a further challenge in the future, it may well be that it will be held to have breached its duty”*16 [p. 9]. Similar evidence of differential attainment has been reported in the United States, Canada, Europe, and elsewhere.4,17–19 A study from Canada found that fewer than half of IMGs passed their certification Objective Structured Clinical Examination, while almost all (93.5%) Canadian and American graduates passed.17 Similarly, a study from Sweden, of candidates taking an assessment at the end of internship, found that graduates from Swedish universities had a failure rate of less than 4% in contrast to graduates from other EU countries and non-EU graduates who failed at a rate of 21.2% and 41.6% respectively.18 The reasons for differential attainment are not fully understood. Differential attainment is still evident, even when potential confounders are considered, such as pre-university attainment and socioeconomic status20 own and parents’ first language, motivation for being a doctor, study habits, living arrangements (home or away), and personality.21 Some possible explanations for differential attainment include barriers to training that IMGs experience in their working lives, such as difficulty in accessing training positions, lack of insight into the system, lack of clarity regarding educational supervisors, discrepancies in training budgets, and access to study leave when compared with doctors in training positions.5,22 A GMC report from 2019 highlighted the importance of support in the working environment as a factor that promoted success in training progression. These supports included an inclusive workplace, a supportive trainer, and support to navigate the process of completing challenging professional examinations.23 While differential attainment has been observed in knowledge-based assessment, this scoping review project will focus specifically on publications related to clinical competence assessment, including but not confined to OSCEs, workplace-based assessments, direct observation of procedures, and mini-clinical examinations. Publications related to knowledge-based assessments only will be excluded. The rationale for this is that there are many qualitative differences between the experience of undergoing clinical competency assessment and the experience of sitting knowledge-based written examinations,24 including the dynamics between candidates, examiners, real patients, and simulated patients that occur in clinical examinations but not in knowledge-based assessment. Additionally, clinical assessment mirrors the day-to-day practice of medicine more closely than knowledge-based written examinations and is therefore a very relevant measure of an IMG’s adaptation and integration into a new healthcare system. A preliminary search of PubMed, the Cochrane Database of Systematic Reviews, and *JBI Evidence Synthesis* was conducted to determine what evidence exists regarding IMGs’ experiences in relation to postgraduate and medical licensing assessment. In 2015, the UK GMC commissioned a rapid review to understand differential attainment across medical training pathways.25 This review found that most published studies focused on examination outcomes, such as pass/fail and progression/non-progression outcomes, and did not examine IMGs’ experiences, opinions, or attitudes toward assessment. There have been no further reviews on this topic since 2015, and no systematic or scoping reviews on the topic of IMGs’ experiences of clinical competency assessment were identified. ## Materials and Methods Scoping review methodology will be used. A scoping review is a method of knowledge synthesis that addresses an exploratory research question and aims to map key concepts, types of evidence, and gaps in research related to a specific field by systematically searching, selecting, analyzing, and synthesizing existing knowledge in both peer-reviewed and gray literature.26 Because the aim of this review is to address a broad research question and to map the existing academic and gray evidence related to the topic, we consider a scoping review to be the most appropriate method for this study. The proposed scoping review will follow the PRISMA Extension for Scoping Reviews (PRISMA-ScR) reporting guidelines.27 A filled PRISMA-ScR checklist can be viewed in Appendix 1. The six-step framework devised by Arksey and O’Malley28 and further enhanced by Levac et al29 will be used. These steps are: (i) identifying the research question, (ii) identifying relevant studies, (iii) study selection, (iv) charting the data, (v) collating, summarizing, and reporting the results, and (vi) consultation (optional). This review will be conducted in accordance with the JBI methodology for scoping reviews.30 ## Step 1: Identifying the research questions The objective of this scoping review is to map key concepts and types of evidence in academic and gray literature relating to IMGs’ experiences of clinical competency assessment and to identify the gaps in our knowledge on this topic by systematically searching, selecting, analyzing, and synthesizing existing knowledge. The research questions are: 1. What literature has been published relating to the experiences of international medical graduates undertaking clinical postgraduate and licensing medical examinations? 2. What experiences do international medical graduates describe in relation to clinical postgraduate and licensing medical examinations? 3. What are the gaps in the literature relating to our knowledge and understanding of international medical graduates’ experiences of clinical postgraduate and licensing medical examinations? ## Step 2: Identifying relevant studies This scoping review will consider peer-reviewed and gray literature. Qualitative, quantitative, and mixed-methods studies will be included. Reports, reviews, theses, letters, book chapters, opinion pieces, and organizational documents will also be considered. ### Inclusion criteria #### Participants Studies will relate to international medical graduates. For this study, IMGs will be defined as medical doctors practicing in a country other than that in which they received their basic medical qualification. Studies relating to locally trained graduates and those that do not differentiate between IMGs and locally trained graduates will be excluded. Studies related to other healthcare professionals (not medical doctors) will also be excluded. #### Concept The concept of interest will be IMGs’ experiences of clinical competency assessment. #### Context The context will be postgraduate, licensing, or credentialing medical assessment that incorporates elements designed to measure clinical competence, including but not limited to OSCEs, workplace-based assessments, direct observation of procedures, and mini-clinical examinations. Studies that relate only to knowledge-based assessments, such as multiple-choice assessments, will be excluded. ## Search strategy The search strategy will aim to identify published and unpublished studies. An initial limited search of PubMed and Scopus was carried out to become familiar with the available evidence and to identify common keywords associated with the study population and topic. Subsequently, text words, index terms, and MESH headings from relevant articles were combined to develop a full search strategy for the British Education Index, ERIC, PubMed, Psych Info, Scopus, and Soc Index. The initial search of PubMed is provided in Appendix 2. The search strategy, including all identified keywords and index terms, will be adapted for each database and/or information source. A forward and backward citation search will be conducted for all included sources of evidence to screen for additional studies. Sources of unpublished studies or gray literature to be searched include Google, Google Scholar, and reports of relevant stakeholders, such as postgraduate medical training bodies and medical licensing organizations. Publications from 2009 to 2024, which are available in the full text, will be considered for inclusion. This date range was chosen to allow us to include studies regarding differential attainment, which were mainly published from 2012 onwards, while bearing in mind that postgraduate and licensing examinations are regularly reviewed and updated. Therefore, experiences from previous iterations of assessment are not relevant to the current issues faced by international medical graduates. ## Step 3: Study/Source of Evidence selection Following the search of all sources, identified citations will be collated and uploaded into the Covidence systematic review software (Veritas Health Information, Melbourne, Australia). Duplicates will be removed. A pilot test will be conducted to trial the inclusion criteria. No language restrictions will be applied. From the initial searches, we believe that the number of non-English language papers will be low. If the need arises, every effort will be made to translate relevant papers into other languages. After the pilot, three reviewers will use the inclusion and exclusion criteria (Table 1) to screen the titles and abstracts of all citations, with two researchers independently screening each item. Thereafter, full texts will be retrieved for sources that were identified as potentially relevant, and these will be assessed in detail against the inclusion criteria by two of the three independent reviewers. Sources that do not meet the inclusion criteria for full-text review will be removed. The reasons for exclusion will be recorded and reported in the scoping review. If any disagreements arise between the reviewers at any stage of the selection process, these sources will be discussed, and if necessary, an additional reviewer or reviewers will be involved in resolving the issue. The results of the search and the study inclusion process will be documented in the final scoping review using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Review (PRISMA-ScR) flow diagram.27 View this table: [Table 1:](http://medrxiv.org/content/early/2024/05/28/2024.05.28.24307860/T1) Table 1: Inclusion and Exclusion Criteria ## Step (iv): Charting the Data A data extraction tool specific to the research questions will be developed and piloted by the reviewers. Three independent reviewers will use the data extraction tool to extract and record the data from the papers. The extracted data will include specific details about the study participants, concepts, contexts, study methodologies, and key findings relevant to the review questions. The draft extraction tool can be viewed in Appendix 3. This will be modified and revised as necessary during the process of extracting data from each of the included sources of evidence. All modifications will be described in the scoping review. To reduce the possibility of error or bias, two of the three reviewers will independently extract the data from each source. Disagreements between the reviewers will be resolved through discussion or with the involvement of an additional reviewer. In cases where essential data are lacking, the authors of the respective papers will be contacted to request the required information. ## Step (v): Collating, summarizing, and reporting the results As per the JBI Manual for Evidence Synthesis 2020 Guideline30, the results will be presented as both diagrams and tables, with a descriptive summary discussing how the results relate to the review objectives and questions. The summary will also identify possible areas for further research on this topic. The results will be categorized according to the key themes identified and will relate back to the specific review objectives on the experiences of international medical graduates in relation to postgraduate and licensing clinical competency assessments. ## Step (vi): Consultation Experienced researchers will advise throughout the process including an expert in assessment who is also an international medical graduate. This protocol has been registered and published on the Open Science Framework (available at: [https://osf.io/8gdm7](https://osf.io/8gdm7)) ## Discussion The strengths of this study lie in the chosen methodology. The search strategy has been designed to be inclusive, with searches of multiple databases, gray literature and reports from the relevant medical licensing and assessment bodies. Adhering to the JBI methodological framework for scoping reviews will allow for a broad exploration of the research landscape. The use of the PRISMA ScR reporting guidelines will ensure transparency at all stages in the reporting process. A potential limitation of the study may be the difficulty in obtaining translations of sources that are not published in the English language. However, the researchers are based in a University with a large multinational faculty and global research links and every effort will be made to obtain translations of all relevant sources. As with all reviews, there is the potential for publication bias in the studies included. This will be considered and discussed in the final review. The findings of this scoping review will be disseminated via peer reviewed journal publication and presentation at medical conferences. This scoping review will be part of a larger piece of work which aims to explore the issues and difficulties faced by international medical graduates in relation to clinical competency assessment. While there are published reviews of the issues faced by IMGs in relation to working and acclimatization in a new country, these do not deal specifically with issues related to assessment. This work will add to the body of existing knowledge in this field. Due to the large number of IMGs now staffing health services across the globe, we believe that this review is timely and that it has the potential to suggest ways to improve assessment for international and local medical graduates. ## Data Availability No datasets were generated or analysed during the current study. All relevant data from this study will be made available upon study completion. ## Acknowledgements The authors acknowledge the contribution of Virginia Conrick, a librarian at University College Cork, for her assistance in devising the search strategy. ## S1: Appendix 1 Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) Checklist ![Table2](http://medrxiv.org/) [Table2](http://medrxiv.org/content/early/2024/05/28/2024.05.28.24307860/T2) *From:* Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, et al. PRISMA Extension for Scoping Reviews (PRISMA ScR): Checklist and Explanation. Ann Intern Med. 2018;169:467–473. doi: 10.7326/M18-0850. ## Appendix 2: Search strategy ### PubMed (National Library of Medicine) Search conducted on May 10thth, 2024. ![Table3](http://medrxiv.org/https://www.medrxiv.org/content/medrxiv/early/2024/05/28/2024.05.28.24307860/T3.medium.gif) [Table3](http://medrxiv.org/content/early/2024/05/28/2024.05.28.24307860/T3) This strategy used in PubMed will be revised for use with British Education Index, ERIC, Psych Info, Scopus, and Soc Index. ## S3: Appendix 3 Data Extraction Tool ![Table4](http://medrxiv.org/) [Table4](http://medrxiv.org/content/early/2024/05/28/2024.05.28.24307860/T4) * Received May 28, 2024. * Revision received May 28, 2024. * Accepted May 28, 2024. * © 2024, Posted by Cold Spring Harbor Laboratory This pre-print is available under a Creative Commons License (Attribution 4.0 International), CC BY 4.0, as described at [http://creativecommons.org/licenses/by/4.0/](http://creativecommons.org/licenses/by/4.0/) ## References 1. 1.Malau-Aduli BS, Smith AM, Young L, Sen Gupta T, Hays R. To stay or go? Unpacking the decision-making process and coping strategies of International Medical Graduates practising in rural, remote, and regional Queensland, Australia. PLoS One. 2020 Jun 1;15(6). 2. 2.Healey SJR, Fakes K, Nair BR. Inequitable treatment as perceived by international medical graduates (IMGs): a scoping review. BMJ Open. 2023 Jul 12;13(7):e071992. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6NzoiYm1qb3BlbiI7czo1OiJyZXNpZCI7czoxMjoiMTMvNy9lMDcxOTkyIjtzOjQ6ImF0b20iO3M6NTA6Ii9tZWRyeGl2L2Vhcmx5LzIwMjQvMDUvMjgvMjAyNC4wNS4yOC4yNDMwNzg2MC5hdG9tIjt9czo4OiJmcmFnbWVudCI7czowOiIiO30=) 3. 3.OECD. Health at a Glance 2023 [Internet]. OECD; 2023 Nov. (Health at a Glance). Available from: [https://www.oecd-ilibrary.org/social-issues-migration-health/health-at-a-glance-2023_7a7afb35-en](https://www.oecd-ilibrary.org/social-issues-migration-health/health-at-a-glance-2023_7a7afb35-en) 4. 4.Jenkins TM, Franklyn G, Klugman J, Reddy ST. Separate but Equal? The Sorting of USMDs and Non-USMDs in Internal Medicine Residency Programs. J Gen Intern Med. 2020 May 10;35(5):1458–64. 5. 5.Tyrrell E, Keegan C, Humphries N, McAleese S, Thomas S, Normand C, et al. Predictors of career progression and obstacles and opportunities for non-EU hospital doctors to undertake postgraduate training in Ireland. Hum Resour Health. 2016 Jun 30;14. 6. 6.Motala MI, Van Wyk JM. Experiences of foreign medical graduates (FMGs), international medical graduates (IMGs) and overseas trained graduates (OTGs) on entering developing or middle-income countries like South Africa: A scoping review. Vol. 17, Human Resources for Health. BioMed Central Ltd.; 2019. 7. 7.Michalski K, Farhan N, Motschall E, Vach W, Boeker M. Dealing with foreign cultural paradigms: A systematic review on intercultural challenges of international medical graduates. Vol. 12, PLoS ONE. Public Library of Science; 2017. 8. 8.Esmail A, Roberts C. Independent Review of the Membership of the Royal College of General Practitioners (MRCGP) examination). 2013. 9. 9.Tiffin PA, Illing J, Kasim AS, McLachlan JC. Annual Review of Competence Progression (ARCP) performance of doctors who passed Professional and Linguistic Assessments Board (PLAB) tests compared with UK medical graduates: National data linkage study. Vol. 348, BMJ (Online). BMJ Publishing Group; 2014. 10. 10.Wakeford R, Denney M, Ludka-Stempien K, Dacre J, McManus IC. Cross-comparison of MRCGP & MRCP(UK) in a database linkage study of 2,284 candidates taking both examinations: Assessment of validity and differential performance by ethnicity. BMC Med Educ. 2015 Dec 12;15(1). 11. 11.Woolf K, McManus IC, Potts HWW, Dacre J. The mediators of minority ethnic underperformance in final medical school examinations. British Journal of Educational Psychology. 2013 Mar;83(1):135–59. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/j.2044-8279.2011.02060.x&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23369179&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F05%2F28%2F2024.05.28.24307860.atom) 12. 12.Luton OW, Mellor K, Robinson DBT, Barber Z, James OP, Powell AGMT, et al. Differential attainment in higher surgical training: scoping pan-specialty spectra. Postgrad Med J. 2023 Jul 21;99(1174):849–54. 13. 13.McManus IC, Wakeford R. PLAB and UK graduates’ performance on MRCP(UK) and MRCGP examinations: data linkage study. BMJ. 2014 Apr 17;348(apr16 3):g2621–g2621. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MzoiYm1qIjtzOjU6InJlc2lkIjtzOjE3OiIzNDgvYXByMTZfMy9nMjYyMSI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDI0LzA1LzI4LzIwMjQuMDUuMjguMjQzMDc4NjAuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 14. 14.Pattinson J, Blow C, Sinha B, Siriwardena A. Exploring reasons for differences in performance between UK and international medical graduates in the Membership of the Royal College of General Practitioners Applied Knowledge Test: A cognitive interview study. BMJ Open. 2019 May 1;9(5). 15. 15.Menzies L, Minson S, Brightwell A, Davies-Muir A, Long A, Fertleman C. An evaluation of demographic factors affecting performance in a paediatric membership multiple-choice examination. Postgrad Med J. 2015 Feb 1;91(1072):72–6. [Abstract/FREE Full Text](http://medrxiv.org/lookup/ijlink/YTozOntzOjQ6InBhdGgiO3M6MTQ6Ii9sb29rdXAvaWpsaW5rIjtzOjU6InF1ZXJ5IjthOjQ6e3M6ODoibGlua1R5cGUiO3M6NDoiQUJTVCI7czoxMToiam91cm5hbENvZGUiO3M6MTI6InBvc3RncmFkbWVkaiI7czo1OiJyZXNpZCI7czoxMDoiOTEvMTA3Mi83MiI7czo0OiJhdG9tIjtzOjUwOiIvbWVkcnhpdi9lYXJseS8yMDI0LzA1LzI4LzIwMjQuMDUuMjguMjQzMDc4NjAuYXRvbSI7fXM6ODoiZnJhZ21lbnQiO3M6MDoiIjt9) 16. 16.Between: The Queen on the application of BAPIO Action Ltd. (Claimant) v Royal College of General Practitioners (First Defendant) and General Medical Council (Second Defendant). 2014. 17. 17.MacLellan AM, Brailovsky C, Rainsberry P, Bowmer I, Desrochers M. Examination outcomes for international medical graduates pursuing or completing family medicine residency training in Quebec. Vol. 56, Canadian Family Physician • Le Médecin de famille canadien. 2010. 18. 18.Östgren CJ, Krook-Brandt M, Carlborg A. Internship-test reveals increased knowledge gaps. Lakartidningen. 2016 Apr 8;113. 19. 19.Wikaire E, Curtis E, Cormack D, Jiang Y, McMillan L, Loto R, et al. Predictors of academic success for Māori, Pacific and non-Māori non-Pacific students in health professional education: a quantitative analysis. Advances in Health Sciences Education. 2017 May 1;22(2):299–326. 20. 20. Broecke Stijn, Nicholls Tom. Ethnicity and degree attainment (research report RW92). 2007. 21. 21.Woolf K, McManus IC, Potts HWW, Dacre J. The mediators of minority ethnic underperformance in final medical school examinations. British Journal of Educational Psychology. 2013 Mar;83(1):135–59. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1111/j.2044-8279.2011.02060.x&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=23369179&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F05%2F28%2F2024.05.28.24307860.atom) 22. 22.Rasquinha M. Difficulties and educational challenges faced by international medical graduates in trust grade roles in the UK. Br J Hosp Med. 2022 Apr 2;83(4):1–7. [PubMed](http://medrxiv.org/lookup/external-ref?access_num=http://www.n&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F05%2F28%2F2024.05.28.24307860.atom) 23. 23.Roe V, Patterson F, Edwards KH. “What supported your success in training?” Executive Summary Background [Internet]. 2019 [cited 2023 Jun 25]. Available from: [https://www.gmc-uk.org/-/media/documents/gmc-da-final-report-success-factors-in-training-211119\_pdf-80914221.pdf](https://www.gmc-uk.org/-/media/documents/gmc-da-final-report-success-factors-in-training-211119_pdf-80914221.pdf) 24. 24.Miller GE. The assessment of clinical skills/competence/performance. Academic Medicine. 1990;65(9):S63–67. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1097/00001888-199009000-00045&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=2400509&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F05%2F28%2F2024.05.28.24307860.atom) [Web of Science](http://medrxiv.org/lookup/external-ref?access_num=A1990EA23700032&link_type=ISI) 25. 25. Regan De Bere S, Nunn S, Nasser M. Understanding differential attainment across medical training pathways: A rapid review of the literature Final report prepared for The General Medical Council. 2015. 26. 26.Colquhoun HL, Levac D, O’Brien KK, Straus S, Tricco AC, Perrier L, et al. Scoping reviews: time for clarity in definition, methods, and reporting. J Clin Epidemiol [Internet]. 2014 Jul [cited 2024 Jan 13];67(12):1291–4. Available from: [https://www.jclinepi.com/article/S0895-4356(14)00210-8/fulltext](https://www.jclinepi.com/article/S0895-4356(14)00210-8/fulltext) 27. 27.Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Ann Intern Med. 2018 Oct 2;169(7):467–73. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.7326/M18-0850&link_type=DOI) [PubMed](http://medrxiv.org/lookup/external-ref?access_num=30178033&link_type=MED&atom=%2Fmedrxiv%2Fearly%2F2024%2F05%2F28%2F2024.05.28.24307860.atom) 28. 28.Arksey H, O’Malley L. Scoping studies: towards a methodological framework. Int J Soc Res Methodol. 2005 Feb;8(1):19–32. [CrossRef](http://medrxiv.org/lookup/external-ref?access_num=10.1080/1364557032000119616&link_type=DOI) 29. 29.Levac D, Colquhoun H, O’Brien KK. 2010, ‘Scoping studies: advancing the methodology’, I vol. 5, no. 69, pp. 1–9. Implementation Science. 2010;5(69):1–9. 30. 30.Peters M, Godfrey C, McInerney P, Munn Z, Tricco A, Khalil H. Chapter 11: Scoping reviews. In: JBI Manual for Evidence Synthesis. JBI; 2020.