Global research agenda for medical education regulation: findings from a nominal group consensus exercise Authors: Valdes Roberto Bollela, Vanessa Burch, Kadambari Dharanipragada, Janneke Frambach, Janet Grant, Lois Haruna-Cooper, Homa Kabiri, James Kelly, Maria-Athina Martimianakis, Fernando Menezes da Silva, Lamiaa Mohsen, John-george Nicholson, Mohammed Ahmed Rashid, David Rojas, Sean Tackett, Cynthia Ruth Whitehead, Dawit Wondimagegn, Rania Zaini Published: 2025 ABSTRACT AbstractBackgroundAlthough medical education regulation is widely practised and given substantial resource and priority by policymakers and leaders, there is little empirical evidence to support it or guide regulation practices at an international level. In recent years, international and cross-border accreditation systems have gained prominence, often linked to migratory opportunities for graduating physicians. Given the high-stakes nature of regulation in medical education, there is a pressing need for research in this area, including the development of a framework to guide how to prioritise the different areas of scholarly inquiry that need to be addressed to best inform and elevate accreditation practices.MethodsThis article reports a nominal group technique consensus exercise on global medical education regulation conducted in August 2023 in London, UK. Participants were invited based on their research and leadership roles in medical education regulation around the world. Working in three groups using the nominal group technique, participants examined issues associated with medical education regulation globally that required research and evaluation.Results18 participants from 11 countries took part. There was remarkable consistency across the three groups. Each group identified over 15 areas of inquiry summarised in seven overall research domains: Purpose, Quality and Sustainability, Economics, Governance, Colonialism, Process and Outcomes.DiscussionRegulation is ubiquitous in medical education, and a panel of international scholars and leaders identified a pressing set of global issues that require exploration to inform future practices. This research agenda can help policymakers and researchers understand and embrace the complexity that underlies this topic and use it to prioritise research efforts in the years ahead.Keywords: Global Health, Health education and promotion, Health policy WHAT IS ALREADY KNOWN ON THIS TOPIC WHAT THIS STUDY ADDS A framework for an ongoing research agenda into the drivers and impact of globalised medical education regulatory programmes, which acknowledges and gives weight to the Global South. A framework for an ongoing research agenda into the drivers and impact of globalised medical education regulatory programmes, which acknowledges and gives weight to the Global South. HOW THIS STUDY MIGHT AFFECT RESEARCH, PRACTICE OR POLICY It is hoped that the research framework proposed here will help inform future research into regulatory practices and evaluation of the drivers and impact of existing global initiatives. It is hoped that the research framework proposed here will help inform future research into regulatory practices and evaluation of the drivers and impact of existing global initiatives. Introduction Medical education regulation is a widely used process intended to protect the public interest by ensuring that individuals and educational organisations adhere to established standards of safety, quality and ethical conduct. At the level of a medical school or postgraduate training programme, the process is resource-intensive, involving a comprehensive review of the institution or programme, including an evaluation of its governance, administration, resources, educational processes and educational outcomes according to the standards and processes that the accrediting body creates. Simply put, regulatory practices are high stakes. They have the power to determine whether an institution is allowed to train professionals,1 which has a direct impact on institutional reputation and finances.2 Furthermore, regulatory practices play an increasingly restrictive role in determining where graduates can work. While the importance of regulatory practices is widely accepted, our understanding of the processes and nuanced impact on stakeholders and institutions is limited.3,7 The literature on medical school regulation so far lacks an explicit conceptual foundation and is commonly studied as a linear process that influences singular outcomes like faculty engagement,8,11 curricular reforms,12 13 licensing exams14,20 or the culture of Continuous Quality Improvement at the schools.21,24 These empirically siloed approaches, however, have not yet addressed how social complexities, like power dynamics, governmental structures or institutional agendas, result in marginalised voices during the regulatory process, inevitably affecting outcomes. These complexities are amplified in the international regulatory context, drawing attention to the lack of scholarly evidence to drive the globalisation of medical school regulation and its effects and impact. The WFME Recognition Programme is often cited as a key example of efforts to elevate global standards in medical education regulation. It was launched in 2012 following the 2010 ECFMG policy announcement - which initially required ECFMG certification for applicants to graduate from schools accredited by WFME-recognised agencies.25 Although the ECFMG policy has since been amended to permit applicants from all schools, WFME has continued to expand its recognition of accreditation agencies worldwide.26 Early data from Van Zanten17 suggest that graduates of WFME-recognised schools perform marginally better on the USMLE compared with those from non-recognised institutions. However, these observed differences may be driven by broader contextual factors, such as access to preparatory resources and the intent to practise in the United States, rather than the recognition status itself. This underscores the need for more rigorous academic inquiry to disentangle correlation from causation. At the same time, the broader impact of the WFME Recognition Programme remains insufficiently examined. Empirical evidence is lacking on its effects in key areas such as graduate quality, brain drain and equity across educational systems. Analyses to date have highlighted inconsistencies in the accreditation procedures of WFME-recognised agencies, particularly around transparency27 and reporting requirements.28 Furthermore, institutions in low- and middle-income countries continue to face significant structural challenges in meeting the accreditation standards of WFME-recognised agencies.29 These challenges, often shaped by political, infrastructural and curricular constraints,29 have received little scholarly attention, and there is limited research to inform how they might be effectively addressed. International regulatory bodies state that one benefit of global regulatory practices is the potential attainment of a “Global Mark of Recognition”.30 They also suggest that globalisation of medical school regulation could help improve medical education by modernising its regulatory practices.31 The argument of ‘modernization’, however, could be problematic if it only suggests the adoption of Global North practices. This is precisely the challenge with the concept of achieving a “Global Mark of Recognition”, which, perhaps inadvertently, reinforces the idea that Global South institutions should adopt Global North ideas and ways of thinking to avoid marginalisation.31 Thus, now more than ever, there is a need to develop a more comprehensive evidence base around regulatory practices that considers the intrinsic complexity associated with standardising regulatory practices across countries with different healthcare systems, diverse higher education models, different resources and approaches to learning, variable local standards of service, multiple regulatory agencies to seek recognition from,26 and in some cases, a lack of transparency around current accreditation processes. Currently, there is no framework available that can guide the prioritisation of different areas of scholarly inquiry that need to be addressed to best inform and advance or improve accreditation practices. In this article, we present a framework of priority research topics that need to be addressed in the field of medical education accreditation. The framework was developed during a 1-day symposium using a consensus-building approach, the Nominal Group Technique (NGT). Methods NGT is a method used to generate ideas and reach consensus.32 We chose this method as it offered a structured brainstorming process where all voices are heard and accounted for, while also offering a process to reach agreement around the discussed areas.33 Participants Two centres for research in Health Professions Education hosted an international symposium, inviting global scholars and thought leaders in medical education based on their research and leadership roles in medical education regulation worldwide. Participants were purposefully selected to ensure a diversity of perspectives across geographic regions. All individuals were senior academics with established expertise in the field. The nationalities of participants are represented in figure 1. Nationalities of participants. Nominal Group Technique NGT was conducted during a full-day meeting at University College London. We started the day with an introduction and contextualisation of the current state of the evidence around international medical education accreditation. After the initial presentation, participants were divided into three groups. Each group was designed to have representation from diverse geographical regions of the world, avoiding overrepresentation from any one region. All participants were instructed to write down as many issues as they each could identify associated with the globalisation of medical school regulation that require research or evaluation during 10 min of silent individual brainstorming. Following brainstorming, participants, one at a time and in turn, had the opportunity to share one of these ideas with the rest of their small group. No discussion was allowed among participants at this point. One of the group members wrote down each shared idea on a flip chart in view of other participants. This process continued until all ideas were recorded. Having no discussion among participants at this stage enabled them to freely report the ideas they considered worth discussing. After the process of individual reporting, each group had the opportunity to discuss all the ideas that had been shared in the group. The goal was to clarify recorded ideas, where needed, and identify duplication and overlap of ideas. After the discussion in each group, participants were asked to identify the top five ideas they considered should be addressed to advance the evidence base and better inform international accreditation practices. In each group, participants gave a 5 to the idea they considered most important and a 4, 3, 2 and 1 to one idea per rank in decreasing order of importance. After all participants ranked their top five ideas, a moderator in each group tallied up the total scores allocated to each recorded idea. The results of the ratings were then shared with all participants. A member of each group shared all the ideas that received any rating within their group, highlighting the top five based on the tallied ranking. This was the first time during the NGT that the groups were presented with the information discussed in the other groups. Participants returned to their groups to discuss the results of their tallies, the areas of agreement and/or new areas of importance identified by the other groups. Each group was then tasked with generating a framework that highlighted the ideas that had been prioritised as well as any connection(s) with other ideas identified by the other groups. The last step in our NGT process was presentation of the frameworks by each group to all participants. The frameworks highlighted key areas that would benefit from scholarly inquiry to help understand the effects of existing international regulatory initiatives and inform future policies for the globalisation of medical school regulation. Each group considered whether to add to their framework based on wider discussion in the plenary session. After the event, the event moderators (DR and JK) jointly examined the three individual frameworks by thematically analysing overlap between the three groups. This analysis included all items generated in the NGT rounds, with special emphasis on the top five scores for each group to develop a consensus framework. The moderators’ aim was to group questions by theme and to examine for any loss of granularity in the final consensus framework. This resulted in seven key areas, which included areas that had featured prominently in early discussions but had dropped out of later rounds of discussion. The final consensus framework was shared with all the authors for final review and endorsement. Results There were 18 participants from 11 countries: Afghanistan, Brazil, Canada, Egypt, Ethiopia, India, the Netherlands, Saudi Arabia, South Africa, United Kingdom and United States of America. Each group had six participants. The ideas with the top five scores for each group are presented below in table 1. Table 1Summary of ideas that received the top five scoreGroup 1 Relevance of population health needs - are they factored in international regulatory practices?19 Programmed ‘brain drain’ to Western countries18 Contextualisation of education is at risk14 Is it ethical to force poor countries to accredit?10 Feasibility and sustainability of international regulatory practices globally7 Marginalisation of voices and experiences from Global South7Group 2 The politics/power relationships of globalisation12 Understanding what drives the engagement of medical institutions in the Global South9 Who pays the price for globalising regulatory practices?6 How can a single set of accreditation standards be relevant globally?5 Will the globalisation of medical school regulation improve the healthcare provided in my country?5 What is the real motivation behind global regulatory practices?5Group 3 Does one size fit all? (universal vs individual)15 Accreditation as a business and threats to methodologies*10 Who is the global regulator accountable to?9 Differences and political power8 Is international medical school regulation a legitimate or fabricated practice?8*“Threats to the methodologies” refer to the processes of international regulatory practices, and how they could be affected when the regulatory practice is driven by economic interests. Summary of ideas that received the top five score “Threats to the methodologies” refer to the processes of international regulatory practices, and how they could be affected when the regulatory practice is driven by economic interests. Each group had a different number of ideas generated throughout the NGT exercise. This impacted the total ratings and score distribution. In group 1, 12 ideas received scores during the ranking exercise; in group 2, there was a total of 17 ideas that received scores and group 3 had 15 ideas receiving scores. The top five ideas from each group presented consistency among the scores (ranges from 19 to 5). Table 2 below outlines the resulting consensus framework of areas that should be addressed to help understand and inform international medical regulatory practices. Each domain in the framework has been identified as an area where further inquiry is needed. The questions presented as part of the framework reflect the ideas and discussion captured through the NGT. Table 2Consensus FrameworkPurposeWhat is the goal of international regulatory practices in medical education?Quality and SustainabilityIs the process of international medical school regulation feasible and sustainable for all countries?Are the international regulatory practices supporting continuous quality improvement processes at educational institutions in both resource-rich and resource-poor countries?Do international regulatory practices require an excess of resources from the educational institutions seeking recognition?EconomicsWhat is the cost of engaging in an international regulatory process to educational institutions?Do the benefits outweigh the costs?Who pays the price for globalising regulatory practices?How does this affect the cost of healthcare, the cost of sickness around the world?GovernanceWho currently controls the international medical education regulatory practices agenda and how might we make agenda setting more equitable?Who comprises the current leadership of the international regulatory bodies, and how is the leadership selected/elected? How can leadership practices become more equitable?What are the agendas of the international regulatory bodies' leadership?Based on the current governmental structure of international regulatory practices, which voices are silenced?How do governmental structures advantage or disadvantage participating groups?Colonialism EffectsHow do international regulatory practices threaten context-specific knowledge and skills that are required in each country? What are the advantages and disadvantages of pursuing a universal standard of quality for medical graduates?How are international regulatory processes triggering discriminatory or inequitable practices in different contexts?How are international regulatory practices marginalising medical schools or medical practitioners from the Global South?Process(the legitimacy, accountability and power associated with the regulatory process)How does the globalisation of medical school regulation process contribute to the legitimisation of medical schools?Who should the international regulatory bodies be accountable to?How are issues of power mitigated within the international regulatory processes? How are power differentials accounted for within the international regulatory practices?Outcomes(An example of outcomes of interest related to regulatory practices)Does international medical accreditation improve the quality of medical education? How will we know?To what extent does the preparation to meet international regulatory standards facilitate the fulfilment of social responsibility objectives within medical schools?Are international accreditation practices triggering brain drain? If so, how can this be studied? Is it an intended or unintended consequence? If unintended, can it be mitigated? Consensus Framework Discussion In medical education, where theory and practice are expected to be integrated to inform key operational elements,34 such as admissions, pedagogy, training models, assessment and evaluation, the lack of scholarly evidence to drive and inform regulatory practices warrants attention. Globalisation of medical school regulation has the power to significantly influence the global distribution of the future medical workforce. Thus, it is of paramount importance that a process with this reach of power and impact be informed by methodological, theory-driven research. While the need for a framework that prioritises accreditation research is clear, traditionally, these agendas have been designed and informed mostly by perspectives from the Global North. The framework presented in this manuscript moved beyond this limitation by using NGT with input from medical education thought leaders representing 11 countries, including the Global South. This framework is not meant to be prescriptive, but to offer some structure for future research and evaluation work on medical education regulatory practices. It’s recognised that within each dimension of the framework, additional relevant questions may arise that are worth exploring. Additionally, this framework could help review existing research and understand where key gaps exist. For example, the framework posits a question about the goal of international regulatory practices. On this, the literature shows that discourses of endorsement and modernisation have helped frame the move towards a globalised medical school accreditation model as a process of altruism and improvement of medical education worldwide.35 Yet, there is little clear evidence to show this has been achieved. On the topic of ‘purpose’, evidence also shows room for improvement around clarity regarding processes and standards used to regulate practices in different countries,26 a proxy of the overall purpose of regulatory practices. Greater clarity could also facilitate comparative case studies of processes required to achieve international regulatory recognition by meeting global rather than local standards, the outcomes of these processes and potential impacts. Such analyses could help inform a reflection on the appropriateness and applicability of global standards, their effects on different national regulatory processes36 and whether they are meeting their intended purpose. In the economics domain, early work presented the approximate cost of a regulatory self-study process conducted to meet the requirements of the Liaison Committee on Medical Education (LCME) accreditation process in the United States. It contrasted achievements with the perceptions of stakeholders involved in the process, showing support for the process but scepticism regarding acting on the identified areas for improvement.37,39 Although informative, the work focused only on one element within the regulatory process (self-study). More information describing the total cost of regulatory self-study processes is needed to undertake cost-benefit analyses and determine the total costs incurred by institutions seeking regulatory recognition as well as costs borne by other stakeholder groups. The governance domain presents an opportunity to focus research questions on how the leadership of regulatory authorities (local and international) is selected or elected and the role(s) of key players in regulatory processes. As an example, within the Canadian context, recent work by Cartmill et al40 has identified how changes in the format of the medical schools’ regulatory process resulted in voices being silenced, and how the addition of a new role within the Canadian accreditation model might shift the power among the regulatory visiting team, warning about the risks associated with having too much power (responsibilities) devoted to one single role. Further studies examining the intersection between power, governance and the structure of international regulatory practices will offer a foundation to better understand the impact of changes in any of these areas. Work focusing on the effects of colonialism shows evidence of how countries outside the Global North have considered international regulatory recognition as a legitimisation process.14 16 18 41 However, this does address the power gradients that exist between international and local regulatory bodies and the need to identify how and to whom international medical school regulatory processes should be accountable. Medical education has also problematised the implementation of universal global standards, especially calling attention to the need to explore the potential benefits, drawbacks and unintended consequences of the approach to foster globalised educational practices.42 Our framework highlights the need to further study the marginalisation potential of international regulatory practices on communities that do not have the infrastructure and/or human resources required to achieve international regulatory recognition. The potential valuable loss of delivering context-specific medicine in different countries and the associated inequitable or discriminatory practices might trigger the need for careful evaluation. Finally, regarding outcomes, several studies exploring the impact of local and international medical school regulatory recognition, using licensing exam scores as a proxy for the quality of graduates, have found associations between accreditation and exam performance.14,1743 44 However, these studies do not prove that accreditation improves education.45 Other outcome work has asked institutional leaders about their perception of regulatory practices as a proxy of showing the impact of medical school regulatory processes, presenting a variety of perspectives, some positive and some neutral.22 38 However, most of the initiatives have been conducted at a local level. Further research is needed to evaluate the impact that globalisation of medical school regulation could have on key issues like brain drain and the social accountability of medical school practices. Conclusion This work represents a first attempt at offering the broader medical education community a framework of priority research issues focusing on the globalisation of medical school regulation. The framework is unique because it was designed to capture the views of medical education thought leaders from the Global North and Global South using a consensus approach (NGT). While this paper aims to offer guidance to researchers focusing on the globalisation of medical school regulation, it is essential to highlight that regulatory practices, as a complex system,46 will continue to evolve. Thus, the framework must be revisited as new evidence emerges and additional voices and perspectives join the conversation. New questions and areas of inquiry will arise as medical educators better understand regulatory processes and how they shape medical education and clinical practice going forward. We encourage the community to further engage in this meaningful work so that the solid evidence needed to understand the decision-making process and its consequences can underpin the future of local and international medical school regulatory practices. Footnotes Funding: The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors. Handling editor: Soumitra S Bhuyan Data availability free text: Data is available on request to the corresponding authors. Patient consent for publication: Not applicable. Ethics approval: Not applicable. Provenance and peer review: Not commissioned; externally peer reviewed. Patient and public involvement: Patients and/or the public were not involved in the design, or conduct, or reporting, or dissemination plans of this research. Map disclaimer: The depiction of boundaries on this map does not imply the expression of any opinion whatsoever on the part of BMJ (or any member of its group) concerning the legal status of any country, territory, jurisdiction or area or of its authorities. This map is provided without any warranty of any kind, either express or implied. Data availability statement Data are available upon reasonable request. References Associated Data Data Availability Statement Data are available upon reasonable request.