Policy evaluation frameworks for rare diseases: a scoping review Authors: Mehtap Çakmak Barsbay, Muhammed Yusuf Aydamak Published: 2025 ABSTRACT BackgroundThe epidemiological burden of rare diseases positions them as a global public health challenge. Because rare disease policies are heterogeneous and complex, evaluating their effectiveness requires a systematic and structured approach. Policy evaluation frameworks provide tools to understand how policies are defined, implemented, and assessed in different health systems. These frameworks help identify gaps in policy design and support the development of mechanisms to improve rare disease management. Although several policy evaluation methods have been proposed, no study has synthesized them in a structured and comparative manner. This study aims to map existing policy evaluation frameworks for rare diseases, describe their overarching structures, and propose recommendations for improvement.ResultsThis scoping review followed the Context, Population and Concept (CPC) structure to guide the search strategy. Databases and grey literature were searched from inception to 1 May 2025. Ultimately, five studies were included for extraction and evaluation. The context, population and concept of the included studies were categorized into three thematic domains: policy focus, policy problem, and stakeholder groups and collaboration.ConclusionsThe limited number of available frameworks underscores the need for further methodological development. While current approaches provide initial insights, they remain context-specific and lack a unified, transferable framework applicable to different health systems. Background Rare diseases are defined as conditions that affect a small proportion of the population. However, they represent a significant global health burden [1]. In Europe, an estimated 30 million people live with one of the 6,000–8,000 known rare diseases [2], and similar figures are reported in the United States, where more than 30 million individuals are affected by over 7,000 conditions [3]. Most rare diseases are genetic in origin [4], and their number continues to expand as new conditions are identified [5]. Approximately 95% of rare disease patients lack access to approved treatments, and around 70% of rare diseases manifest in childhood, with nearly 30% of diagnosed children dying before the age of five [6]. This heavy epidemiological burden underscores the global importance of rare diseases [7]. Because no health system can fully address the complex needs associated with rare diseases, countries have introduced a range of targeted policy initiatives [8, 9]. In this context, health policies for rare diseases require systematic planning and evaluation to address both patient needs and broader public health goals [10]. Despite growing international attention, substantial gaps remain in the literature regarding structured approaches to policy evaluation in this field [11]. Evidence from previous reviews indicates that many countries face challenges not only in developing rare disease policies but also implementing and monitoring them effectively. To address these challenges, the establishment of shared dialogue mechanisms and scientifically grounded evaluation frameworks is essential [12]. The importance of improving rare disease policy evaluation has also been recognized at the global level. United Nations General Assembly Resolution A/RES/78/173 represents a key strategic milestone encouraging the development of policies devoted to rare diseases [13]. This resolution highlights the need for policies that reduce inequalities faced by individuals with rare diseases and ensure equitable access to care [14]. Given this growing normative and policy momentum, reviewing the methods used in policy evaluation for rare diseases is expected to contribute significantly to their effective management. Nevertheless, rare disease policies still lack clarity and coherence, underscoring the need for a systematic guide, well-defined methodology, and standardized criteria for evaluation. Accordingly, this study aims to analyse policy evaluation frameworks for rare diseases, scope their overarching structures, and propose recommendations for strengthening policy evaluation practices. Method A scoping review was considered the most suitable review methodology for synthesising evidence and identifying key concepts, characteristics, and gaps in the literature [15]. This review followed the Arksey and O’Malley framework, comprising five stages: (1) identifying the research question, (2) identifying relevant studies, (3) study selection, (4) charting the data, and (5) collating, summarising, and reporting the results [16]. Identifying the research question The research questions were structured using the Context, Population and Concept (CPC) framework recommended by the JBI and PRISMA-ScR guidelines [17, 18]. Context included health policy development, implementation, and evaluation related to rare diseases at national, regional, or international levels, covering domains such as access to orphan drugs, reimbursement mechanisms, patient registries, coordinated care, public health planning, or research funding. The population included all relevant stakeholder groups such as policymakers, healthcare professionals, researchers, patients, and advocacy organisations. The concept focused on the frameworks used to evaluate health policies for rare diseases, including approaches assessing policy outcomes, effectiveness, equity, and impact. Based on this structure, the sub-questions were as follows: (1) What is the main focus of the frameworks used to evaluate health policies for rare diseases, and are the policy evaluation frameworks designed for disease-specific evaluation or for general health policy assessment? (2) To what extent do the frameworks involve stakeholders in their development, and which stakeholder groups are typically included? (3) How were policy evaluation frameworks for rare diseases developed, and what similarities and differences exist among them? Inclusion criteria Studies from any health system setting were eligible if they focused on frameworks used to evaluate health policies for rare diseases. Qualitative, quantitative, and mixed-methods studies reporting on the development or application of policy evaluation frameworks were included. Rare disease definitions followed the Orphanet classification [19]. Search terms The search strategy combined: (rare disease OR orphan disease OR orphan drug OR rare disorder OR rare condition) AND (policy checklist OR policy evaluation OR policy framework OR policy assessment OR policy review OR policy analysis). Identifying relevant studies (search strategy) A comprehensive search was conducted in PubMed, Web of Science (Clarivate), Scopus, CINAHL (Ebsco), and Medline (Ebsco) from inception to 1 May 2025 by two independent reviewers. No date restrictions were applied. Backward and forward citation tracking was performed via the databases and Google Scholar. Grey literature searches were conducted using Google and included sources such as WHO, EURORDIS, Rare Diseases International, and the Sarcoma Patient Advocacy Global Network. The search strategy is presented in Table 1. Table 1Search strategyDateDatabaseKeywordsLanguageRecords identified01.05.2025PubMed(“rare disease*”[Title] OR “orphan disease*”[Title] OR “orphan drug*”[Title] OR “rare disorder*”[Title] OR “rare condition*”[Title]) AND (“policy checklist*”[Title] OR “policy evaluat*”[Title] OR “policy framework*”[Title] OR “policy assessment*”[Title] OR “policy frame*”[Title] OR “policy review”[Title] OR “policy analyse”[Title] OR “policy analysis”[Title])English701.05.2025Medline (Ebsco)(“rare disease*” OR “orphan disease*” OR “orphan drug*” OR “rare disorder*” OR “rare condition*”) AND (“policy checklist*” OR “policy evaluat*” OR “policy framework*” OR “policy frame*” OR “policy assessment*” OR “policy review” OR “policy analyse” OR “policy analysis” OR (policy N15 checklist*) OR (policy N15 evaluat*) OR (policy N15 framework*) OR (policy N15 frame*) OR (policy N15 assessment*) OR (policy N15 review) OR (policy N15 analyse) OR (policy N15 analysis))English2401.05.2025CINAHL (Ebsco)(“rare disease*” OR “orphan disease*” OR “orphan drug*” OR “rare disorder*” OR “rare condition*”) AND (“policy checklist*” OR “policy evaluat*” OR “policy framework*” OR “policy frame*” OR “policy assessment*” OR “policy review” OR “policy analyse” OR “policy analysis” OR (policy N15 checklist*) OR (policy N15 evaluat*) OR (policy N15 framework*) OR (policy N15 frame*) OR (policy N15 assessment*) OR (policy N15 review) OR (policy N15 analyse) OR (policy N15 analysis))English1301.05.2025Scopus(“rare disease*” OR “orphan disease*” OR “orphan drug*” OR “rare disorder*” OR “rare condition*”) AND (“policy checklist*” OR “policy evaluat*” OR “policy framework*” OR “policy frame*” OR “policy assessment*” OR “policy review” OR “policy analyse” OR “policy analysis” OR (policy W/15 checklist*) OR (policy W/15 evaluat*) OR (policy W/15 framework*) OR (policy W/15 frame*) OR (policy W/15 assessment*) OR (policy W/15 review) OR (policy W/15 analyse) OR (policy W/15 analysis))English3301.05.2025Web of Science (Clarivate)(“rare disease*” OR “orphan disease*” OR “orphan drug*” OR “rare disorder*” OR “rare condition*”) AND (“policy checklist*” OR “policy evaluat*” OR “policy framework*” OR “policy frame*” OR “policy assessment*” OR “policy review” OR “policy analyse” OR “policy analysis” OR (policy NEAR checklist*) OR (policy NEAR evaluat*) OR (policy NEAR framework*) OR (policy NEAR frame*) OR (policy NEAR assessment*) OR (policy NEAR review) OR (policy NEAR analyse) OR (policy NEAR analysis))English35 Table 1Search strategyDateDatabaseKeywordsLanguageRecords identified01.05.2025PubMed(“rare disease*”[Title] OR “orphan disease*”[Title] OR “orphan drug*”[Title] OR “rare disorder*”[Title] OR “rare condition*”[Title]) AND (“policy checklist*”[Title] OR “policy evaluat*”[Title] OR “policy framework*”[Title] OR “policy assessment*”[Title] OR “policy frame*”[Title] OR “policy review”[Title] OR “policy analyse”[Title] OR “policy analysis”[Title])English701.05.2025Medline (Ebsco)(“rare disease*” OR “orphan disease*” OR “orphan drug*” OR “rare disorder*” OR “rare condition*”) AND (“policy checklist*” OR “policy evaluat*” OR “policy framework*” OR “policy frame*” OR “policy assessment*” OR “policy review” OR “policy analyse” OR “policy analysis” OR (policy N15 checklist*) OR (policy N15 evaluat*) OR (policy N15 framework*) OR (policy N15 frame*) OR (policy N15 assessment*) OR (policy N15 review) OR (policy N15 analyse) OR (policy N15 analysis))English2401.05.2025CINAHL (Ebsco)(“rare disease*” OR “orphan disease*” OR “orphan drug*” OR “rare disorder*” OR “rare condition*”) AND (“policy checklist*” OR “policy evaluat*” OR “policy framework*” OR “policy frame*” OR “policy assessment*” OR “policy review” OR “policy analyse” OR “policy analysis” OR (policy N15 checklist*) OR (policy N15 evaluat*) OR (policy N15 framework*) OR (policy N15 frame*) OR (policy N15 assessment*) OR (policy N15 review) OR (policy N15 analyse) OR (policy N15 analysis))English1301.05.2025Scopus(“rare disease*” OR “orphan disease*” OR “orphan drug*” OR “rare disorder*” OR “rare condition*”) AND (“policy checklist*” OR “policy evaluat*” OR “policy framework*” OR “policy frame*” OR “policy assessment*” OR “policy review” OR “policy analyse” OR “policy analysis” OR (policy W/15 checklist*) OR (policy W/15 evaluat*) OR (policy W/15 framework*) OR (policy W/15 frame*) OR (policy W/15 assessment*) OR (policy W/15 review) OR (policy W/15 analyse) OR (policy W/15 analysis))English3301.05.2025Web of Science (Clarivate)(“rare disease*” OR “orphan disease*” OR “orphan drug*” OR “rare disorder*” OR “rare condition*”) AND (“policy checklist*” OR “policy evaluat*” OR “policy framework*” OR “policy frame*” OR “policy assessment*” OR “policy review” OR “policy analyse” OR “policy analysis” OR (policy NEAR checklist*) OR (policy NEAR evaluat*) OR (policy NEAR framework*) OR (policy NEAR frame*) OR (policy NEAR assessment*) OR (policy NEAR review) OR (policy NEAR analyse) OR (policy NEAR analysis))English35 Search strategy Study selection All retrieved studies were screened in two stages: title/abstract screening and full-text screening. After deduplication, 271 studies remained and were imported into Rayyan for management and manipulation as recommended by Cochrane [20]. It enabled collaborative, blinded screening and tagging of studies, streamlining the initial phases of the review [21]. Two reviewers independently screened titles and abstracts to assess eligibility. English-language publications with accessible full texts were included. Full-text screening was subsequently undertaken to determine final inclusion. Quality appraisal was conducted using the JBI Critical Appraisal Checklist for Policy/Consensus Guideline Evidence [22]. The study selection process is summarised in the PRISMA flow diagram presented in Fig. 1. Fig. 1PRISMA flow diagram for the study PRISMA flow diagram for the study Charting the data Data were charted for all included studies, and characteristics of included studies are presented in Table 2. Table 2Characteristics of included studiesFirst Author & YearCountryOrganizationStudy Type & MethodologyDefinition of Rare DiseasesTarget Population/ Disease GroupAim & ScopeLimitationsContent of the Evaluation FrameworkWinquist et al., 2012 [23]CanadaMinistry of Health and Long-Term Care (Ontario)Stakeholder- participatory; qualitativeAnnual incidence < = 1 in 150,000 live births and/or low prevalenceAll diseases meeting the RD definitionTo provide guidance for public financing policy for rare diseases and develop an evaluation framework for orphan drug reimbursementLimited epidemiological evidence for some diseases may affect the usability of the framework; modelling recommended when data are insufficientSeven-step sequential framework: (1) confirm rarity, (2) understand disease, (3) assess candidate medicine value, (4) model clinical efficacy, (5) evaluate cost and financing, (6) stakeholder/expert evaluation, (7) re-evaluation with new dataWagner et al., 2016 [24]CanadaLASER AnalyticaAdaptation of a multi-criteria decision analysis tool; mixed methodsNo specific definition; adaptable to national contextsAll rare diseasesTo evaluate, compare and improve rare diseases policies using a value-based holistic approachNo specific limitations reportedAdaptation of EVIDEM v3.0 MCDA frameworks;quantitative and qualitative criteria grouped under two evaluation dimensionsCasali et al., 2017 [25]European UnionSarcoma Policy Checklist Expert GroupStakeholder- participatory;qualitativeBased on clinical and epidemiological definition of sarcomaPatients with sarcomaTo support policymakers in improving access to quality information and services for sarcoma patientsFramework limited to sarcoma but extendable to other rare cancersFive evaluation domains: reference centres, professional training, multidisciplinary care, research incentives, timely access to treatmentMenon et al., 2015 [26]CanadaCanadian Organization for Rare Disorders (CORD)Stakeholder participatory; Kingdon’s Multi-Stream Model (qualitative)Prevalence < = 1 in 2,000All rare diseasesTo assess the policy landscape and develop a patient-centred rare disease policy evaluation frameworkNo explicit limitations reportedThree-stream framework based on Kingdon: (1) Problem Stream, (2) Policy Stream, (3) Politics Stream; strong patient participationLi et al., 2023 [27]ChinaChinese UniversitiesContent analysis and bibliometric analysis; mixed methodsLow-prevalence diseases; approximately 20 million affected in ChinaAll rare diseases recognized in literatureTo develop a “tools-themes” analytical framework for evaluating rare diseases policy instruments in ChinaLimitations acknowledged: complexity of policy analysis; need for in-depth analysis; potential institutional biasTwo-dimensional framework: (1) Policy tools (environment-based, supply-based, demand-based), (2) Policy themes derived from document analysis and interviews Table 2Characteristics of included studiesFirst Author & YearCountryOrganizationStudy Type & MethodologyDefinition of Rare DiseasesTarget Population/ Disease GroupAim & ScopeLimitationsContent of the Evaluation FrameworkWinquist et al., 2012 [23]CanadaMinistry of Health and Long-Term Care (Ontario)Stakeholder- participatory; qualitativeAnnual incidence < = 1 in 150,000 live births and/or low prevalenceAll diseases meeting the RD definitionTo provide guidance for public financing policy for rare diseases and develop an evaluation framework for orphan drug reimbursementLimited epidemiological evidence for some diseases may affect the usability of the framework; modelling recommended when data are insufficientSeven-step sequential framework: (1) confirm rarity, (2) understand disease, (3) assess candidate medicine value, (4) model clinical efficacy, (5) evaluate cost and financing, (6) stakeholder/expert evaluation, (7) re-evaluation with new dataWagner et al., 2016 [24]CanadaLASER AnalyticaAdaptation of a multi-criteria decision analysis tool; mixed methodsNo specific definition; adaptable to national contextsAll rare diseasesTo evaluate, compare and improve rare diseases policies using a value-based holistic approachNo specific limitations reportedAdaptation of EVIDEM v3.0 MCDA frameworks;quantitative and qualitative criteria grouped under two evaluation dimensionsCasali et al., 2017 [25]European UnionSarcoma Policy Checklist Expert GroupStakeholder- participatory;qualitativeBased on clinical and epidemiological definition of sarcomaPatients with sarcomaTo support policymakers in improving access to quality information and services for sarcoma patientsFramework limited to sarcoma but extendable to other rare cancersFive evaluation domains: reference centres, professional training, multidisciplinary care, research incentives, timely access to treatmentMenon et al., 2015 [26]CanadaCanadian Organization for Rare Disorders (CORD)Stakeholder participatory; Kingdon’s Multi-Stream Model (qualitative)Prevalence < = 1 in 2,000All rare diseasesTo assess the policy landscape and develop a patient-centred rare disease policy evaluation frameworkNo explicit limitations reportedThree-stream framework based on Kingdon: (1) Problem Stream, (2) Policy Stream, (3) Politics Stream; strong patient participationLi et al., 2023 [27]ChinaChinese UniversitiesContent analysis and bibliometric analysis; mixed methodsLow-prevalence diseases; approximately 20 million affected in ChinaAll rare diseases recognized in literatureTo develop a “tools-themes” analytical framework for evaluating rare diseases policy instruments in ChinaLimitations acknowledged: complexity of policy analysis; need for in-depth analysis; potential institutional biasTwo-dimensional framework: (1) Policy tools (environment-based, supply-based, demand-based), (2) Policy themes derived from document analysis and interviews Characteristics of included studies Adaptation of EVIDEM v3.0 MCDA frameworks; quantitative and qualitative criteria grouped under two evaluation dimensions Stakeholder- participatory; qualitative Collating, summarizing, and reporting the results The review is reported according to PRISMA-ScR guideline [18]; however, no review protocol has been registered or published. Results Screening A total of 112 records were identified through database searches. After removing 66 duplicates, 46 records remained for title and abstract screening. After title and abstract screening, this number was reduced to 13. An additional 275 records were identified through grey literature searches and backward-forward citation tracking. Following the removal of 50 duplicates, 225 records remained. After title and abstract screening, this number was reduced to 3. Then full text screening was applied to 16 studies. Five studies met the inclusion criteria and were included in the final analysis. The study selection process is summarised in the PRISMA flow diagram (Fig. 1). Data extraction Two reviewers independently extracted data using a standardised data extraction form (Table 2). Extracted items included first author and year, country, study type and methodology, rare disease definition, target groups, aim and scope, limitations and content of evaluation frameworks. Discrepancies were resolved through discussion and consensus. Characteristics of studies Five studies were published between 2012 and 2023. Three studies originated from Canada, one from the European Union, and one from China. Definitions of rare diseases varied considerably across studies; one study focused specifically on sarcoma. The studies employed diverse methodological approaches, including stakeholder-participatory designs, mixed-methods analyses, multi-criteria decision analysis, and policy document analysis. Winquist et al. [23] developed an evaluation framework for orphan drug reimbursement in Ontario, Canada. The seven-step framework emphasizes understanding disease characteristics, assessing medicine value, modelling clinical benefits, incorporating cost considerations, and engaging stakeholders before policy revision [23]. Wagner et al. [24] adapted the EVIDEM (Evidence and Value: Impact on Decision Making) multi-criteria decision analysis framework for rare diseases. The adapted framework integrates quantitative and qualitative criteria to support structured, value-based decision-making for rare disease policy issues. Casali et al. [25] developed the Sarcoma Policy Checklist within a European expert initiative. The framework consists of five main domains and 19 sub-items addressing reference centres, professional training, multidisciplinary care, research incentives, and access to treatment. It was designed to inform and strengthen sarcoma-specific policy implementation across EU Member States [25]. Menon et al. [26] used Kingdon’s Multiple Streams Model to examine the rare disease policy environment and to develop a patient-centred evaluation framework. The three streams—problem, policy, and politics—were informed by national and regional workshops involving patients and families facilitated by CORD, resulting in significant patient participation. While ultra-orphan diseases are often defined in the literature as conditions affecting 1 in 50,000 or fewer, the study focused more broadly on access challenges for rare and ultra-rare conditions. Li et al. [27] analysed rare disease policies in China using content analysis and bibliometric methods, developing a two-dimensional “tools–themes” analytical framework. Policy tools (environment-based, supply-based, demand-based) were mapped onto policy themes identified from policy documents and expert interviews, illustrating how policy instruments and thematic priorities interact within China’s rare disease policy landscape. Main themes The synthesis of the five included studies revealed three overarching themes that characterize rare disease policy evaluation frameworks: policy focus, policy problem, and stakeholder groups and collaboration. A conceptual dendrogram illustrating these themes and their sub-themes is presented in Fig. 2. In total, twelve sub-themes were identified across the three thematic domains. Rare Disease Policy Evaluation Frameworks. Fig. 2Dendrogram of themes in rare disease policy evaluation frameworks Dendrogram of themes in rare disease policy evaluation frameworks Policy focus Despite differences in scope and methodological orientation, the included frameworks share several focal areas. These can be grouped under four sub-themes: (1) improvement of public health and service delivery, (2) policy empowerment, (3) continuity and variability, and (4) social expectations and needs. Some frameworks explicitly aim to strengthen existing policies, while others provide guidance for emerging policy areas where gaps persist. In general, the reviewed approaches contribute evaluative structures intended to support more transparent, accountable, and responsive policymaking for rare diseases. Ethical considerations also underlie several frameworks, shaping their boundaries and informing decision processes. Winquist et al. [23] developed a seven-step evaluation framework to inform orphan drug reimbursement decisions in Ontario whether particular medicines should be covered under public funding. Decisions were examined through the lens of public finance policy, with priority given to the reimburser. Guided by principles of accountability, transparency, and evidence-based reasoning, their approach draws on the “accountability for reasonableness” ethical framework, emphasizing transparency, relevance, appeals, and regulation. Wagner et al. [24] adopted a multi-criteria decision analysis (MCDA) approach adapted from the EVIDEM framework. Their method reflects multiple ethical principles—including deontology, utilitarianism, distributive justice, and practical wisdom—and synthesizes clinical evidence, system performance indicators, and societal values into a value-based evaluation process. Casali et al. [25] presented the Sarcoma Policy Checklist, a structured tool covering reference centres, professional training, multidisciplinary care, research incentives, and timely access to treatments. Unlike broader frameworks, it focuses specifically on sarcoma-related policies within the EU. Menon et al. [26] used Kingdon’s Multiple Streams Model to construct a patient-centred framework addressing uncertainties around access to orphan and ultra-orphan drugs. Through national and regional stakeholder consultations facilitated by CORD, patient perspectives were incorporated into the problem, policy, and politics streams. Li et al. [27] examined policy instruments and thematic priorities in China’s rare disease policymaking. Their “tools–themes” framework offers a process-oriented evaluation approach by mapping policy tools (environment-based, supply-based, demand-based) against policy themes. Policy problem The reviewed policy evaluation frameworks address five main policy problem areas: (1) the definition of rare diseases and population prevalence thresholds, (2) decision-making and prioritisation, (3) orphan drug development and cost, (4) the availability and use of evidence-based knowledge, and (5) structural and systemic inequalities in rare disease care. Variation in how rarity is defined represents a foundational problem across frameworks. Most evaluation frameworks include an initial criterion assessing whether a condition meets the prevalence threshold. For instance, the seven-step method proposed by Winquist et al. [23] begins with confirming that the disease is truly rare, establishing rarity as an entry requirement for policy evaluation. Wagner et al.’s [24] decision-making model incorporates disease severity, population size, and societal prioritisation as additional criteria, demonstrating that rarity interacts with broader clinical and social factors. Priority-setting challenges appear prominently, particularly in frameworks assessing public funding or access to therapies. Wagner et al. [24] employ MCDA to structure prioritisation across ethical, clinical, and system-level criteria. Menon et al. [26] highlight uncertainties in patient access and position patient perspectives as essential inputs into agenda-setting and prioritisation processes. The cost and affordability of orphan drugs constitute a distinct policy problem, closely linked but not reducible to priority-setting. Winquist et al. [23] integrate cost-effectiveness, clinical effectiveness, and budget impact into their seven-step model, directly addressing reimbursement complexity. Menon et al. [26] identify value for money, affordability, and therapy adoption and diffusion as core decision domains, revealing the financial and system-level constraints shaping orphan drug policy. A recurring challenge across frameworks is the scarcity of robust clinical and epidemiological data. Problems include small sample sizes, coding inconsistencies, and limited registry infrastructures. Winquist et al. [23] emphasise the centrality of evidence-based reasoning while acknowledging that randomised controlled trials are often infeasible in rare diseases. They advocate the use of surrogate endpoints as pragmatic alternatives. Other frameworks indirectly reflect evidence limitations through their reliance on qualitative methods with stakeholder input or policy mapping approaches. Inequality appears as a cross-cutting concern rather than a formalised component of every framework. It includes disparities in access to diagnosis, treatment availability, specialist centres, and research capacity. Menon et al. [26] address inequalities through patient-centred consultations that reveal barriers to access. Casali et al. [25] indirectly highlight inequalities by documenting cross-country variation in reference centres, training opportunities, and treatment pathways. Li et al. [27] map regional heterogeneity in policy instruments, exposing uneven policy implementation across China. These structural inequalities are compounded by small patient populations, high diagnostic and treatment costs, and limited commercial incentives for pharmaceutical development, all of which constrain equitable policy responses. Stakeholder groups and collaboration The reviewed policy evaluation frameworks engage three stakeholder groups: (1) patients and patient organizations, (2) medical and health sciences experts, and (3) policymakers. By contributing experiential, clinical, and regulatory expertise, these groups collectively shape the creation and practical application of the frameworks. Several frameworks explicitly integrate stakeholder collaboration into their design. For instance, one policy evaluation framework was co-developed by pharmacists, physicians, policymakers, health economists, and patient representatives. Stakeholder involvement is embedded in the sixth step, where joint evaluation is required, highlighting co-decision as a core principle [23]. Similarly, the Sarcoma Policy Checklist was developed with active input from field experts. The checklist includes evaluation criteria promoting multidisciplinary sarcoma care, such as national guideline development, expert team composition, and the assignment of a dedicated healthcare professional to each patient [25]. Menon et al. [26] placed patient engagement at the centre of their framework. National conferences and workshops facilitated by the Canadian Organisation for Rare Disorders (CORD) were used to gather patient perspectives, after which the consultation scope was broadened to include academics, clinicians, and other domain specialists. Discussion This scoping review provides a synthesis of existing methodologies used to evaluate rare disease policies, rather than the policies themselves or the empirical application of policy evaluation frameworks. By analysing the frameworks identified in the literature, it reveals both the diversity and limitations of current methodological approaches. The limited number of available frameworks for rare disease policy evaluation indicates that this is an underdeveloped research area. There is a need for more tailored methodological models that can address the effectiveness of rare disease policies. Several factors can contribute to this gap, including political and economic constraints, data scarcity, and institutional barriers. As highlighted in Li et al.’s study [27], one of the structural challenges is the lack of inter-institutional cooperation in policy development. Bureaucratic fragmentation often leads institutions to operate in silos, formulating policies independently and undermining the potential for a holistic and coordinated approach. These uncoordinated efforts represent a systemic weakness, as it is a barrier for the establishment of essential infrastructure for policy evaluation and data systems. The lack of integrated patient records and well-structured registry systems for both formal and informal caregivers is another barrier for evidence-based policy-making. These barriers are often responsible for limiting capacity to follow-up and evaluate rare diseases policies effectively. A key finding is that existing evaluation frameworks have largely been developed in response to specific regional needs and policy gaps. This demand-driven approach to policy-making suggests that no universally accepted or comprehensive model currently exists for holistically evaluating rare disease policies. The absence of such a framework has been acknowledged at the international level, where global calls emphasize the need for more inclusive and evaluable rare disease policy structures [28]. Comparative studies highlight cross-national disparities in rare disease policies. For example, an analysis of twelve Eurasian countries revealed that none had comprehensive or adequate policies, whereas EU member states performed better than non-member states in policy formulation and implementation [29, 30]. However, designing a rare diseases policy evaluation framework is not without challenges. Population surveys examining respondents’ preferences for treating different patient groups have yielded conflicting results [31], making them difficult to interpret for meaningful policy recommendations. Given the ethical complexities inherent in prioritising rare disease treatments, population preferences alone cannot determine appropriate policy directions. This suggests that majority opinion is not necessarily a good measure of what is ethically appropriate to guide policy decisions and reinforces the importance of structured, evidence-based evaluation tools. The reviewed evaluation frameworks have both similarities and differences. Stakeholder engagement and joint efforts emerge as the strongest commonality among the frameworks. The most significant difference in scope appears to be influenced by regional contexts, as the evaluation frameworks have been shaped to meet local expectations and needs. Characteristics of the population and healthcare systems have played a key role in determining the structure and priorities of these methodologies. For example, the studies by Menon et al. [26] and Winquist et al. [23], both conducted in Canada, reflect the specific social and healthcare needs of that context. Menon et al. [26] incorporated patient perspectives into their methodology; though the qualitative nature of these insights limits their transferability to societies with different cultural norms and healthcare structures. In contrast, the study by Casali et al. [25] focuses on EU countries and evaluates rare disease policy from the perspective of the European healthcare system, reviewing both current practices and future possibilities. A central concern in all frameworks is the economic burden of rare diseases, particularly the high cost of orphan drugs, which makes cost-effectiveness and budget impact analysis key criteria. Policy and research implications The findings of this scoping review yield several implications for both policy development and future research. Firstly, the scarcity of rare disease policy evaluation frameworks across regions underscore the need for more comprehensive and inclusive models capable of addressing issues related to access, funding, and stakeholder engagement. Policymakers should incorporate patient advocacy groups, healthcare professionals, and other relevant stakeholders into evaluation processes to ensure that policies align with real-world needs and priorities. Secondly, the limited availability of high-quality grey literature and the inconsistency of reporting practices point to a broader need for improved documentation and dissemination strategies among rare disease organizations. Establishing centralised and standardised data repositories could enhance transparency, support knowledge exchange, and facilitate policy transfer across national and regional contexts. Finally, future research should examine the long-term effects of rare disease policies on patient outcomes, health equity, and system sustainability. Comparative policy analyses across countries may generate transferable evidence and contribute to the development of global best-pactice models for rare disease policy evaluation. Limitations This study has several limitations. First, only five frameworks met the inclusion criteria, which restricts the breadth of available approaches and limits the generalizability of our findings. Second, the review included only English-language publications, raising the possibility that frameworks published in other languages or embedded in national policy documents may not have been captured. Although grey literature was included, access to some repositories was restricted, and the identification of grey sources relied on searching the websites of rare disease organizations via Google, which may have introduced selection bias. Third, the search strategy relied on title-only searches in the primary databases. This approach aligned with the study’s objective of mapping conceptual structures and schemas rather than reviewing empirical applications. However, it may have reduced sensitivity by omitting studies that discuss policy frameworks explicitly referencing them in the title. Researchers aiming to explore operational or real-world use of rare disease policy evaluation frameworks may wish to broader search strategies. Fourth, the included frameworks were conceptually heterogeneous, differing in their definitions of rare diseases, policy domains, methodological orientations, and evaluation criteria. This heterogeneity limited the ability to conduct structured comparisons across frameworks. Additionally, while efforts were made to ensure consistency in data extraction, thematic synthesis involves interpretive judgment, and researcher subjectivity may have influenced the categorisation and interpretation of themes. Finally, as a scoping review, this study aims to map existing approaches rather than assess the effectiveness or real-world impact of the identified frameworks. The findings should therefore be interpreted as descriptive, intended to provide an overview of current conceptual approaches rather than prescriptive guidance on policy performance or outcomes. Conclusions Based on the findings of this scoping review, the included policy evaluation frameworks for rare diseases converge around three thematic domains: the scope and focus of the policies they aim to assess, the key policy problem areas they address, and the forms of collaboration they establish with stakeholder groups. Across all frameworks, stakeholder engagement, particularly involvement of patients and their families, emerges as a prominent theme. Cost considerations also feature prominently, reflecting the substantial economic burden posed by rare diseases and the high cost of orphan drugs. Variation in how rare diseases are defined contributes to differences in the structure, scope, and application of these evaluation frameworks, suggesting that local context influences evaluation approaches. The studies developing these frameworks often employed mixed methods, drawing on both quantitative evidence and qualitative insights. Given the multifaceted nature of rare diseases, such methodological diversity appears both necessary and appropriate. Overall, the limited number of available frameworks highlights the need for a specialised and comprehensive methodology dedicated to evaluating rare disease policies. Developing such a tool could support improvements in policy design, service delivery, and accountability. However, the considerable cross-country variability in rare disease governance suggests that leadership from international organisations, such as the WHO, may be required to articulate broad evaluative principles, while still allowing countries to adopt specific processes to their national contexts. Creating a single, unified evaluation framework remains challenging due to the clinical, organizational, and technological diversity of the more than 7,000 identified rare diseases. This inherent heterogeneity continues to represent a major barrier to coherent policy development and evaluation in the rare disease field.